Violation of 1st Amendment

Richard Spencer is a known white supremacist. He gives speeches all around voicing his opinion and some don't agree with him and take offense to what he says. Spencer has had visits scheduled to visit and deliver his speech to universities but they have all cancelled him. The supposedly violates the 1st amendment because it states that public universities cannot cancel or block a speaker from coming based on their views, no matter how offensive it may be to some. Although I do not agree with some of the topics he expresses his opinion on, he does have the right to say whatever he want's.

https://www.nytimes.com/2017/10/19/opinion/richard-spencer-university-florida.html?rref=collection%2Ftimestopic%2FFirst%20Amendment%20(US%20Constitution)&action=click&contentCollection=timestopics&region=stream&module=stream_unit&version=latest&contentPlacement=1&pgtype=collection