I have been experiencing this problem ever since I have started playing on the server, it doesn't happen to me on any other servers or any other games. I was able to record it happening 2 times but please know that I don't have the best gaming computer right now so its a pretty crappy recording but you can still see it happen. I am still building my gaming pc. I am just curious if this is a problem with my internet connection to the server or my computer can't handle the surf server? I have the settings on the lowest and I have even turned off rendering trails and unusuals and I still run into the freezing issue. My proof: To save your time it happens at 0:08 and 1:38.
That issue you're experiencing is usually when the server and client desync for any number of reasons and the server is then correcting your client. If you could record more of the same, but in your console put in "net_graph 3" (without quotes). This will display a bunch of stuff in the bottom right which will be of use in helping debug the situation.
My internet speed is 300 Mbps but I have quite a bit of people over. So my main speed when people are over is around 200+ Mbps, my ping on the server is usually around 50