What sort of internet connection (and what speed) do you have? 30ms to get to hop #2 is surprising, as is the fact that it is a different RFC1918 netblock. Are you running a VPN?
AT&T MiFi 30Mbps
In that case, my best guess is that you're running into reception issues from time to time on your MiFi. Unfortunately there's not going to be a lot that we can do here if it's taking over 2 minutes to download a 4 second segment of video.
Eventually it's going to get so far behind that the playlist we are reading from will no longer contain all of the segments we need to download to create a complete stream.
Is there’s a way to get SD feeds rather than HD feeds? I did notice that file size of a 1 hr ESPN recording is almost twice the size of a TBS recording, as an example.
It would be technically possible for us to do, but there's a lot of implications for it and how we would present it that we aren't at a point where we can easily tackle.