Does it only happen with live content, and not with recorded stuff?
I always figured this is usually since you are tuning into live content, there is no way to build a big 'buffer' because the content is coming in from the HDHR in realtime. You only ever have a second or two ahead in the video, and after conversion of framerates / deinterlacing / whatever else is happening to play the content on your TV, that buffer will run out. You can see in the playback stats how far ahead of a buffer you have, and I would guess that when you see this occur it is dropping from 1-2 seconds down closer to 0.
This is different from when you watch recordings (or any files like with Plex or some other media server), your client might download a 30 sec ahead buffer at 50 or 100 Mbps for a 10 Mbps bitrate file.
With realtime broadcast content, the same isn't possible without time travelling into the future 30 seconds.
My workaround is that after I tune to a channel, I hit back on the remote after a couple of seconds. That rewind gives me a couple seconds of buffer. My wife no longer gets mad at me for doing it, so it isn't too disruptive.
I've asked in the past about a configurable buffer time when tuning to a channel - so we could choose between the fast tuning of channels we currently get, with potential buffer issues, versus delaying playing the content for a time we can set as a buffer builds up.
You can see this with things like Hulu Live TV and even some cable providers, when you tune to a channel it takes a couple of seconds to start playing.