High latency Not a channels problem but hope someone can advise

[slampman]

@dtrottman

Maybe I forgot to mention the computer in earlier posts. I did rebuild it with new everything in late March with Windows 11.

Did you replace everything or just reload the OS? I agree with @Michael_Birk the Windows computer is the only variable left.
Are you using the PC for other functions? It could be a resource/utilization issue. Windows is notorious for extensive AV scans, Windows Updates etc.
Personally I HATE using Windows for server functions, I prefer a dedicated Channels server running Linux Server. The overhead of Windows is unnecessary IMHO.

If you want to figure out whether it is the computer or the network you could do this. disconnect your computer from the network. Run a new Ethernet cable directly from your appletv to your computer. set a static IP on your home computer of something like 192.168.50.2/24 with no default gateway. Then IP your appletv to 192.168.50.3/24. Configure your channels client to connect manually to 192.168.50.2 (if it doesn't autodiscover your server) Your PC will not have internet access or access to HDHR/TVE. Run your speedtest and see if the latency problem disappears.

The thing to keep in mind is there are literally dozens of variables in play here. Isolating them is key to resolving...
If you can repro the issue then it is your computer. if that is the case my recommendation is you do a dedicated channels server. If it works perfect in this test configuration then it is your network.

[dtrottman]

I did swap out cables. I will try a direct connection tonight.

[slampman]

I'm leaning more toward your computer being the issue. Other apps are communicating directly from the AppleTV to the provider. They are not going via your PC.

[chDVRuser]

You said you rebuilt the PC.
Is it the same PC you had before?
Same network Adapter on the PC you had before?
Did you get the latest Network Adapter drivers from the manufacturer?
Try turning off any advanced Network Adapter settings that look "green", energy saving.
Check Windows power plan settings also.

What brand and model gigabit network switch are you using? I threw many "green" switches out because of issues. If it's a managed switch, have you checked the setup for flow, bandwidth and storm control?

Everything these days seem to default to "green".

[Michael_Birk]

@dtrottman

Maybe I forgot to mention the computer in earlier posts. I did rebuild it with new everything in late March with Windows 11.

Did you do a clean install of Windows 11 or did you do an upgrade and keep all your apps, files, and current settings? I have been using Windows 11 for my server for 2.5 years on a much less capable machine than you are using. I only use wireless on my FireTV Max clients and get consistently around 4ms latency with the Channels speed test.

[dtrottman]

slampman - Good point about the other apps. I agree it's probably the computer (or Channels DVR server) that is the problem. Generally, the CPU is running 1-5%, memory 15-20%. It's not being stressed. I do the ookla speedtest from the computer and get 12ms latency, 375Mbps download, 11Mbps upload. Seems like the network adapter is ok as going outside has much better performance than internal Channels.

chDVRuser - Same case. Motherboard, CPU, memory, storage all new. Network adapter is built in to the Motherboard. It's intel I225-V. Motherboard is MSI MAG Z790 Tomahawk MAX WiFi. I had the latency issue on my old computer, too.
I did get the latest drivers from MSI. Not from Intel.
I didn't really see any "green" settings for the Network adapter. I do have "Allow computer to turn off device" unchecked.
I checked Windows power plan settings. It's complaining I don't have the "green" settings set. So I think I'm good there.
The switch is a TP-Link TL-SG105E. I logged in to it and see storm control. It is disabled for all ports. Bandwidth is unlimited for all ports. I don't see flow.

Michael Birk- Yes, a clean install. No apps/files/settings kept. The fact that yours works fine is further frustration for me. I can't imagine what might be going on.

Thanks for all the input. I appreciate it. I'm disappointed that channels doesn't have tracing to show how quickly it responds to requests.
I am going to uninstall/reinstall channels later tonight to see if that changes anything. I'm also willing to try or check anything else anyone can suggest.

[dtrottman]

This is so weird. I checked latency earlier this evening and it continued to be bad. We watched a movie on Amazon and for no reason I decided to check latency again.

I sure would like to know what's going on! I didn't do anything. The computer wasn't doing anything.

[john9527]

Try completely turning off your phone (I think I read it was a Pixel?). Some Google phones are notorious for creating an ARP storm.

[dtrottman]

Thanks John, next time it happens I'll try that.

[dtrottman]

Two month update.
I had 2 good weeks then latency went back to 100ms, compared to the <1ms when working well. I closed my chrome windows and the two local servers I have running Ruby on Rails, neither of which do much. The latency reverted back to <1ms.
Problem solved, or so I thought. Two weeks later latency went back to 100ms. I shut down my chrome and RoR servers. No change. Shut down the computer and restarted without chrome or RoR servers. No change. Started chrome and RoR servers. I disconnected HDHomeRun (on a whim) and reconnected hours later. Success! Latency reverted back to <1ms.
Either my computer or HDHomeRun is the problem. Or so I thought. A week ago latency went back to 100ms. I did all of the above with no luck. While chrome and RoR servers down, I have unplugged or blocked all devices except the computer (where Channels lives), Apple box, ethernet switch, and router. No luck.
It's such a mystery. I wish I knew of a diagnostic tool to find the problem rather than all this guessing. Does anyone know of a diagnostic tool to find the problem rather than shutting stuff down and hoping something allows latency to revert back to <1ms?

[jkr4m3r]

Could be a rogue nearby appliance? This happened to me 15-20 years ago. Heck, even now if my CPAP machine in the bedroom is in the "cooling down 1 hour mode" it keeps my old Sony AM-FM radio from getting known good stations.

[tmm1]

There are some tools to detect packet storms which is likely what's happening. I don't know of them offhand. Wireshark may but its a pretty complex tool.

A Broadcast Storm Defined & How to Fix It

[dtrottman]

PingPlotter was recommended before. I got that and installed on my computer where the Channels server is. PingPlotter is reporting .7ms average. Which is what the Channels client reports when times are good.
However, right now my Channels client on Apple TV is reporting 114ms.
I don't know what to make of that. Why would latency be direction dependent?

My AppleTV box is IP 192.168.1.123.

[Michael_Birk]

Since you have replaced everything except the HDHomerun tuner, do you have it updated to the latest firmware? When you have the high latency, have you done an internet speed test from the windows server?

[tmm1]

The pingplotter blog post I linked talks about how they used Wireshark to diagnose storms and how it appears in pingplotter.

It's helpful to run pingplotter for a long period of time and zoom out, so you can see what it looked like when you start noticing the problems elsewhere.

[dtrottman]

hmmm. It looks like upload latency is pretty bad if I'm reading this right.

I never notice the problem anywhere else except when all of a sudden Channels client response time is bad. I'll continue to look into it.
I have not checked HDHomeRun firmware. I will do that.

[dtrottman]

WireShark didn't show the broadcast storm like PingPlotter suggested it would. WireShark is pretty cool so I decided to trace my ethernet while I ran the speedtest from the client. Here's a snippet of it. No ICMP is sent from the client. Looks like HTTP for latency and TCP (maybe) for speeds. 123 is Apple. 120 is my computer. Those times seem bigger than they should. I don't really know when the client determines latency. On the ACK?

[dtrottman]

I sent a note to PingPlotter suggesting I don't see a broadcast storm and wondered if they had any other ideas. They suggested getting a laptop plugged in where the Apple box is and ping from it to my computer and see what I get.
I first issued the HTTP command 192.168.1.120:8089/speedtest and got the following terrible latency.
I then did a ping (after opening up my computer firewall to accept ICMPs) and got the following great latency.

So the question is why is the HTTP to Channels so bad when a ping to the computer is great? Are HTTP packets lower priority?

[dtrottman]

The mystery continues. All of a sudden this morning my <1ms latency is back! Yay!?
I had poor response for over a week, maybe 2 weeks. Here are 3 WireShark snippets at my computer when doing a speedtest with 100ms+ latency followed by a 4th snippet taken this morning with <1ms latency.
In the slow responses the ACK beats the OK every time and the OK is almost 200ms later. Not sure how that lines up with the client reported 100ms latency.
In the fast response the OK is almost immediate.
Doesn't that say there's something going on in my computer or in the Channels DVR for the OK to be so slow in the bad cases?