Network Timeouts and DVR "Hanging"

Channels DVR Server
#1

DVR 2023.01.14.2318
Synology DS220+

Within the past couple of days, I'm seeing issues on all of my clients such as:

  • Channel icons are not refreshed in "On Now" or they very slowly refresh while "On Now" is being viewed
  • TVE streams sometimes work as expected, and sometimes they fail with timeout or "tuner unreachable" messages

FYI - I tried and apparently failed to submit diagnostics from an iPad client (you'll see that message in the log entries at the end of this post)

I've seen this message in the log periodically, also:

2023/01/15 09:45:07.110307 [ERR] Failed to refresh auth: Post "https://community.getchannels.com/dvr/api": dial tcp 104.21.71.35:443: i/o timeout

Here are the some recent log entries following a restart of the ChannelsDVR server on the NAS. Please help me to identify if I have some network issue or if this is something going on at the Channels end of things. Thank you.

2023/01/15 10:15:34.281272 [SYS] Starting Channels DVR v2023.01.14.2318 (linux-x86_64 pid:11276) in /var/packages/ChannelsDVR/target/channels-dvr/data
2023/01/15 10:15:34.612365 [SYS] Started HTTP Server on 8089
2023/01/15 10:15:35.064895 [HDR] Found 1 devices
2023/01/15 10:16:00.315016 [TVE] action=cbs_station err=Post "https://www.cbs.com/live-tv/check-availability/": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
2023/01/15 10:16:10.334978 [TVE] action=cbs_station err=Post "https://www.cbs.com/live-tv/check-availability/": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
2023/01/15 10:16:10.613467 [M3U] Refreshed lineup for PlutoTV with 351 channels
2023/01/15 10:16:28.222181 [DVR] Waiting 2h42m31.777824211s until next job 1673805540-121 NFL Football
2023/01/15 10:16:29.166427 [DVR] Recording engine started in /volume1/ChannelsDVR
2023/01/15 10:16:29.167154 [SYS] Bonjour service running for dvr-jjbds220.local. [192.168.1.28 192.168.1.29]
2023/01/15 10:16:30.354476 [SYS] Created database snapshot: backup-20230115.151629
2023/01/15 10:16:30.354697 [SYS] Removing old backup backup-20221227.135403
2023/01/15 10:16:38.397583 [IDX] Pruned 1558 expired airings from USA-OTA19711 in 163.63188ms.
2023/01/15 10:16:38.797832 [IDX] Pruned 1978 expired airings from X-TVE in 400.204052ms.
2023/01/15 10:16:39.072955 [IDX] Pruned 1348 expired airings from XMLTV-PlutoTV in 275.051749ms.
2023/01/15 10:17:55.685174 [TVE] stream timestamps: cc: start_at=2023-01-15T10:16:54-05:00 end_at=2023-01-15T10:17:25-05:00 live_delay=28.212169519s
2023/01/15 10:17:55.685269 [TNR] Opened connection to TVE-Philo for ch6010 CC
2023/01/15 10:18:20.482399 [SNR] Buffer statistics for 192.168.1.211 (DadPad) for ch6010 CC: buf=0% drop=0%
2023/01/15 10:18:20.486774 [TNR] Closed connection to TVE-Philo for ch6010 CC
2023/01/15 10:26:23.944968 action=requestor err=Get "https://sp.auth.adobe.com/adobe-services/config/AMC?noflash=true": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
2023/01/15 10:26:44.026868 [ERR] Could not start stream for TVE-Philo ch6086 AMC: TVE: Post "https://sp.auth.adobe.com/adobe-services/shortAuthorize": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
2023/01/15 10:27:54.992833 [SYS] Error checking for update: Get "https://channels-dvr.s3.amazonaws.com/prerelease.json": dial tcp 52.217.191.9:443: i/o timeout
2023/01/15 10:30:54.969280 [DVR] Reindexed 2179 airings into XMLTV-PlutoTV (302 channels over 19h0m0s) + 3820 skipped [4s index]
2023/01/15 10:30:55.320787 [DVR]   pruned 110 replaced airings in 0s.
2023/01/15 10:31:09.271976 [DVR] Indexed 40 channels (13440 airings + 0 replaced) with placeholders [13s index]
2023/01/15 10:31:10.733416 [DVR] Fetching guide data for 112 stations in X-TVE @ 2023-01-28 10:30PM
2023/01/15 10:31:40.734211 [DVR] Error fetching guide data: Get "https://data.tmsapi.com/v1.1/lineups/USA-DFLTE/grid?api_key=x26sg2rpk8qyuyn9ddzwmsuu&startDateTime=2023-01-28T22:30-05:00&endDateTime=2023-01-29T04:30-05:00&enhancedCallSign=true&imageSize=Lg&imageAspectTV=4x3&stationId=60179,66268,64241,99450,60964,60150,82696,79318,106796,35044,108919,44861,58623,92008,78808,16220,104846,91404,110291,61812,45399,59303,52329,110480,113380,72422,105440,89360,110839,67375,68065,78584,57394,49788,107076,123130,74030,111043,31780,78601,123127,63236,92020,123126,97502,123122,59440,92204,73171,114174,120551,71601,16123,57390,51529,56905,34969,19614,123120,55559,60222,59814,58988,59155,71799,112157,97163,82547,92041,70388,58452,49438,64492,92205,73163,59186,96971,59337,31046,62077,123125,123119,73994,60046,82649,46710,102337,114278,123129,91579,50747,12553,121307,123128,55916,58574,10183,14771,60468,105723,19613,107241,123124,62420,65342,57391,123123,123380,65626,58625,96827,123121": dial tcp 35.171.132.251:443: i/o timeout
2023/01/15 10:31:40.740707 [DVR] Fetching guide data for 112 stations in X-TVE @ 2023-01-29 4:30AM
2023/01/15 10:32:10.741541 [DVR] Error fetching guide data: Get "https://data.tmsapi.com/v1.1/lineups/USA-DFLTE/grid?api_key=x26sg2rpk8qyuyn9ddzwmsuu&startDateTime=2023-01-29T04:30-05:00&endDateTime=2023-01-29T10:30-05:00&enhancedCallSign=true&imageSize=Lg&imageAspectTV=4x3&stationId=92041,70388,97163,82547,64492,92205,58452,49438,59186,96971,73163,123125,123119,73994,60046,82649,59337,31046,62077,46710,102337,123129,91579,50747,12553,114278,121307,123128,55916,58574,14771,60468,10183,105723,19613,62420,65342,107241,123124,57391,123123,96827,123121,123380,65626,58625,66268,64241,60179,60964,60150,99450,79318,106796,82696,58623,92008,78808,35044,108919,44861,104846,91404,16220,59303,52329,110291,61812,45399,105440,89360,110839,67375,68065,110480,113380,72422,57394,49788,78584,74030,107076,123130,111043,31780,63236,92020,78601,123127,123126,59440,92204,97502,123122,71601,16123,57390,73171,114174,120551,51529,56905,34969,19614,123120,58988,59155,55559,60222,59814,71799,112157": dial tcp 35.171.132.251:443: i/o timeout
2023/01/15 10:32:10.747814 [DVR] Fetching guide data for 112 stations in X-TVE @ 2023-01-29 10:30AM
2023/01/15 10:32:40.748635 [DVR] Error fetching guide data: Get "https://data.tmsapi.com/v1.1/lineups/USA-DFLTE/grid?api_key=x26sg2rpk8qyuyn9ddzwmsuu&startDateTime=2023-01-29T10:30-05:00&endDateTime=2023-01-29T16:30-05:00&enhancedCallSign=true&imageSize=Lg&imageAspectTV=4x3&stationId=105723,19613,107241,123124,62420,65342,57391,123123,123380,65626,58625,96827,123121,60179,66268,64241,99450,60964,60150,82696,79318,106796,35044,108919,44861,58623,92008,78808,16220,104846,91404,110291,61812,45399,59303,52329,110480,113380,72422,105440,89360,110839,67375,68065,78584,57394,49788,107076,123130,74030,111043,31780,78601,123127,63236,92020,123126,97502,123122,59440,92204,73171,114174,120551,71601,16123,57390,51529,56905,34969,19614,123120,55559,60222,59814,58988,59155,71799,112157,97163,82547,92041,70388,58452,49438,64492,92205,73163,59186,96971,59337,31046,62077,123125,123119,73994,60046,82649,46710,102337,114278,123129,91579,50747,12553,121307,123128,55916,58574,10183,14771,60468": dial tcp 34.225.135.33:443: i/o timeout
2023/01/15 10:32:40.754896 [DVR] Fetching guide data for 112 stations in X-TVE @ 2023-01-29 4:30PM
2023/01/15 10:33:10.755493 [DVR] Error fetching guide data: Get "https://data.tmsapi.com/v1.1/lineups/USA-DFLTE/grid?api_key=x26sg2rpk8qyuyn9ddzwmsuu&startDateTime=2023-01-29T16:30-05:00&endDateTime=2023-01-29T22:30-05:00&enhancedCallSign=true&imageSize=Lg&imageAspectTV=4x3&stationId=91579,50747,12553,114278,123129,121307,123128,55916,58574,14771,60468,10183,105723,19613,62420,65342,107241,123124,57391,123123,96827,123121,123380,65626,58625,66268,64241,60179,60964,60150,99450,79318,106796,82696,92008,78808,35044,108919,44861,58623,104846,91404,16220,59303,52329,110291,61812,45399,110839,67375,68065,110480,113380,72422,105440,89360,57394,49788,78584,107076,123130,74030,111043,31780,63236,92020,78601,123127,123126,59440,92204,97502,123122,16123,57390,73171,114174,120551,71601,51529,56905,34969,19614,123120,58988,59155,55559,60222,59814,71799,112157,92041,70388,97163,82547,64492,92205,58452,49438,59186,96971,73163,73994,60046,82649,59337,31046,62077,123125,123119,46710,102337": dial tcp 34.225.135.33:443: i/o timeout
2023/01/15 10:33:10.760690 [DVR] Fetching guide data for 112 stations in X-TVE @ 2023-01-29 10:30PM
2023/01/15 10:33:40.761590 [DVR] Error fetching guide data: Get "https://data.tmsapi.com/v1.1/lineups/USA-DFLTE/grid?api_key=x26sg2rpk8qyuyn9ddzwmsuu&startDateTime=2023-01-29T22:30-05:00&endDateTime=2023-01-30T04:30-05:00&enhancedCallSign=true&imageSize=Lg&imageAspectTV=4x3&stationId=82547,92041,70388,97163,49438,64492,92205,58452,59186,96971,73163,31046,62077,123125,123119,73994,60046,82649,59337,46710,102337,123129,91579,50747,12553,114278,121307,123128,55916,58574,14771,60468,10183,105723,19613,123124,62420,65342,107241,57391,123123,65626,58625,96827,123121,123380,66268,64241,60179,60964,60150,99450,79318,106796,82696,108919,44861,58623,92008,78808,35044,104846,91404,16220,61812,45399,59303,52329,110291,113380,72422,105440,89360,110839,67375,68065,110480,57394,49788,78584,107076,123130,74030,111043,31780,123127,63236,92020,78601,123126,123122,59440,92204,97502,114174,120551,71601,16123,57390,73171,51529,56905,34969,19614,123120,60222,59814,58988,59155,55559,71799,112157": dial tcp 34.225.135.33:443: i/o timeout
2023/01/15 10:33:40.766884 [DVR] Fetching guide data for 112 stations in X-TVE @ 2023-01-30 4:30AM
2023/01/15 10:34:10.767774 [DVR] Error fetching guide data: Get "https://data.tmsapi.com/v1.1/lineups/USA-DFLTE/grid?api_key=x26sg2rpk8qyuyn9ddzwmsuu&startDateTime=2023-01-30T04:30-05:00&endDateTime=2023-01-30T10:30-05:00&enhancedCallSign=true&imageSize=Lg&imageAspectTV=4x3&stationId=123129,91579,50747,12553,114278,121307,123128,55916,58574,14771,60468,10183,105723,19613,62420,65342,107241,123124,57391,123123,58625,96827,123121,123380,65626,66268,64241,60179,60964,60150,99450,79318,106796,82696,44861,58623,92008,78808,35044,108919,104846,91404,16220,45399,59303,52329,110291,61812,72422,105440,89360,110839,67375,68065,110480,113380,57394,49788,78584,123130,74030,107076,111043,31780,63236,92020,78601,123127,123126,59440,92204,97502,123122,120551,71601,16123,57390,73171,114174,51529,56905,34969,19614,123120,59814,58988,59155,55559,60222,71799,112157,92041,70388,97163,82547,64492,92205,58452,49438,59186,96971,73163,62077,123125,123119,73994,60046,82649,59337,31046,46710,102337": dial tcp 34.225.135.33:443: i/o timeout
2023/01/15 10:34:15.672224 [DVR] Rule 'NFL Football' (121) found 1 new airings
2023/01/15 10:34:15.915896 [DVR]   queued recording job for EP000031281137 @ Mon Jan 23 12:29:00AM on ch=[6192] (1674451740-121)
2023/01/15 10:34:16.588185 [DVR] Waiting 2h24m43.411820909s until next job 1673805540-121 NFL Football
2023/01/15 10:37:52.325561 [ERR] Could not start stream for TVE-Philo ch6110 SCIENCE: TVE: Post "https://us1-prod-direct.sciencechannel.com/playback/v3/channelPlaybackInfo": dial tcp 3.222.175.48:443: i/o timeout (Client.Timeout exceeded while awaiting headers)
2023/01/15 10:40:03.295218 [SYS] Error checking for update: Get "https://channels-dvr.s3.amazonaws.com/prerelease.json": dial tcp 52.217.200.177:443: i/o timeout
2023/01/15 10:43:40.305235 action=requestor err=Get "https://sp.auth.adobe.com/adobe-services/config/hallmarkchannel?noflash=true": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
2023/01/15 10:44:00.306317 action=requestor err=Get "https://sp.auth.adobe.com/adobe-services/config/hallmarkchannel?noflash=true": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
2023/01/15 10:44:11.072350 [TRS] DNS: OK: Resolved host via system DNS
2023/01/15 10:44:16.073337 [TRS] Cloud Reachable: ERROR: Could not connect to community.getchannels.com: Timeout after 5 seconds
2023/01/15 10:44:20.664076 [ERR] Could not start stream for TVE-Philo ch6091 HALLMARKMM: TVE: Post "https://sp.auth.adobe.com/adobe-services/authorize": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
2023/01/15 10:44:21.073785 [TRS] Local Time: ERROR: Could not connect to www.google.com: Get "http://www.google.com/": context canceled
2023/01/15 10:44:21.073958 [TRS] TV Everywhere: OK
2023/01/15 10:44:21.075684 [TRS] TV Everywhere DNS: OK: Resolved TVE authenticator via system DNS
2023/01/15 10:44:26.076366 [TRS] Guide Provider: ERROR: Could not connect to guide provider: data.tmsapi.com: Timeout after 5 seconds
2023/01/15 10:44:26.076457 [TRS] Remote Access: OK: Remote access not configured
2023/01/15 10:44:26.085050 [TRS] Disk Permissions: OK
2023/01/15 10:45:06.048247 [ERR] Diagnostics submission failed: Post "https://carriage.channelsdvr.cloud/help": dial tcp 172.67.165.182:443: i/o timeout
#2

Something is wrong with your network

2 Likes
#3

@tmm1 that’s what I was thinking, although my streaming services (Philo, Sling) are working without issue from my client devices. Maybe a problem on my NAS.

Still troubleshooting, but I replaced a network switch and that MAY have fixed things.

1 Like
#4

Would those timeouts I was seeing happen if the server time was incorrect? I was going through logs and saw some ntp sync failures from my NAS.

#5

I found out years ago on my Synology how to make it reliable.
Use time.google.com as your NTP server.
Enable, then disable the NTP server service on your Synology.

This ensures it keeps your time accurate.

1 Like
#6

Strangely, the NTP sync problem was with time.google.com. I switched to something else and it has resolved.

#7

OK, I think I found something here: it looks like my Plex server was causing a problem with NTP sync. I have no actual network logs to back that up, but I stopped and removed the Plex server from my Synology NAS and all the errors went away. If I try to install a new Plex server, I once again see errors in Channels related to the NTP-sync issue, plus I am unable to claim the Plex server.

I've been running Plex on the same device as Channels for a couple of years and never had a problem. I realize this is not a Channels problem but I know many of us also run Plex so any input appreciated. Thanks.

#8

One final (I hope) post on this topic: I have Verizon FiOS, and it turns out their "home network protection" feature was blocking some of the Plex traffic, and that appeared to cause all networking from the NAS to hang. Once I disabled their "protection" app, all these problems went away. Note: I still have the same security settings as before in my router, I just disabled Verizon's McAfee-powered network nanny.

#9

This topic was automatically closed 365 days after the last reply. New replies are no longer allowed.