Just an observation that I thought I’d share to see if others are seeing the same.
Both yesterday and today so far tit seems the frequency of the issue is less. Yesterday we had FNC playing for 2 1/2 hours before it happened and today it’s been running for 2 hours without any problems so far.
Previously, it was happening a couple of times an hour for us.
I just had this happen on 2 completely different channels. My wife is upstairs watching Food network and I'm downstairs watching DIY network. Both streams failed within a few minutes of eachother.
2019/08/28 12:26:04 [TNR] Opened connection to TVE-ATTOTT for ch6108 DIY
2019/08/28 12:30:00 [TNR] Closed connection to 104F208B for ch20.1 WFYI 1
2019/08/28 12:30:04 [DVR] Finished job 1567008000-9 Super Why!
2019/08/28 12:30:04 [DVR] Waiting 5h29m55.280069995s until next job 1567029600-4 Mama's Family
2019/08/28 12:30:04 [DVR] Processing file-70: TV/Super Why!/Super Why! S01E35 2008-09-03 Pinocchio 2019-08-28-1200.mpg
2019/08/28 12:30:07 [DVR] Running commercial detection on file 70 (TV/Super Why!/Super Why! S01E35 2008-09-03 Pinocchio 2019-08-28-1200.mpg)
2019/08/28 12:38:30 [DVR] Commercial detection finished with 4 markers.
2019/08/28 14:42:20 [TNR] Opened connection to TVE-ATTOTT for ch6102 FOOD
2019/08/28 15:40:34 [ERR] Error during stream TVE-ATTOTT ch6102 FOOD: Failed to download file: https://x-default-stgec.uplynk.com/auso/slices/369/4f59ea65df184a2580ad8fc80d3eaa32/369ef7d79c4f4864a657649f90d35f26/H00000004.ts?pbs=20339d74b6c24f77a12e1df84b42ed2f&_jt=l&chid=9181e4aeaf864e45aafe0dd2373ee4cd&oid=e6cf0c55dac249f0a0f72e7c72e6f6cb&si=33
2019/08/28 15:40:36 [TNR] Closed connection to TVE-ATTOTT for ch6102 FOOD
2019/08/28 15:47:52 [ERR] Error during stream TVE-ATTOTT ch6108 DIY: Failed to download file: https://x-default-stgec.uplynk.com/auso/slices/369/4f59ea65df184a2580ad8fc80d3eaa32/369ef7d79c4f4864a657649f90d35f26/H00000004.ts?pbs=2e3e9b1690f4433086ee9e184350e472&_jt=l&chid=480d1ff42e924413990ee0eeb693ce9f&oid=e6cf0c55dac249f0a0f72e7c72e6f6cb&si=138
2019/08/28 15:47:54 [TNR] Closed connection to TVE-ATTOTT for ch6108 DIY
2019/08/28 15:51:47 [TNR] Opened connection to TVE-ATTOTT for ch6102 FOOD
I'm on DVR server build 2019.08.15.2304. ATV Version 3.2.26. I submitted video player diag logs from both ATVs but this is all that I saw in the log on the DVR server.
Please update the DVR to the latest version (click-and-hold the Check For Update button).
If it happens again please provide logs again (the new version has better logs for these failures).
FNC just happened again.
2019/08/28 16:26:06 [TNR] Opened connection to TVE-ATTOTT for ch6073 FNC
2019/08/28 16:48:07 [ERR] Error during stream TVE-ATTOTT ch6073 FNC: Failed to download file: https://x-live-fox-stgec.uplynk.com/ausc/slices/afd/4f59ea65df184a2580ad8fc80d3eaa32/afd76bf662454d8b870fd07499a57c8f/H0000000F.ts?pbs=809ec7a2ce254c23955363c41a64e82d&_jt=l&chid=1e298c9d65a245b3bd37f339cadcca58&oid=5b6fd7c6528d417e8bdad7f79754bb9e&si=24: 403 Forbidden
2019/08/28 16:48:10 [TNR] Closed connection to TVE-ATTOTT for ch6073 FNC
Same 403 as seen above. I'l keep trying different channels
Is there anything that can be done in the player to account for this problem? I just returned from a trip and my wife told me it pita and that it happens “all the time”. I’ve been home for less than a few hours and have seen it 3-4 times already.
Any improvement in the latest DVR build?
Been watching Netflix tonight but we can do some testing. Is 2019.09.03.1947 the latest?
Yes.
Ran for about an hour before the error happened. This time though the screen went full black with no indication of what had happened.
Logs:
2019/09/03 20:41:29 [TNR] Opened connection to TVE-sony_auth-gateway_net for ch6073 FNC
2019/09/03 21:10:42 [NAT] Successfully mapped port 8089 using natpmp
2019/09/03 21:38:50 [ERR] Error during stream TVE-sony_auth-gateway_net ch6073 FNC: Failed to download file: https://x-live-fox-stgec.uplynk.com/ausc/slices/afd/4f59ea65df184a2580ad8fc80d3eaa32/afd76bf662454d8b870fd07499a57c8f/H0000000F.ts?pbs=68a28b069e1443ae9f873e677da569de&_jt=l&chid=1e298c9d65a245b3bd37f339cadcca58&oid=5b6fd7c6528d417e8bdad7f79754bb9e&si=33: 403 Forbidden
2019/09/03 21:38:50 [TNR] Closed connection to TVE-sony_auth-gateway_net for ch6073 FNC
2019/09/03 21:39:35 [TNR] Opened connection to TVE-sony_auth-gateway_net for ch6073 FNC
I'm running 2019.09.03.1947. I've had 2 error types. The 403 as previously mentioned and a 404 on the MLB Channel.
2019/09/03 18:28:10 [TNR] Opened connection to TVE-DTV for ch6193 MLBTV [transcode=none]
2019/09/03 18:34:53 [ERR] Error during stream TVE-DTV ch6193 MLBTV: Failed to download file: http://mlblive-akc.mlb.com/ls01/mlbam/mlb_network/NETWORK_LINEAR_1/MLB_VIDEO_MLBN_FAUX_LINEAR_STREAM_1_MLBN_Linear_Stream_Tuesday_20190903_1567490547777/3000K/01/34/09.ts: 404 Not Found
2019/09/03 18:34:53 [TNR] Closed connection to TVE-DTV for ch6193 MLBTV
2019/09/03 18:35:21 [TNR] Opened connection to TVE-DTV for ch6073 FNC [transcode=none]
2019/09/03 18:40:22 [ERR] Error during stream TVE-DTV ch6073 FNC: Failed to download file: https://x-live-fox-stgec.uplynk.com/ausc/slices/afd/4f59ea65df184a2580ad8fc80d3eaa32/afd76bf662454d8b870fd07499a57c8f/H0000000F.ts?pbs=0b54c4c92fbe4b0ba60b9579ad77daf9&_jt=l&chid=1e298c9d65a245b3bd37f339cadcca58&oid=5b6fd7c6528d417e8bdad7f79754bb9e&si=8: 403 Forbidden
2019/09/03 18:40:22 [TNR] Closed connection to TVE-DTV for ch6073 FNC
2019/09/03 18:44:07 action=p12_validate status=200 OK
It did fail a second time for me last night. In this case it failed as “normal” meaning the screen did not go black on me.
Logs:
2019/09/03 21:39:35 [TNR] Opened connection to TVE-sony_auth-gateway_net for ch6073 FNC
2019/09/03 21:59:04 [ERR] Error during stream TVE-sony_auth-gateway_net ch6073 FNC: Failed to download file: https://x-live-fox-stgec.uplynk.com/ausc/slices/afd/4f59ea65df184a2580ad8fc80d3eaa32/afd76bf662454d8b870fd07499a57c8f/H0000000F.ts?pbs=fa0839636d2442b99070e28b2022269f&_jt=l&chid=1e298c9d65a245b3bd37f339cadcca58&oid=5b6fd7c6528d417e8bdad7f79754bb9e&si=25: 403 Forbidden
2019/09/03 21:59:04 [TNR] Closed connection to TVE-sony_auth-gateway_net for ch6073 FNC
2019/09/03 21:59:19 [TNR] Opened connection to TVE-sony_auth-gateway_net for ch6073 FNC
Downloaded and installed latest this morning. Ran for about 90 min ok and then it encountered the error again.
Log:
2019/09/04 06:53:13 [SYS] Downloading new version v2019.09.04.0522
2019/09/04 06:53:16 [SYS] Update downloaded and verified successfully.
2019/09/04 06:53:18 [TNR] Closed connection to 10711025 for ch11.1 WTVD-D1
2019/09/04 06:53:42 [SYS] Shutting down...
2019/09/04 06:53:42 [DVR] Recording engine stopped.
2019/09/04 06:53:42 [SYS] Bonjour service stopped.
2019/09/04 06:53:42 [SYS] Goodbye.
2019/09/04 06:53:43 [SYS] Starting Channels DVR v2019.09.04.0522 (darwin-x86_64 pid:30902) in /Users/admin/Library/Application Support/ChannelsDVR/data
2019/09/04 06:55:05 [HDR] Found 1 devices
2019/09/04 06:55:07 [SYS] Started HTTP Server
2019/09/04 06:55:07 [DVR] Recording engine started in /Volumes/Channels-DVR
2019/09/04 06:55:07 [DVR] Waiting 6h34m52.733589s until next job 1567618200-35 The Bold and the Beautiful
2019/09/04 06:55:07 [SYS] Removing old update 2019.08.30.1336
2019/09/04 06:55:07 [NAT] Successfully mapped port 8089 using natpmp
2019/09/04 06:55:07 [SYS] Bonjour service registered with XXXXX.XXXXXXXXXX.XXX
2019/09/04 06:55:17 [IDX] Pruned 198 expired airings from USA-OTA27587 in 15.632726ms.
2019/09/04 06:55:17 [IDX] Pruned 807 expired airings from X-TVE in 25.668514ms.
2019/09/04 06:55:42 [SYS] Created database snapshot: backup-20190904.065507
2019/09/04 06:55:42 [SYS] Removing old backup backup-20190816.144516
2019/09/04 06:55:47 [TNR] Opened connection to 10711025 for ch11.1 WTVD-D1
2019/09/04 07:16:30 [TNR] Closed connection to 10711025 for ch11.1 WTVD-D1
2019/09/04 07:16:42 [TNR] Opened connection to TVE-sony_auth-gateway_net for ch6073 FNC
2019/09/04 07:55:07 [NAT] Successfully mapped port 8089 using natpmp
2019/09/04 08:23:01 [TNR] Sharing existing connection to TVE-sony_auth-gateway_net for ch6073 FNC (clients=2, len=0)
2019/09/04 08:48:19 [ERR] Error during stream TVE-sony_auth-gateway_net ch6073 FNC: Failed to download file: https://x-live-fox-stgec.uplynk.com/ausc/slices/afd/4f59ea65df184a2580ad8fc80d3eaa32/afd76bf662454d8b870fd07499a57c8f/H0000000F.ts?pbs=cdeea231d5dd4c4195ebcbe25c40dbb9&_jt=l&chid=1e298c9d65a245b3bd37f339cadcca58&oid=5b6fd7c6528d417e8bdad7f79754bb9e&si=67: 403 Forbidden
2019/09/04 08:48:19 [TNR] Closed connection to TVE-sony_auth-gateway_net for ch6073 FNC
I see in my logs we've had 8 occurrences of this error in the last 2 days. Google searching "uplynk 403 forbidden" yielded some interesting posts about this error related to uplynk and ffmpeg. Technically, outside of my scope of understanding but maybe it will help in tracking down the issue.
@tmm1, I just came home from a week long trip to California and one of the first things my wife said to me is that it’s time to find an alternative because she’s tired of this issue.
Honestly, I’m not there at this point but I have to say I feel like for the most part this problem is being ignored as if it’s not a big deal.
To us it is a big deal. It’s disruptive and frustrating to watch the focus on new features and troubleshooting of other’s network / setup issues rather than fixing the issues that exist for the users.
Channels is / has always been a great platform. A significant part of that greatness is the support. After a month of this problem I have to be blatantly honest and say I’m not “feeling the love” right now.
This is happening a lot on Fox News and Fox Business for me in the last week or so. I normally download nightly builds so Im not sure if that is the issue or not.
Those are the 2 stations that seems to be the problem children. I don't know if anyone has looked to fix this yet
That stuff happen in the apps. Its buggy as snot and those same annoying commercials are even worse.
We have to do all of those things. You're all our customers and we can't neglect users with installation issues, new features that make the software easier to use and more stable, or strange and flaky issues with certain TVE channels.
In the case of TVE channels, there are a lot of things we can do to make it better and more stable, but at the end of the day, we're at the mercy of the TV networks providing a good and stable video stream.
We've put a lot of work into this issue (as we do all bugs that are reported), but in this case haven't found any simple answers for why this happens. It isn't clear to us if there's an issue with our integration with the channels or if there's just a fundamental issue with the hosting. If these sorts of glitches happen when watching on the Fox website or the Fox app, it's likely a bug in how they're serving their video. If that's the case, there's a limit to how much we can do to fix things.
@eric, I hear you, but frankly disagree on some of your points.
First, I’ve not seen it fail in the browser version. In fact, I watched FNC for several hours yesterday on an airplane of all places and it ran just fine. Better than in channels from the perspective of this particular error.
Second, you do not have to support users resolving their own network, external disk drive, Nas, etc errors and issues. It’s very nice that you do, but the reality is you need to support your product to the extent that you show the issue is NOT your product. The community is the proper place to support those other issues.
Thirdly, you’ve spent far more time IMHO working on new features (transcoders) than this issue. Maybe I’m wrong but I can only give you my impression based on the activity in the forums.
Lastly, did you do the search that I suggested earlier in the week? There are numerous reports of this error against this server in the ffmpeg forums (you use ffmpeg, right?) with solutions to them.
You’re right that you’re at the mercy of what the stream providers send, but only to a point. You’re responsible for how your program reacts to and handles errors.
I say all of this from the perspective of someone who has been responsible for providing technical support for 4+ fortune 100 tech companies over the last 25 years.
Here are a few suggestions for you guys. You don’t have to follow any of them, but I’m going to put them out there anyway because I love your product, want to see it succeed even more, and will continue to recommend it.
Listen to your user community and respond to them in some way but do what you can to do it more efficiently. There are a lot of requests for features that seem to fall on deaf ears (ie; changing the colors, clocks, PIPs, overlays of guide data). Put together an FAQ that establishes your position on these types of things and point users to them. You used to do this for DRM as an example.
Put together a solid self-help guide. This can be jointly maintained by you and your users. New users can leverage this as opposed to writing you directly. And, if you have this then you can quickly point users to this.
I’ll reiterate, questions on recommended hardware, network issues, etc. are not in your realm of direct responsibility. Your users and an FAQ can handle this.
Put some controls in place around the sprawl. Channels started out, I believe, as primarily an Apple ecosystem focused solution. Over the years its grown tremendously in what it supports. This grows the user base but it means you’re spread even more thinly. My point is, maybe address some of the current issues/requests before moving to support ARM devices or RPi4s.
All of these are meant as suggestions as to how you can streamline your time so that you can focus more on your product. One thing we all know is that when it comes to TV it’s a very different world in end user computing. The sensitivity to issues or tolerance of them is almost akin to stock trading. It’s just not the same as your typical app. You need to continue to improve over time in order to stay ahead of your competition. Providers such as Hulu, PS Vue, Sling, etc will eat your lunch when it comes to ease of use. You’re better than them now, but don’t rest on that. If you allow them to they will outpace you from a feature perspective over time and you will lose share to them. Right now, you’re ahead because of your ability to store recordings, skip commercials and your support, but you’re behind on things like ease of use, complexity and the limitation to add features do to your custom video player. You’re a small company competing against giants you’re continued success depends on your ability to innovate a solid and easy to implement product. You’re there now for the most part but I sense you’re at a critical juncture and need to adapt to the size that you’ve become.
We (my family) love Channels and want nothing but it’s continued success.