Beta: tvOS & iOS Intro and Credits detection

As of the latest TestFlight beta and server pre-release, we've added Intro and Credits detection for TV Shows.

Detection

The process is completely handled locally on Channels DVR Server. Once an entire show has been scanned and its episodes' intros and credits were detected, intros will be able to be skipped.

While credits are detected, their index is used differently in that Channels uses them to prompt the Next Up card used for Auto Play, rather than just showing it with 20 seconds left in the episode. This should be a huge improvement to Auto Play, for shows with detected credits.

Get Started

We are looking for folks to try this out on their shows and share how it's working for them to see how it performs across a wide range of situations.

We do not automatically perform detection on all shows while in beta. You will need to opt your shows into this one by one.

If you would like to participate in this beta feature, read below on the steps you'll need to take to enable it.

Make sure you have both the latest pre-release server and TestFlight beta of the Channels app installed.

Enable Deep Video Processing

On your Channels DVR Server, you will have to enable Deep Video Processing in the Experimental settings:

Opt a Show In

You can opt a show into intro and credits detection by choosing the Detect Segments action on the TV show's page in your Channels DVR Server web admin.

It will then process all of the episodes for that show and index any intros or credits that it finds.

Once you have opted a show into this, all new episodes for that show will automatically be detected once they are added to your library.

Inspecting Results

We've built a few ways for you to peek at the detected segments of your episodes.

On a TV show's page in your web admin, we've added the View Detected Segments action to view the overall success of the detection for the show.

This will open a modal listing all of the detected segments of each episode grouped by season. You can adjust the season with the drop down at the top.

Debugging

We've also provided a way for you to delete all of the detected segments for a show, in the off chance that the detection is completely inaccurate. You may want to do this if you find that the detection is bad and you don't want that show to have awkward results in the Channels app.

There is also a way to download debug data to provide to the developers, but more on that below.

Additionally, you can see a single episode's detected segments in its View Details modal.

How it works

OK great! You've opted some shows into detection and now you want to actually get something out of it!

Intro Skip

Intro Skip works just like the Commercial Skipping you're familiar with. It shares the same options and allows for both a global setting and setting per TV show.

The skip options are:

  • Automatic - Channels will automatically skip through detected intros.
  • Skip Button - Channels will offer a button to allow you to tell it to skip through an intro.
  • Manually - Channels will do nothing, and instead you can double click the seek forward button to skip through the intro, just like Commercial Skipping.

Credits

But what about credits?

Library Playback

While Channels detects credits in shows, it does not offer a skip credits option when watching shows from your library. This is because Channels uses Auto Play to get you to each next episode. So skipping credits doesn't make a lot of sense.

Instead, we use the detected credits to cue Auto Play's next up card, rather than the old way of just showing it 20 seconds before the episode ends.

This should incredibly improve the experience of Auto Play.

Virtual Channels

By design, Virtual Channels play things back to back continuously, there is no Auto Play.

For Virtual Channels, we've added credits skip options.

We've added a new setting to your Virtual Channels for Credits Skipping that have the same options as listed above.

Notes

  • You must be on the latest TestFlight beta and pre-release server
  • This is only for tvOS/iOS clients
  • The more episodes of a show that you have to run this on, the better it performs.

What happens if I get bad results?

Please let us know! We've seen it perform well on the shows we've checked, but you may have found something we haven't seen yet.

Steps to provide feedback

If you notice that your show is inaccurately detecting segments, please follow these steps to provide us some information.

  1. Take a screenshot of the inaccurate detected segments, like the shot we provided above.
  2. Download the debug data of that TV Show.
  3. Email us with these items:
  • email address: [email protected]
  • Subject line: Segment Detection Beta
  • Attach the screenshot and debug file
  • Provide the source(s) the episodes came from (OTA, TVE, Personal Media, etc)

Known Issues

  1. Recordings that have a lot of the same ads running over and over again can cause bad results. Pluto is a good example of this. We do not currently have a solution for this.
  2. Recordings from TV Everywhere sources can detect "Commercial in Progress" breaks as Intros.

9 Likes

Excellent addition!

1 Like

I am not seeing Detect Segments. I have the check mark on Deep Video Processing. Running Debian Linux server.

1 Like

I am not seeing Detect Segments either - running on Windows 11 and have selected the check mark for Deep Video Processing.

Maybe fixed

1 Like

Yep, that new build should fix it for you. Let me know if it doesn't.

2 Likes

chDVRuser didn't even give Eric a chance to reply. :wink:

Yes I see it in the menu now and it is currently rolling. Will see how this goes. Fingers crossed!

Fixed for me as well on Windows - thanks much - I'll start testing it out!

So far its working. It would be nice on the timeline if there was a different color to indicate where the Intro Skip will start.

If you FF to the Commercial Skip you will get the Intro Skip prompt too

I ran the "Detect Segments" on my first show and timestamps for intros/credits look good. On tvOS, the intro button shows up appropriately but I'm still not seeing the auto play prompt until the last 20 seconds.

@alai I'm not able to replicate what you're describing. It's popping up for me as soon as the credits start.

Could you go to View Detected Segments and find the episode in question and post the screenshot here?

Can you provide more details on what you mean, and how to reproduce it?

If you use the right direction on the remote and FF until you hit the dark purple spot on the timeline where there should be a commercial skip that will auto skip. You will get the indicator at the top for commercial skip and also at the bottom the Into Skip will pop up. I have the commercial skip to auto skip and the Intro Skip to Skip Button. I will see if I can get a screenshot.

Also seems like it might make it through the first commercial skip but then on the second one is where it was happening.

2 Likes

@jxxaxxy Could you go to View Detected Segments and find the episode in question and post the screenshot here?

Here you go.

This is an amazing addition to Channels and is the functionality I wanted the most. I just got home and will start trying this out.

I love the way you're implementing the Skip End credits. It makes more sense that way and I am going to test it on some of those shows with long end credits that are just annoying to use with autoplay currently. I end up having to skip forward anyway.

Anyway, great job team!

1 Like

@jxxaxxy Great! It looks like it detected a commercial break as an Intro. We're discussing how we can help you clean up situations like this where TVE feeds have these recurring segments that are actually ads.

We've updated the Known Issues above to highlight this.

I also noticed I didn't see any credits like your original post shows as well. Two intros. I know we padded these by a little bit at each start too. I think these recordings might have come from hulu or philo. I don't have an active 6000 ish channels anymore and I don't remember exactly due to the changes overtime.