BETA: Enhanced Commercial Detection

Following on the help from everyone on submitting their Commercial Edits, we'd like to show everyone what that has been building towards: Enhanced Commercial Detection.

With this latest prerelease, you can now opt in to our new Enhanced Commercial Detection system that should be more accurate than our current comskip system.

To enable it, select one of the two modes the system operates in:

  • Preview: Enhanced Detection will be enabled in the browser-based Commercial Editor, but nothing will be automatically updated to reflect the new detected commercials
  • On: Enhanced Detection will be run on all shows and any show that has not been edited and the commercials will be updated

We will be updating the model from time to time and at the moment those updates will only happen when you tap the Check For Updates button. At that time, if Enhanced Detection is set to On all shows that have not been edited will be updated with the results of the latest model.

Preview Mode

In preview mode, there is a new tab in the Commercial Editor that can be used to review what the Enhanced Detection would have been. Once they are reviewed you can scroll to the bottom to save them.

Comparing results

After commercials have been edited for a recording, the system will provide a score that will compare how well the new system did compared to the standard comskip:

How does it work?

Our Enhanced system is built on top of our existing comskip solution which means that the normal comskip process will run and complete before the enhanced process does. Once standard comskip has completed it will take between 1-10s for the enhanced process to complete on a recording.

What can I do to help?

Please continue to edit commercials and enable Share Commercial Edits. We use the edits to improve the quality of the results. The more results we can get, the better the system can become.

What if I don't like the results?

If you turn Enhanced Detection back to the Off position, the commercials will be set back to the results from the standard comskip process. Additionally, the more you submit your edits when you see results that aren't correct the better the system will become.

Limitations

Enhanced Detection has a few current limitations that could change in the future:

  • It will not automatically run on some TVE recordings that have had their commercials detected from the stream itself (internally known as tagged commercials)
  • It will not run during Live Commercial Detection
6 Likes

Yeah...I've been waiting for something like this for a while. Its getting a bit tougher and tougher for comskip to detect normal commercials. Thats the reason why I don't bother removing the commercials when I process them in FF (and instead opting for chapters). I'm gonna give it a whirl later tonight.

I'm not able to enable Enhanced Commercial Detection on Windows. I was able to on my Docker version.

On my Docker version it seems to be working pretty good compared to the compskip default. Is it possible to have an option to include closing credits? Currently on shows I tried this on, the credits don't get included with the show blocks. Seeing the credits let's me know the show has ended.

Great work! I'm seeing positive results.

Please submit diagnostics and I’ll check out what’s going on.

Logs have been submitted as **ecad180b-4d1b-42e5-9228-fa8ac826721d

Can you take a screenshot of a the scenes around the ones you're talking about so I can get a better idea of how the structure looks?

The way Enhanced Commercial Detection works right now is based on the consensus of all of the folks who have submitted edits so far. This definitely leaves room for reasonable people to have a different opinion of what is part of the show and what isn't.

As we get more feedback from folks we'll look at ways to handle this. I do have plans to post a document that gives a our official guidance to some of these scenarios that are ambiguous and solicit feedback on that as well.

Can you try this latest pre-release?

2 Likes

I'm able to enable Enhanced commercial detection in Windows with the latest release. Thank you!

It maybe better to add an option to add 5 seconds to the last show block. The credits sometimes show right after a show ends and other times after commercial segments. This is not a big deal to me. I just need watch my recordings with the enhanced detection to see how it is when the show ends. The current version may work just fine.

1 Like

I suggest the guidance encourages people to include the credits as a show block as well. I understand many credit rolls have ads for other shows, but everybody deserves credit for their hard work.

1 Like

2 posts were split to a new topic: Spurious error with Enhanced Commercial Detection

We have been enjoying the improved commercial detection. Thank you for the enhancement.

3 Likes