BETA: Experimental Imported Movie Matching

eric · February 12, 2024, 7:12pm

We're currently working on unifying the metadata of content in your library.

The Problem

Currently, imported movies are indexed with TheMovieDB, and recordings retain the metadata from the guide data provided by Gracenote. To the system, the same movie that was imported is different than if it was recorded. The same issue happens with content recorded from a Custom Channels source.

This creates strife in your library when it comes to implementing features. Some features will just not work because your content appears diffently to the system. We don't love this.

For example, On Later will not show that a movie is already in your library if you imported it. This is because, to the system, they're different content due to how they were indexed. The same goes for recording things. If you have and advanced pass to record movies, it will still record the movie even if you have imported it. Again, the system can not differentiate between the two. But this is what we're looking to resolve.

The Plan

We're testing out a new mechanism to ensure content has unified metadata so that no matter what the source of content is, it always has the same metadata. We're starting with imported movies first.

It's still under active development and this initial release is small to make sure all of the components work correctly and don't hurt anything. We'll be taking all of this slow.

To enable this new feature toggle Experimental Imported Movie Matching and wait for the system to synchronize existing imported movies.

Highlights

When the feature is enabled:

The guide and scheduler will note imports as already recorded and won't re-record unless requested
Imported file matching for movies will now:
- look for IMDB IDs in filenames and use them for matching
- look for {tmdb-xxxxxx} and {imdb-ttxxxxxx} in filenames and use them for matching
- look for an .nfo file next to the imported file and look for entries for type imdb or tmdb
Recorded movies will now have trailers that can be viewed through the apps

Updates

mjitkop · February 12, 2024, 7:27pm

This is great news! Count me in as a beta tester.

I've had this issue because I edit videos and import them a lot. I even wrote my own script that managed to match movies between my library and upcoming schedule based on title, year, director. Seemed to work quite well but just a workaround.

I will start adding TMDB IDs in the file names and see the magic happen.

Edwin_Perez · February 12, 2024, 7:35pm

Wii this read NFO files from EMBY ? Sample below ... Movie info towards the bottom.

<?xml version="1.0" encoding="utf-8" standalone="yes"?>
<movie>
  <plot><![CDATA[When an IMF mission ends badly, the world is faced with dire consequences. As Ethan Hunt takes it upon himself to fulfill his original briefing, the CIA begin to question his loyalty and his motives. The IMF team find themselves in a race against time, hunted by assassins while trying to prevent a global catastrophe.]]></plot>
  <outline><![CDATA[Some missions are not a choice.]]></outline>
  <lockdata>false</lockdata>
  <dateadded>2024-02-11 16:49:23</dateadded>
  <title>Mission: Impossible - Fallout</title>
  <originaltitle>Mission: Impossible - Fallout</originaltitle>
  <actor>
    <name>Tom Cruise</name>
    <role>Ethan Hunt</role>
    <type>Actor</type>
    <tmdbid>500</tmdbid>
    <tvdbid>254032</tvdbid>
  </actor>
  <actor>
    <name>Henry Cavill</name>
    <role>August Walker</role>
    <type>Actor</type>
    <tmdbid>73968</tmdbid>
    <tvdbid>327579</tvdbid>
  </actor>
  <actor>
    <name>Ving Rhames</name>
    <role>Luther Stickell</role>
    <type>Actor</type>
    <tmdbid>10182</tmdbid>
    <tvdbid>313451</tvdbid>
  </actor>
  <actor>
    <name>Simon Pegg</name>
    <role>Benjamin 'Benji' Dunn</role>
    <type>Actor</type>
    <tmdbid>11108</tmdbid>
    <tvdbid>259672</tvdbid>
  </actor>
  <actor>
    <name>Rebecca Ferguson</name>
    <role>Ilsa Faust</role>
    <type>Actor</type>
    <tmdbid>933238</tmdbid>
    <tvdbid>295149</tvdbid>
  </actor>
  <actor>
    <name>Sean Harris</name>
    <role>Solomon Lane</role>
    <type>Actor</type>
    <tmdbid>16702</tmdbid>
    <tvdbid>375076</tvdbid>
  </actor>
  <actor>
    <name>Angela Bassett</name>
    <role>Erika Sloane</role>
    <type>Actor</type>
    <tmdbid>9780</tmdbid>
    <tvdbid>274193</tvdbid>
  </actor>
  <actor>
    <name>Vanessa Kirby</name>
    <role>The White Widow</role>
    <type>Actor</type>
    <tmdbid>556356</tmdbid>
    <tvdbid>403805</tvdbid>
  </actor>
  <actor>
    <name>Michelle Monaghan</name>
    <role>Julia</role>
    <type>Actor</type>
    <tmdbid>11705</tmdbid>
    <tvdbid>269484</tvdbid>
  </actor>
  <actor>
    <name>Wes Bentley</name>
    <role>Erik</role>
    <type>Actor</type>
    <tmdbid>8210</tmdbid>
    <tvdbid>505320</tvdbid>
  </actor>
  <actor>
    <name>Frederick Schmidt</name>
    <role>Zola</role>
    <type>Actor</type>
    <tmdbid>1312122</tmdbid>
  </actor>
  <actor>
    <name>Alec Baldwin</name>
    <role>Alan Hunley</role>
    <type>Actor</type>
    <tmdbid>7447</tmdbid>
    <tvdbid>287126</tvdbid>
  </actor>
  <actor>
    <name>Yang Liang</name>
    <role>Lark Decoy</role>
    <type>Actor</type>
    <tmdbid>1645047</tmdbid>
  </actor>
  <actor>
    <name>Kristoffer Joner</name>
    <role>Nils Debruuk</role>
    <type>Actor</type>
    <tmdbid>7742</tmdbid>
    <tvdbid>621515</tvdbid>
  </actor>
  <actor>
    <name>Wolf Blitzer</name>
    <role>Wolf Blitzer</role>
    <type>Actor</type>
    <tmdbid>1224993</tmdbid>
    <tvdbid>254196</tvdbid>
  </actor>
  <actor>
    <name>Dean Ashton</name>
    <role>French Policeman</role>
    <type>Actor</type>
    <tmdbid>1980397</tmdbid>
  </actor>
  <actor>
    <name>Alix Bénézech</name>
    <role>French Policewoman</role>
    <type>Actor</type>
    <tmdbid>1126301</tmdbid>
    <tvdbid>7908031</tvdbid>
  </actor>
  <actor>
    <name>Joey Ansah</name>
    <role>Henchman</role>
    <type>Actor</type>
    <tmdbid>29406</tmdbid>
    <tvdbid>473442</tvdbid>
  </actor>
  <actor>
    <name>Velibor Topic</name>
    <role>Henchman</role>
    <type>Actor</type>
    <tmdbid>34515</tmdbid>
    <tvdbid>315033</tvdbid>
  </actor>
  <actor>
    <name>Alexandre Poole</name>
    <role>Rowdy Frenchman</role>
    <type>Actor</type>
    <tmdbid>2089917</tmdbid>
  </actor>
  <actor>
    <name>Andrew Cazanave Pin</name>
    <role>Rowdy Frenchman</role>
    <type>Actor</type>
    <tmdbid>2089912</tmdbid>
  </actor>
  <actor>
    <name>Christophe de Choisy</name>
    <role>Rowdy Frenchman</role>
    <type>Actor</type>
    <tmdbid>2089913</tmdbid>
  </actor>
  <actor>
    <name>Guy Remy</name>
    <role>Rowdy Frenchman</role>
    <type>Actor</type>
    <tmdbid>2089918</tmdbid>
  </actor>
  <actor>
    <name>Jean Baptiste Fillon</name>
    <role>Rowdy Frenchman</role>
    <type>Actor</type>
    <tmdbid>1692241</tmdbid>
  </actor>
  <actor>
    <name>Maximilian Geller</name>
    <role>Rowdy Frenchman</role>
    <type>Actor</type>
    <tmdbid>49163</tmdbid>
  </actor>
  <actor>
    <name>Olivier Huband</name>
    <role>Rowdy Frenchman</role>
    <type>Actor</type>
    <tmdbid>2089914</tmdbid>
  </actor>
  <actor>
    <name>Raphael Desprez</name>
    <role>Rowdy Frenchman</role>
    <type>Actor</type>
    <tmdbid>1651413</tmdbid>
  </actor>
  <actor>
    <name>Raphael Joner</name>
    <role>Rowdy Frenchman</role>
    <type>Actor</type>
    <tmdbid>2089911</tmdbid>
  </actor>
  <actor>
    <name>Thierry Picaut</name>
    <role>Rowdy Frenchman</role>
    <type>Actor</type>
    <tmdbid>2089916</tmdbid>
  </actor>
  <actor>
    <name>Vincent Latorre</name>
    <role>Rowdy Frenchman</role>
    <type>Actor</type>
    <tmdbid>1698108</tmdbid>
  </actor>
  <actor>
    <name>Harvey Djent</name>
    <role>DJ Harvey</role>
    <type>Actor</type>
    <tmdbid>1858373</tmdbid>
  </actor>
  <actor>
    <name>Grahame Fox</name>
    <role>Grand Palais Bouncer</role>
    <type>Actor</type>
    <tmdbid>662006</tmdbid>
    <tvdbid>8034915</tvdbid>
  </actor>
  <actor>
    <name>David Mumeni</name>
    <role>Marine Sergeant</role>
    <type>Actor</type>
    <tmdbid>1619648</tmdbid>
  </actor>
  <actor>
    <name>Charlie Archer</name>
    <role>Delivery Man</role>
    <type>Actor</type>
    <tmdbid>1808581</tmdbid>
  </actor>
  <actor>
    <name>Caspar Phillipson</name>
    <role>The European</role>
    <type>Actor</type>
    <tmdbid>1441919</tmdbid>
  </actor>
  <actor>
    <name>Ffion Jolly</name>
    <role>Woman at Desk</role>
    <type>Actor</type>
    <tmdbid>1769602</tmdbid>
  </actor>
  <actor>
    <name>Lolly Adefope</name>
    <role>Woman at Desk</role>
    <type>Actor</type>
    <tmdbid>1627501</tmdbid>
    <tvdbid>296346</tvdbid>
  </actor>
  <actor>
    <name>Ross O'Hennessy</name>
    <role>British Agent</role>
    <type>Actor</type>
    <tmdbid>1717916</tmdbid>
  </actor>
  <actor>
    <name>Russ Bain</name>
    <role>British Agent</role>
    <type>Actor</type>
    <tmdbid>1304469</tmdbid>
  </actor>
  <actor>
    <name>Nigel Allen</name>
    <role>CIA Agent</role>
    <type>Actor</type>
    <tmdbid>1303330</tmdbid>
  </actor>
  <actor>
    <name>Tracey Saunders</name>
    <role>CIA Agent</role>
    <type>Actor</type>
    <tmdbid>2089919</tmdbid>
  </actor>
  <actor>
    <name>Alicia Mencía Castaño</name>
    <role>CIA Agent (uncredited)</role>
    <type>Actor</type>
    <tmdbid>2089920</tmdbid>
  </actor>
  <actor>
    <name>Conny Sharp</name>
    <role>Julie Bar Woman (uncredited)</role>
    <type>Actor</type>
    <tmdbid>1917316</tmdbid>
  </actor>
  <actor>
    <name>Jessie Vinning</name>
    <role>Navy (uncredited)</role>
    <type>Actor</type>
    <tmdbid>2060814</tmdbid>
  </actor>
  <actor>
    <name>Stuart Davidson</name>
    <role>Nightclub VIP (uncredited)</role>
    <type>Actor</type>
    <tmdbid>139635</tmdbid>
    <tvdbid>422333</tvdbid>
  </actor>
  <actor>
    <name>Julianne Binard</name>
    <role>Paris Guest (uncredited)</role>
    <type>Actor</type>
    <tmdbid>2000489</tmdbid>
  </actor>
  <actor>
    <name>Hiten Patel</name>
    <role>Train Commuter (uncredited)</role>
    <type>Actor</type>
    <tmdbid>1973190</tmdbid>
  </actor>
  <actor>
    <name>Jag Patel</name>
    <role>Mourner (uncredited)</role>
    <type>Actor</type>
    <tmdbid>1785923</tmdbid>
  </actor>
  <actor>
    <name>Godiva Marshall</name>
    <role>Passer-By (uncredited)</role>
    <type>Actor</type>
    <tmdbid>2852261</tmdbid>
  </actor>
  <actor>
    <name>Gina Aponte</name>
    <role>Lounge Violinist (uncredited)</role>
    <type>Actor</type>
    <tmdbid>2002674</tmdbid>
  </actor>
  <actor>
    <name>Robert Ryan</name>
    <role>Office Manager (uncredited)</role>
    <type>Actor</type>
    <tmdbid>3291978</tmdbid>
  </actor>
  <actor>
    <name>Pamela Cook</name>
    <role>Funeral Mourner (uncredited)</role>
    <type>Actor</type>
    <tmdbid>4271074</tmdbid>
  </actor>
  <director tmdbid="9033" tvdbid="300790">Christopher McQuarrie</director>
  <trailer>plugin://plugin.video.youtube/?action=play_video&amp;videoid=wb49-oV0F78</trailer>
  <trailer>plugin://plugin.video.youtube/?action=play_video&amp;videoid=XiHiW4N7-bo</trailer>
  <trailer>plugin://plugin.video.youtube/?action=play_video&amp;videoid=MEOOas3JZt0</trailer>
  <rating>7.421</rating>
  <year>2018</year>
  <sorttitle>Mission: Impossible - Fallout</sorttitle>
  <mpaa>PG-13</mpaa>
  <imdbid>tt4912910</imdbid>
  <tvdbid>22</tvdbid>
  <tmdbid>353081</tmdbid>
  <premiered>2018-07-13</premiered>
  <releasedate>2018-07-13</releasedate>
  <runtime>147</runtime>
  <tagline>Some missions are not a choice.</tagline>
  <country>United States of America</country>
  <genre>Action</genre>
  <genre>Adventure</genre>
  <studio>Paramount</studio>
  <studio>Bad Robot</studio>
  <studio>Skydance Media</studio>
  <studio>TC Productions</studio>
  <set tmdbcolid="87359">
    <name>Mission: Impossible Collection</name>
  </set>
  <uniqueid type="tmdb">353081</uniqueid>
  <uniqueid type="imdb">tt4912910</uniqueid>
  <uniqueid type="tvdb">22</uniqueid>
  <uniqueid type="facebook">missionimpossiblemovie</uniqueid>
  <facebookid>missionimpossiblemovie</facebookid>
  <uniqueid type="instagram">missionimpossible</uniqueid>
  <instagramid>missionimpossible</instagramid>
  <uniqueid type="official website">https://www.missionimpossible.com/</uniqueid>
  <uniqueid type="twitter">missionfilm</uniqueid>
  <twitterid>missionfilm</twitterid>
  <id>tt4912910</id>
  <fileinfo>
    <streamdetails>
      <video>
        <codec>h264</codec>
        <micodec>h264</micodec>
        <bitrate>4451045</bitrate>
        <width>1920</width>
        <height>1080</height>
        <aspect>16:9</aspect>
        <aspectratio>16:9</aspectratio>
        <framerate>23.976025</framerate>
        <language>und</language>
        <scantype>progressive</scantype>
        <default>True</default>
        <forced>False</forced>
        <duration>147</duration>
        <durationinseconds>8843</durationinseconds>
      </video>
      <audio>
        <codec>eac3</codec>
        <micodec>eac3</micodec>
        <bitrate>192000</bitrate>
        <language>eng</language>
        <scantype>progressive</scantype>
        <channels>6</channels>
        <samplingrate>48000</samplingrate>
        <default>True</default>
        <forced>False</forced>
      </audio>
      <subtitle>
        <codec>mov_text</codec>
        <micodec>mov_text</micodec>
        <bitrate>79</bitrate>
        <language>eng</language>
        <scantype>progressive</scantype>
        <default>True</default>
        <forced>False</forced>
      </subtitle>
    </streamdetails>
  </fileinfo>
</movie>

eric · February 12, 2024, 7:37pm

It will only grab these values out of it to use for matching:

eric · February 12, 2024, 7:39pm

mjitkop · February 12, 2024, 7:39pm

Just to clarify, did you mean "look far {tmdb-xxxxxx} or {imdb-ttxxxxxx} in filenames"?

eric · February 12, 2024, 7:41pm

@mjitkop it will look to see if either of those tags is in the filename. The expectation is that it will only find one of them.

There should not be a reason to rename files that have already been matched successfully in Channels, as that will create a duplicate entry that would need to be cleaned up.

mjitkop · February 12, 2024, 7:43pm

That's what I thought. I wanted to make sure I didn't have to put both IDs in every file name.

maddox · February 12, 2024, 7:54pm

While these new indexing techniques (ids in file names) help the matching, it is important to understand that they’re not required.

We’ve improved the system to match things with multiple metadata sources without you having to do any work.

So you do not need to make any changes. And honestly we hope you don’t. It will test this better.

Edwin_Perez · February 12, 2024, 7:59pm

Will I see anything in the logs I am about to import a lot.

eric · February 12, 2024, 8:08pm

@Edwin_Perez In general you won't see anything special in the logs (beyond occasional warnings about retrying due to rate limits, which is completely normal).

The only thing that will happen is things that were matched will now show up as "Recorded" when you look at the guide or search for upcoming airings of that movie.

mjitkop · February 12, 2024, 8:17pm

Understood. That's perfect because that's my favorite thing to do: nothing.

eric · February 12, 2024, 8:22pm

@mjitkop well, you do need to enable the Experimental Imported Movie Matching setting to get the new mapping of import IDs to guide IDs

Edwin_Perez · February 12, 2024, 8:33pm

This is what I see .... Imported

eric · February 12, 2024, 10:30pm

3 posts were split to a new topic: Movie being Queued to be re-recorded that are already recorded

eric · February 12, 2024, 8:59pm

That's exactly what it should be doing. We now have the IMDB/TMDB -> Gracenote for those movies.

What was the expected behavior here? What is your Pass for this? Could you submit diagnostics so we can see what's going on?

mjitkop · February 12, 2024, 10:01pm

When looking in the 152 matches of this pass, some matches are not labeled as "Queued", "Recorded" or "Imported". Example with "Dater's Handbook":

When I click on the gear icon:

It just happens that this movie is an imported MKV file in my library:

At least, it's not marked as to be recorded so that's a good thing.
It's just missing the "Imported" label.

While scrolling down the list, I saw more than a dozen imported MKV movies with the same blank gear icon.

eric · February 12, 2024, 10:42pm

@mjitkop It doesn't appear that your synchronization has happened for some reason. Could you go to Settings -> Live TV & DVR -> Guide Data -> Maintenance -> Refresh Movie Info and hopefully that'll get it to start doing the mapping.

mjitkop · February 12, 2024, 10:45pm

OK, it's in progress now.
Once it's done, anything else I should do?

eric · February 12, 2024, 11:40pm

Nope, just check to ensure that "Dater's Handbook" is listed as "Imported".