BETA: Experimental Imported Movie Matching

I like this improvement. What happens if there are two versions of a movie and they have the same name? For example "The Taking of Pelham 123" One is the original and one is the remake.

You can differentiate movies with the same names by their release dates.

There seems to be three different versions in TMDB: The Taking of Pelham 123 — The Movie Database (TMDB) (themoviedb.org)

  • "The Taking of Pelham One Two Three" (1974) => tmdb/8333
  • "The Taking of Pelham One Two Three" (1998) => tmdb/314370
  • "The Taking of Pelham 1 2 3" (2009) => tmdb/18487
1 Like

You can re-process everything with:

otherwise, there is a nightly task that refreshes the info that will handle it.

Will any of the actions taken (or not taken) be logged? I do see a Timeout that I assume is just a load issue?

[ERR] Failed to get movie info for tmdb/1832: Get "https://contentdb.fancybits.co/api/movies/tmdb/1832": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

I would be interesting to see what files are being inspected and what actions are being taken but I like high verbosity logs and that might not be how others feel. :smile:

2024/02/13 16:22:53.463494 [WRN] Server requested a slowdown while getting movie info for tmdb/493922: retrying in 2s
2024/02/13 16:23:12.181227 [WRN] Server requested a slowdown while getting movie info for tmdb/36243: retrying in 4s
2024/02/13 16:23:20.723889 [WRN] Server requested a slowdown while getting movie info for tmdb/36679: retrying in 6s
2024/02/13 16:23:34.143844 [WRN] Server requested a slowdown while getting movie info for tmdb/15766: retrying in 3s
2024/02/13 16:24:07.510472 [WRN] Server requested a slowdown while getting movie info for tmdb/393457: retrying in 1s
2024/02/13 16:24:16.621159 [WRN] Server requested a slowdown while getting movie info for tmdb/754: retrying in 2s
2024/02/13 16:24:26.035407 [WRN] Server requested a slowdown while getting movie info for tmdb/301875: retrying in 3s
2024/02/13 16:24:35.928905 [WRN] Server requested a slowdown while getting movie info for tmdb/8869: retrying in 4s
2024/02/13 16:24:46.956291 [WRN] Server requested a slowdown while getting movie info for tmdb/12920: retrying in 4s
2024/02/13 16:24:56.944874 [WRN] Server requested a slowdown while getting movie info for tmdb/11821: retrying in 5s

I'm not exactly sure what you're asking here. Can you rephrase?

It doesn't appear we have any specific load-related issues that I can see on our graphs, but it does look like we can add retries when we get timeouts like this, so this build should handle that better (and the logging for it).

We don't plan on logging every fetch that happens, but you should see the Activity showing the file that it is currently working on.

@Edwin_Perez Was there something you needed addressed with those logs?

Just was wondering if that is OK ?

@Edwin_Perez Yep, all part of normal operation. I may remove the log messages eventually, but they're helpful right now to make sure that the backoff is working as intended.

Sure, something like "Found file XXXX, trying to match as IMDBYYYY." Or "Movie ZZZZ found in guide, matches File XXXX"

The goal to be knowing if my files are matching or not matching, being seeing and processed for matching or not being seen and processed for matching. There is the Experimental toggle for HTTP Logging so an additional toggle for File Match Logging could be considered similar.

On a tangent, a couple of 502s on Trakt. Only reporting for information:
2024/02/13 16:25:18.838501 [ERR] Failed to get movie info for tmdb/493828: error resolving trakt: tmdb: GET: https://api.trakt.tv/movies/fireplace-for-your-home-classic-edition-2008/ratings: 502 Bad Gateway: "error code: 502"

Just got a 500 error from the lookup

2024/02/14 12:43:26.087242 [IDX] Generating video index for file-29411: SciFi Fantasy\Terminator\Terminator - Dark Fate (2019).mkv
2024/02/14 12:43:28.501353 [ERR] ContentDB search error: Terminator: GET: https://contentdb.fancybits.co/api/movies/search/tmdb?q=Terminator: 500 Internal Server Error
2024/02/14 12:43:29.116482 [SCN] Imported movie #29411 SciFi Fantasy\Terminator\Terminator - Dark Fate (2019).mkv

@IDisposable Please try again now. Just deployed a fix for this issue. Thanks for reporting it.

Edit: I realize the fallback logic will take care of importing even with this error, so there's nothing you need to do here.

We don't really have something like this for other kinds of lookups like this, and it isn't really valuable for us for debugging, so I'm not sure if it's something we'll get a chance to implement.

Thanks for reporting this. I've added handling to ignore this sort of transient error.

I poked it every way from the individual file and ALSO retriggered the match maker code in Settings

Interesting... looks like I shouldn't trigger all the things on the individual level... looks like it got angry that the file was in use (due to video index scan) while trying to write timestamps*

2024/02/14 14:09:26.507160 [IDX] Generating video index for file-29411: SciFi Fantasy\Terminator\Terminator - Dark Fate (2019).mkv
2024/02/14 14:10:27.452704 [MTS] Rewriting video timestamps for file-29411: Terminator - Dark Fate (2019).mkv
2024/02/14 14:10:29.908169 [DVR] Running commercial detection on file 29411 (SciFi Fantasy\Terminator\Terminator - Dark Fate (2019).mkv)
2024/02/14 14:10:56.711306 [WRN] Server requested a slowdown while getting movie info for tmdb/624860: retrying in 7s
2024/02/14 14:11:03.851659 [WRN] Server requested a slowdown while getting movie info for tmdb/624860: retrying in 1s
2024/02/14 14:11:07.757240 [WRN] Server requested a slowdown while getting movie info for tmdb/122: retrying in 7s
2024/02/14 14:11:14.916375 [WRN] Server requested a slowdown while getting movie info for tmdb/122: retrying in 1s
2024/02/14 14:11:18.985399 [WRN] Server requested a slowdown while getting movie info for tmdb/8010: retrying in 7s
2024/02/14 14:11:30.897431 [WRN] Server requested a slowdown while getting movie info for tmdb/106: retrying in 5s
2024/02/14 14:11:36.174887 [WRN] Server requested a slowdown while getting movie info for tmdb/106: retrying in 1s
2024/02/14 14:11:40.137161 [WRN] Server requested a slowdown while getting movie info for tmdb/177: retrying in 7s
2024/02/14 14:11:47.319354 [WRN] Server requested a slowdown while getting movie info for tmdb/177: retrying in 1s
2024/02/14 14:11:51.731992 [WRN] Server requested a slowdown while getting movie info for tmdb/242828: retrying in 6s
2024/02/14 14:11:58.116431 [WRN] Server requested a slowdown while getting movie info for tmdb/242828: retrying in 1s
2024/02/14 14:12:02.904455 [WRN] Server requested a slowdown while getting movie info for tmdb/15283: retrying in 6s
2024/02/14 14:12:09.062127 [WRN] Server requested a slowdown while getting movie info for tmdb/15283: retrying in 1s
2024/02/14 14:12:13.207767 [WRN] Server requested a slowdown while getting movie info for tmdb/10515: retrying in 7s
2024/02/14 14:12:22.874500 [WRN] Server requested a slowdown while getting movie info for tmdb/943: retrying in 7s
2024/02/14 14:12:30.025875 [WRN] Server requested a slowdown while getting movie info for tmdb/943: retrying in 1s
2024/02/14 14:12:33.785739 [WRN] Server requested a slowdown while getting movie info for tmdb/623: retrying in 7s
2024/02/14 14:12:44.020805 [WRN] Server requested a slowdown while getting movie info for tmdb/603692: retrying in 7s
2024/02/14 14:12:51.173371 [WRN] Server requested a slowdown while getting movie info for tmdb/603692: retrying in 1s
2024/02/14 14:12:54.897396 [WRN] Server requested a slowdown while getting movie info for tmdb/2501: retrying in 7s
2024/02/14 14:13:02.064658 [WRN] Server requested a slowdown while getting movie info for tmdb/2501: retrying in 1s
2024/02/14 14:16:13.361739 [ERR] Missing file to delete #29277 C:\DVR\TV\NHL Hockey\NHL Hockey St Louis Blues at Buffalo 2024-02-10-1200.mpg: CreateFile C:\DVR\TV\NHL Hockey\NHL Hockey St Louis Blues at Buffalo 2024-02-10-1200.mpg: The system cannot find the file specified.
2024/02/14 14:16:14.877672 [DVR] Deleted #23059 \\zulu\Movies\Action\Goon (2012).mp4 (user)
2024/02/14 14:16:15.747159 [ERR] Missing file to delete #22972 C:\DVR\TV\NHL Hockey\NHL Hockey Detroit Red Wings at St L 2023-12-12-1830.mpg: CreateFile C:\DVR\TV\NHL Hockey\NHL Hockey Detroit Red Wings at St L 2023-12-12-1830.mpg: The system cannot find the file specified.
2024/02/14 14:16:42.962672 [MTS] Statistics for #29411 "Terminator - Dark Fate (2019).mkv": skipped=12566821833 discontinuity_detected=0 transport_errors=17989442 invalid_pts=19 invalid_dts=6 saw_pcr=true saw_pmt=false highest_pts=0.000000
2024/02/14 14:16:43.677045 [IDX] Finished video index generation for file-29411 in 437s
2024/02/14 14:16:44.266662 [ERR] Rewriting video timestamps for file-29411 failed: replace \\zulu\Movies\SciFi Fantasy\Terminator\.Terminator - Dark Fate (2019).mkv.1342651899 \\zulu\Movies\SciFi Fantasy\Terminator\Terminator - Dark Fate (2019).mkv: Access is denied.

I readily admit that I had no reason to rewrite timestamps (not even sure what that's for), but was just trying to trigger any issues... I see nothing wrong, though

Yes, please don't just hit random things on files without knowing that they're for or why you're doing it.

Using "Rewrite Timestamps" is useful in specific cases when instructed by us, but doing it always has the chance to corrupt the file (anything you do to modify a file has the chance to do that), and the rewriter can't rewrite an .mkv (it only handles MPEG-TS).

Noted, sorry :slight_smile:

Update:

In the latest update we are now processing Recordings as soon as they are completed and will be adding Trailers to them if they are available. This is the sort of small improvements we're able to achieve with this new system we new have in place.

For recordings that you already have, they will get updated over night, but if there's a recording you particularly want to see the trailer for now, you can manually refresh the metadata for it.

4 Likes

Is there any way you can set the default resolution? I tried to watch a few on my Apple TV but they're all 720p and look absolutely terrible upscaled to 4K. I'd rather add my own if that's the best it can do.