"Generated fingerprint for ..." seems slow?

Channels DVR Server
#1

Hi, I recently setup FAST Channels and enabled a few new sources. After I did that, the CDVR web UI started locking up on me and my client (AppleTV) often couldn't find the channels server.

I set the stream limits to 1 on the new sources, and that definitely helped, but it's still locking up a bit on me (or at least slowing down) in the web UI and giving me some client problems. My NAS resource manager is showing long stretches of disk I/O pinned at 100%. I generally have about 4-6 streams recording at once.

Looking through the logs, I see entries like "Generated fingerprint for file-24578 in 11m18s" (where file-24578 was a 30 minute TV show). Not sure what that fingerprint is, but 11 minutes feels like a long time for whatever to deal with one file. Do I need fingerprinting / can I turn it off?

I'm running CDVR on a synology DS 220+.

Thanks!

#2

Try disabling Deep Video Processing if it's enabled.
Under Settings > General > Library Database > Deep Video Processing

See

#3

Thanks, that's helpful.

I'm leaning toward turning off Deep File Processing because I don't intend to use intro/credits detection or enhanced com skip (turned off com skip years ago).

But poking around, I see this other comment from a dev:

That mentions that "turning off Deep Video Processing will make remote streaming worse", which I don't love the sound of. I only use it occasionally, but it's a nice to have. That said, I was pleased with the remote streaming when I was on assignment in France for a months in 2023, so as long as turning this off doesn't make it worse than it was back then, I think I'm fine with it.

#4

You can always turn it back on.
I would say to turn it off (mine's off) and test remote streaming while you're at home over cellular.

#5

Thank you for this suggestion. Came here with a similar symptom, albeit on local Bluray movie content. Any chance DVP could be enabled on specific content (recorded) rather than the entire library in the future?

#6

The reason why we run it on all content is because the different kinds of fingerprinting we do end up being useful for different kinds of content and situations.

As for local movie content, getting the video index is how we are able to provide the highest quality and most efficient remote streaming. There's no way to know ahead of time what content someone would want to stream remotely or download, so it has to be done ahead of time.

If you don't want:

  • efficient remote streaming
  • intro/credits detection for TV shows
  • the best commercial detection for recorded content
  • other features we haven't announced yet

you can disable it, but as we've said before, we definitely advocate for leaving it on, even though it sucks to have to churn through all the content.

#7

Thanks, Eric.

I used the remote streaming pretty heavily back in 2023 when I was in France, and was happy with the peppiness of the interface, skip fwd/back, etc. If having deep file processing off means that level of performance with remote streaming, I think I'm good with that. Should I expect that to be the case (or have other things changed/evolved that make the deep file processing critical now)?

Thanks!

#8

There wasn’t a setting to turn it off in 2023 so you were benefiting from the video indexing at the time.

#9

Ah, thanks. I thought the deep video processing was new(ish).

#10

It (deep video processing) is new.
Even if you turn it off in settings, you still get the old video indexing.
Check the DVR log for lines that look like this for your recordings

[IDX] Generating video index for job
#11

Thanks, but now I'm confused. I thought Eric was saying that that the efficient remote streaming relies on deep video processing being on.

#12

Do what you want.
Did you check viewing remotely by using a client over cellular?
Did it work for you in 2023 before they introduced Deep Video Processing?
I'm leaving the Deep Video Processing turned off.

#13

Yes, it worked for me in 2023. Here's what Eric said in response to my comment that I was pleased with the performance in 2023:
"There wasn’t a setting to turn [deep file processing] off in 2023 so you were benefiting from the video indexing at the time."

#14

That's because it's new. Didn't have it in 2023.

And you still can. With or without Deep Video Processing

#15

@Joke Are you being harmed by it being on? Is there some negative experience you're having by having this processing happen? Is it just bothering you to see that it's doing this work in the background and that it is taking a long time?

If you can just let it do its work, you'll end up having a more seamless experience with the DVR than if you disable settings.

#16

Personally I run seven DVR's and the video index causes playback issues so I end up deleting them.
And I don't have comskip enabled on any of them.
No need to have seven DVR running Deep Video Processing for me.

EDIT: Saw you changed your post and were replying to Joke instead of me.

#17

@eric I'm not sure what's causing my problems, I just know that "generating fingerprint" is sometimes taking upwards of 8 minutes on a 30 minute show, at the same time I'm getting poor client performance / locked up server web UI / intermittent inability to find the server.

Here was my description from my first post:

Hi, I recently setup FAST Channels and enabled a few new sources. After I did that, the CDVR web UI started locking up on me and my client (AppleTV) often couldn't find the channels server.

I set the stream limits to 1 on the new sources, and that definitely helped, but it's still locking up a bit on me (or at least slowing down) in the web UI and giving me some client problems. My NAS resource manager is showing long stretches of disk I/O pinned at 100%. I generally have about 4-6 streams recording at once.

Looking through the logs, I see entries like "Generated fingerprint for file-24578 in 11m18s" (where file-24578 was a 30 minute TV show). Not sure what that fingerprint is, but 11 minutes feels like a long time for whatever to deal with one file. Do I need fingerprinting / can I turn it off?

Turning off deep file processing feels like it's made an improvement to all that. My concern is whether I'm costing myself something meaningful as far as remote playback is concerned by turning it off.

#18

And you still can [benefit from video indexing for remote streaming purposes]. With or without Deep Video Processing"

Are you sure that's the case? It contradicts what Eric said upthread, which was :

If you don't want:

  • efficient remote streaming
  • intro/credits detection for TV shows
  • the best commercial detection for recorded content
  • other features we haven't announced yet

you can disable it,

#19

Yes I'm sure.
Try it yourself.
Stream remotely from a client over cellular and see for yourself.
Or just ignore me and enable Deep Video Processing. I don't care :grin:

#20

What are you basing your certainty on that the dev in the thread misstated the expected behavior?

Wifi with my cell phone isn't going to give me a test of the experience I'm interested in, which is broadband on a dedicated device to a TV. Whether performance is good or bad, I won't be able to attribute it to this setting.