Automatically Extract New Web Episodes

Playground
#1

Hey guys, I love channels new feature of using the STRM files. I was wondering if you all might have some ideas on how I might be able to automate the creation of those files.

For example, each week at the same time a new episode comes out. My thought was that if there was a tool to automatically extract the video URL then I could use a cron job in Linux to extract the video url and add it to channels import directory each week.

I know I can use youtube-dl to get the video link if i have the correct url but the problem is i don’t know ahead of time what the new episode link is going to be. I know it has a consistent format of /videos/episode#-“episode name”. Not sure if it’s possible but I’m fairly novice in all this so thought maybe someone smarter than me might have some ideas!

#2

Which service?

#3

Not really a service, it’s just a independent news channel I follow, thehighwire.com

#4

So like last weeks episode was this link and it keeps the same format for new episodes, it just increments the episode number and then adds the title..

One idea was if there was some sort of command line search engine tool i could use that to search for the url and then pass that url to youtube-dl to get the actual video url…

#5

Seems like just the number works

https://thehighwire.com/videos/episode-280

#6

Ahh, good call!!

Sweet, now I just need to figure out how to increment the episode number each week in a cron job and I think it should be pretty straight forward from there

#7

Anybody get this to work? I know this was a while back but been thinking about how to do this for a while.