This project has moved. For the latest updates, please go here.

TVDB SeriesId Mapping

Oct 25, 2012 at 10:13 PM

Apparently I started this tread on the wrong site, so at Ramit's request I am moving it hear.

I see with the 2.3.5 release of MCEBuddy, that there is now a way to manually map a conversion profile to a specific series id.

But please forgive me in potentially miss understanding how to use the implementation. Based upon Ramit's instructions, within the conversion tasks advanced settings, I am to click on the button next to download series info.

When I click on that button, I am given a dialog box to enter either a TVDB series id or an IMDB series Id. Where I get confused is how is this id going to be assigned to a specific show title or title pattern?

Based upon the current implementation it seems that all files converted will end up with the same id?

How would I set it up so that say Vegas gets one id and Dragons Den gets another, and the rest of files simply auto resolve like they do today?

Thanks
<david />

 

 

 

 

 

 

 

 

Coordinator
Oct 25, 2012 at 10:23 PM
I should have clarified. You will news to create a separate conversion task for each show where you want to force the download details.
In the showname filter or filename filter (showname details are compared to the wtv metadata) enter the name of the show you want to limit the series id to.

This is a point solution for specific shows. In most cases the download details works well.
If multiple shows are returned in the match on tvdb mcebuddy cycles through each show comparing episode names and dates to find a match so usually to finds the correct show.

However for a more accurate solution I will request you to upload a copy of the video which is getting the wrong metadata and series Id. I will try to replicate and find a better solution. Do you have the server details to uload the file?
Nov 10, 2012 at 6:21 PM

I hope: 1) I'm not hijacking this thread, since I am asking about a not completely unrelated topic, and 2) as a new user, folks cut me some slack for asking what is probably a common question, but I honestly searched about and couldn't find any reference to my problem.

I am on 2.3.4, upgrading as I type to 2.3.8.

My issue is with renaming shows, e.g. Shark Tank and Survivor Philippines (a/k/a S25).  The wtv files have the right show and some details are correct, but some are missing or slightly in error, such as the air date being correct but the airtime showing 12:00AM.  It would seem that TVDB would be able to identify them from the info I can manually determine, but it never does for these two shows.  I get the show name right; but the Season and Episode are blank (Log shows "CANNOT FIND EPISODE NAME NO").  Are there any tricks or kludges to force MCEBuddy and TVDB to identify the episodes?

Thank you for a great program and any help you can offer.

Coordinator
Nov 10, 2012 at 7:24 PM

Can you post the log file for the conversion here so I can see what's going on (ideally if you can upload hte WTV file to the MCEBuddy server it would be better).

MCEBuddy matches teh Showname and Episode name against TVDB, it needs to be an EXACT match (case insensitive) for it to work. If there is a space or a dot extra or less it won't work. The other way it matches is by Showname and Original Broadcast DATE (not time) to get the episode name.

 

does your WTV provide the episode name or original broadcast date?

Nov 11, 2012 at 4:05 AM

Thank you for responding so quickly.  Unfortunately, I lost my log file when I upgraded to 2.3.8, so I can't post it yet.  I am forcing MCEBuddy to convert the most recent Survivor and will post that log when I have it.  In the meantime, here is the data I do have on the file:

File name: Survivor- Philippines_WKMGDT_2012_11_07_20_00_00.wtv

File Properties:
Title: Survivor: Philippines
Subtitle: Dead Man Walking
Episode Name: Dead Man Walking
Length: 00:59:59
Recording Time: 11/7/2012 8:00 PM
TV Network: CBS Affiliate
Broadcast date: 11/7/2012 12:00 AM
Channel number: 6
Station call sign: WKMGDT
Program Description: During a complicated tribal council, a brutally honest conversation results in a surprising revelation.
TV credits: ;;Jeff Probst;
Rerun: No
ATSC content: Yes
DTV content: Yes
Item type: Windows Recorded TV Show

From what you said above, it seems likely to me that the problem is the file properties gives the Title as "Survivor: Philippines" but TVDB just calls is "Survivor"

But, I do not see any discrepancy on Shark Tank.  Both the file Title and TVDB titles are "Shark Tank".  I am going to convert another episode and see what the log gives me and post it.

Coordinator
Nov 11, 2012 at 7:23 AM

I'll wait for the log file, meanwhile for the abvoe case, you can create a separate conversion task for the show; filter by show name and then assign the TVDB id by clicking on the little icon next to Download Series Information in the Advanced Settings section of the conversion task. this will force all conversions executed by the task to have that particular TVDB id and details.

Nov 11, 2012 at 6:56 PM

I ran tests on Shark Tank and Survivor and got interesting results.  First for Shark Tank, here are the summary results of running MCEBuddy on the same file on separate dates.  The first was from v2.3.4 and the second on v2.3.8:

Source Video -> D:\Recorded TV\Shark Tank_WFTVDT_2012_11_09_21_00_00.wtv
Converted Video -> D:\Media\TV Shows\Shark Tank\Season\SE..20121108.mp4
Profile -> MP4 Normal
Conversion Task -> Convert to MP4
Converted At -> 2012-11-10T02:34:29

Source Video -> D:\Recorded TV\MCEBuddyArchive\Shark Tank_WFTVDT_2012_11_09_21_00_00.wtv
Converted Video -> D:\Media\TV Shows\Shark Tank\Season 4\S04E09.November 9, 2012.20121109.mp4
Profile -> MP4 Normal
Conversion Task -> Convert to MP4
Converted At -> 2012-11-11T05:56:36
I have the log for the second, good one, but since it worked perfectly I am not bothering to send it.  I don't have the first failed log.

For Survivor, here is the log (v2.3.8) that shows episode lookup failing:

INFORMATION> 2012-11-10T22:39:06 MCEBuddy.Engine.ConversionJob --> File Survivor- Philippines_WKMGDT_2012_11_07_20_00_00.wtv checking for showname filter ><
INFORMATION> 2012-11-10T22:39:06 MCEBuddy.Engine.ConversionJob --> System language for stream purposes is English (United States) (eng)
INFORMATION> 2012-11-10T22:39:06 MCEBuddy.Engine.ConversionJob --> System language for stream purposes is English (United States) (eng)
INFORMATION> 2012-11-10T22:39:06 MCEBuddy.Engine.ConversionJob --> Checking for disk space
INFORMATION> 2012-11-10T22:39:06 MCEBuddy.Engine.ConversionJob --> Getting show information and banner from Internet sources
INFORMATION> 2012-11-10T22:39:06 MCEBuddy.MetaData.VideoMetaData --> Extracting MCE Tags
INFORMATION> 2012-11-10T22:39:06 MCEBuddy.MetaData.VideoMetaData --> Downloading Series details
INFORMATION> 2012-11-10T22:39:09 MCEBuddy.Engine.ConversionJob --> Checking for SRT File
INFORMATION> 2012-11-10T22:39:09 MCEBuddy.Engine.ConversionJob --> Checking for EDL File
INFORMATION> 2012-11-10T22:39:09 MCEBuddy.Engine.ConversionJob --> Remuxing recording
INFORMATION> 2012-11-10T22:39:09 MCEBuddy.RemuxMediaCenter.RemuxMCERecording --> Byte stream remuxing
INFORMATION> 2012-11-10T22:41:53 MCEBuddy.Engine.ConversionJob --> Trimming video recording
INFORMATION> 2012-11-10T22:41:53 MCEBuddy.Engine.ConversionJob --> Checking for ShowAnalyzer
INFORMATION> 2012-11-10T22:41:53 MCEBuddy.Engine.ConversionJob --> Checking for Comskip
INFORMATION> 2012-11-10T22:41:53 MCEBuddy.Engine.ConversionJob --> Comskip Advertisement scan
INFORMATION> 2012-11-10T22:41:53 MCEBuddy.CommercialScan.Scanner --> Scanning commercials with Comskip
INFORMATION> 2012-11-10T22:59:01 MCEBuddy.CommercialScan.Scanner --> Using EDL file for commercial removal
INFORMATION> 2012-11-10T22:59:01 MCEBuddy.Engine.ConversionJob --> Analyzing video information
INFORMATION> 2012-11-10T22:59:01 MCEBuddy.VideoProperties.VideoInfo --> Reading MediaInfo from C:\working0\Survivor- Philippines_WKMGDT_2012_11_07_20_00_00.ts
INFORMATION> 2012-11-10T22:59:01 MCEBuddy.VideoProperties.VideoInfo --> Supplementing Media information using FFMPEG
INFORMATION> 2012-11-10T22:59:04 MCEBuddy.VideoProperties.VideoInfo --> Selected Audio Stream 1, Audio Track 0, Channels 6, Codec ac3
INFORMATION> 2012-11-10T22:59:04 MCEBuddy.VideoProperties.VideoInfo --> Getting crop information using MEncoder
INFORMATION> 2012-11-10T23:06:52 MCEBuddy.Engine.ConversionJob --> Converting
INFORMATION> 2012-11-10T23:06:52 MCEBuddy.Transcode.ConvertWithMencoder --> Checking for Unsupported profile for container / codec combination
INFORMATION> 2012-11-10T23:06:53 MCEBuddy.Transcode.Convert --> Converting with MEncoder
INFORMATION> 2012-11-10T23:06:53 MCEBuddy.Transcode.ConvertWithMencoder --> Setting up General conversion parameters : -ss 3 -vf pullup,softskip,yadif=0:-1,hqdn3d,harddup
INFORMATION> 2012-11-10T23:06:53 MCEBuddy.Transcode.ConvertWithMencoder --> Setting up PreDRC
INFORMATION> 2012-11-10T23:06:53 MCEBuddy.Transcode.ConvertWithMencoder --> Setting up input file name parameters
INFORMATION> 2012-11-10T23:06:53 MCEBuddy.Transcode.ConvertWithMencoder --> Setting up video conversion parameters : -ovc x264 -x264encopts bitrate=1800:me=hex:trellis=1:subq=8:partitions=all:8x8dct:me=hex:ref=8:rc_lookahead=50:keyint=25:keyint_min=20:bframes=3:weight_b:level_idc=41:b_pyramid=normal:direct_pred=auto:mixed_refs:deblock=-1,-1:nofast_pskip:nodct_decimate:threads=auto
INFORMATION> 2012-11-10T23:06:53 MCEBuddy.Transcode.ConvertWithMencoder --> Setting up pre video crop parameters
INFORMATION> 2012-11-10T23:06:53 MCEBuddy.Transcode.ConvertWithMencoder --> Checking if video resizing required
INFORMATION> 2012-11-10T23:06:53 MCEBuddy.Transcode.ConvertWithMencoder --> Setting up video resize parameters
INFORMATION> 2012-11-10T23:06:53 MCEBuddy.Transcode.ConvertWithMencoder --> Setting up post video crop parameters
INFORMATION> 2012-11-10T23:06:53 MCEBuddy.Transcode.ConvertWithMencoder --> MEncoder setting up video cropping
INFORMATION> 2012-11-10T23:06:53 MCEBuddy.Transcode.ConvertWithMencoder --> Setting up aspect ratio if required
INFORMATION> 2012-11-10T23:06:53 MCEBuddy.Transcode.ConvertWithMencoder --> Setting up bitrate and quality parameters
INFORMATION> 2012-11-10T23:06:53 MCEBuddy.Transcode.ConvertWithMencoder --> Setting up audio conversion parameters : -oac faac -faacopts br=256:mpeg=4:tns:object=2
INFORMATION> 2012-11-10T23:06:53 MCEBuddy.Transcode.ConvertWithMencoder --> Selecting Audio Track : 0
INFORMATION> 2012-11-10T23:06:53 MCEBuddy.Transcode.ConvertWithMencoder --> Setting up volume adjustment : 2.7dB
INFORMATION> 2012-11-10T23:06:53 MCEBuddy.Transcode.ConvertWithMencoder --> Setting up PostDRC
INFORMATION> 2012-11-10T23:06:53 MCEBuddy.Transcode.ConvertWithMencoder --> Setting up Audio channels
INFORMATION> 2012-11-10T23:06:53 MCEBuddy.Transcode.ConvertWithMencoder --> Requested to limit Audio Channels to 2
INFORMATION> 2012-11-10T23:06:53 MCEBuddy.Transcode.ConvertWithMencoder --> Setting up Output filename
INFORMATION> 2012-11-10T23:06:53 MCEBuddy.Transcode.ConvertWithMencoder --> Mencoder: Checking if advertisement removal is required
INFORMATION> 2012-11-10T23:06:53 MCEBuddy.Transcode.ConvertWithMencoder --> Mencoder setting advertisement removal with EDL file : C:\working0\Survivor- Philippines_WKMGDT_2012_11_07_20_00_00.edl
INFORMATION> 2012-11-10T23:06:53 MCEBuddy.Transcode.ConvertWithMencoder --> Converting the video - Main conversion
INFORMATION> 2012-11-10T23:06:53 MCEBuddy.Transcode.ConvertWithMencoder --> Adding decoding threaded support for 4 Processors
INFORMATION> 2012-11-11T01:45:34 MCEBuddy.Transcode.ConvertWithMencoder --> Checking EAC3 Audio conversion
INFORMATION> 2012-11-11T01:45:34 MCEBuddy.Transcode.ConvertWithMencoder --> Correcting Audio Delay if required
INFORMATION> 2012-11-11T01:45:34 MCEBuddy.Transcode.ConvertWithMencoder --> Remuxing video if required
INFORMATION> 2012-11-11T01:46:02 MCEBuddy.Transcode.Remux --> MP4Box remux avi moving file
INFORMATION> 2012-11-11T01:46:48 MCEBuddy.Transcode.Remux --> MP4Box remux AVI trying to move remuxed file
INFORMATION> 2012-11-11T01:46:48 MCEBuddy.Engine.ConversionJob --> Converted File : C:\working0\Survivor- Philippines_WKMGDT_2012_11_07_20_00_00.mp4
INFORMATION> 2012-11-11T01:46:48 MCEBuddy.Engine.ConversionJob --> Checking if commercials were found
INFORMATION> 2012-11-11T01:46:48 MCEBuddy.Engine.ConversionJob --> Commercials not found or cutting already completed
INFORMATION> 2012-11-11T01:46:48 MCEBuddy.Engine.ConversionJob --> Writing show information
INFORMATION> 2012-11-11T01:46:48 MCEBuddy.MetaData.VideoMetaData --> About to write MP4 Tags
INFORMATION> 2012-11-11T01:47:02 MCEBuddy.Engine.ConversionJob --> Running Custom Commands
INFORMATION> 2012-11-11T01:47:02 MCEBuddy.Transcode.CustomCommand --> No custom commands found
INFORMATION> 2012-11-11T01:47:02 MCEBuddy.Engine.ConversionJob --> Renaming file using show information
INFORMATION> 2012-11-11T01:47:02 MCEBuddy.Engine.ConversionJob --> Renaming file from show information
--> Cannot find Season No
--> Cannot find Season No
--> Cannot find Episode No
--> Rename file to C:\working0\SE.Dead Man Walking.20121107.mp4
INFORMATION> 2012-11-11T01:47:03 MCEBuddy.Engine.ConversionJob --> Moving converted file to destination
INFORMATION> 2012-11-11T01:47:03 MCEBuddy.Engine.ConversionJob --> Moving converted file C:\working0\SE.Dead Man Walking.20121107.mp4 to D:\Media\TV Shows\Survivor Philippines\Season\SE.Dead Man Walking.20121107.mp4
INFORMATION> 2012-11-11T01:47:06 MCEBuddy.Engine.ConversionJob --> Success - All done!
INFORMATION> 2012-11-11T01:47:06 MCEBuddy.Engine.ConversionJob --> 

Thank you!

P.S. I am trying to use the code feature of the bulletin board software, but it works differently than what I normally use so I apologize if it is too big to fit.

Coordinator
Nov 11, 2012 at 7:08 PM

This log isn't helpful. You need to set the log to debug (please read the Before Posting Guidelines for quicker resolution) and ATTACH the log file. Do not copy paste as it will be too big.

Nov 11, 2012 at 7:48 PM

Thanks for your patience.  I have uploaded a description txt file and the debug log.

Coordinator
Nov 11, 2012 at 8:56 PM

I've been though your log and as you had deduced earlier, the issue is that your MCE is setting the showname as Survivor: Phillippines where as TVDB as Survivor.

 

Unfortunately this isn't something that MCEBuddy can resolve on it's own since it depends up on the showname to search TVDB.

 

The solution here is to create a custom Conversion Task for this show. Add a new Conversion Task under Settings -> In Advanced Settings, under Showname Filter add Survivor* (which will make it select all shows which have the work Survivor in it's name).

Then ensure Download Series Details is checked, and click on the little icon next to it. Under TVDB Series ID enter 76733. Now all files converted by thsi task will be forced to use this Show from TVDB to lookup episode details:After setting the remaining paramters (Profile, Destination directory etc), save the Task.

Then Double click on your DEFAULT conversion Task, under Advanced Settings -> Showname filter, enter : *.*;~Survivor*

This will ensure that the default conversion task converts ALL files EXCEPT those who's showname starts with Survivor.

Nov 12, 2012 at 2:13 AM

Thank you for your time to analyze this and the detailed instructions on how to fix.  I very much appreciate what you providing to the community.

Nov 16, 2012 at 7:06 PM

Sorry to hijack someone else's thread, but I also struggle with this from time to time and have devised elaborate work-arounds that are a pain in the butt. It would be REALLY great if MCEBuddy provided a way to override series ID's based on name. For example, I also use WTV-MetaRenamer and it provides an XML file where I can map a series name (from the WTV metadata) to a specific TVDB series ID. This is useful when there are more than one show with similar names, or in the case of "Survivor" referenced above.

Would it be possible to add something like this to a future release? It seems like it would be easier to maintain than individual conversion tasks for each problem series.

Coordinator
Nov 16, 2012 at 10:00 PM

@bmaaske. The feature you are requesting has been provided in 2.3.8 look at my response above to see how go use it. Instead of xml files I have provided a user interface to enter the tvdb or movuedb series I'd. If the above dies not work for you please explain in more details what exactly you had tried and why it does meet your requirements and what you suggest

Nov 16, 2012 at 10:14 PM

Sorry, this also goes to my other post in another thread about multiple conversion tasks. Using multiple tasks to differentiate series will work, but it forces me to create a conversion task for each series, make sure I check all the right boxes, enter the name to match and the series ID. Then I have to EXCLUDE those names from my main conversion task so it doesn't get converted twice. This is all doable. I just wish it was easier, and why I suggested an alternative way to specify the series ID->name match.

Coordinator
Nov 26, 2012 at 5:54 PM

Yes it's very cumbersome I understand, but it's only an exception process.

 

I've looked into other options however they aren't as reliable as this option. E.g. some files like TS file don't have metadata to match in them so it creates a problem for show matching, i.e. how does one match. Providing the option in the conversion task provides the maximum flexibility even though it's a one time cumbersom process.

Oct 12, 2013 at 3:15 PM
I've just picked up MCEBuddy again after a little experimentation a couple of years ago (I ended up staying with Beyond TV then), so I hope this thread is not obsolete.

I understand (and appreciate) the flexibility provided by using separate profiles when needed, but I also agree that a different approach for the naming/lookup issue would provide a significant improvement in ease-of-use without adding much complexity.

First, it would help if conversion tasks were ordered and either implicitly (or explicitly, via an option) stopped with the first match, so that users wouldn't have to keep updating the default task every time they need to create a separate task to specify a series ID.

It would be really nice if, rather than having a single series ID for the task, to be able to specify a list of rows where the user could specify the filename match and associated series ID. To be even nicer, you could also include an optional value for renaming the series -- like changing "The Goldbergs" to "The Goldbergs (2013)" -- which could make the series ID optional, since the TVDB lookup could then succeed. I think that would make the functionality the same as the TV renamer script mentioned earlier.

The filename matching could then be copied from task matching to just before the series lookup. I hope I am being clear enough (too many interruptions from my two and five-year old boys!) -- feel free to contact me if I am not. I'm not sure if I could help with implementation, since I'm primarily a java developer.
Coordinator
Oct 12, 2013 at 4:11 PM
Thanks for your suggestions, definitely something I'll consider. There are a few things which are hard to implement in the current architecture of MCEBuddy, one of them being task ordering. Also I feel that stopping on the first task match can create a lot of confusion while creating tasks, if you were to reorder tasks, the logic would change entirely (think of a nice complex scenario) and it would be nightmare of users to try and debug why some tasks isnn't processing a file while anohter one is (remember the only way to debug is to go through all the log files trying to figure it out). I'm not opposed to implmenting this just need someone to layout the boundary conditions and work through it. Maybe you can lay out the logic for this and lets see how it turns out.

I like the idea of forcin the Title instead of the tvdb Series Id and moviedb id. I can provide that as an option, but remember MCEBudddy needs 2 pieces of information to match a series. Title + either original broadcast date or subtitle - only when both match does a look up work.

I didn't understand what you meant by "The filename matching could then be copied from task matching to just before the series lookup"?


Oct 12, 2013 at 4:38 PM
I thought the task ordering suggestion might be more difficult than anticipated (by me, anyway), but it would be a far lower priority for me if the series lookup logic were enhanced instead. Anyway, I can give it more thought, but my expected "best practice" would be to simply list all the custom/matching tasks first and only fall through to the default task (without any matching) if none of the earlier tasks matched. The explicit "stop or continue to next task" would be more complicated to implement, and as you noted, would be sensitive to task ordering.

The episode title and/or broadcast date would still (have to) come from the metadata or filename. At least, in my experience, the only part that typically needs to be modified is the series title, to correct or disambiguate the name for thetvdb.

I think supporting a series ID is still useful for people who know how to do the lookup at the corresponding site, as it makes the mapping explicit and presumably could make the lookup faster. If the IDs are always numeric, you could choose to allow either to be specified using a single field and then do the appropriate lookup depending on it's value. I think that's what the BTVRenamer script I used with Beyond TV did.

The sentence that confused you (and it is confusing -- sorry) was intended to convey that MCEBuddy already has logic for matching the recording filename to the filename regex in conversion tasks, so it shouldn't need to be "invented" for this new logic -- it could be applied in the same way, just for a new purpose (i.e. doing the lookup to see if there's a substitute title that should be used instead of the default value from the metadata or filename).
Coordinator
Oct 12, 2013 at 4:59 PM
yes I agree title renaming isn't an issue so instead of 2 boxes (tvdb id and moviedb id) now there will be 3, the 3rd being a manual title override.
Any file that passes the matching filters in the conversion task settings will be subject to having it's title renamed with this title as specified and then continue as usual. That's what you're looking for right?

Now the question is are we matching Titles or Filenames here? i.e. are we looking at the filename and then replacing the title or looking at the title and then replacing it? I would think matching against title is more reliable, as that would also lend it self to creating a table like matching as you asked. Now you can one row for each title and then 3 columns to force the appropriate tvdb, moviedb or new title replacement.


Oct 12, 2013 at 5:24 PM
Matching titles, definitely (I was assuming the title could have been derived from metadata or the filename). Then, extend it to allow for multiple rows per conversion task, so that users wouldn't be forced to create multiple tasks just to override the title. BTW, I will definitely be making another contribution if I can get my setup changed over from BeyondTV to MCE/MCEBuddy. I have everything working in BTV now (as it has for years), but I'd like to take advantage of improvements in MCE/MCEBuddy, as BTV hasn't been maintained for several years now -- I'm doing all the same things with it now, but using cobbled-together scripts to do all the conversion/renaming/moving/cleanup, etc.
Coordinator
Oct 13, 2013 at 6:38 AM
okay can you open a feature request ticket and I'll get to it so I don't forget. Also detail out how your want the title and seriesid matching/replacement to look/take place (assuming you've seen the current operation as of 2.3.14)
Coordinator
Jan 29, 2014 at 5:16 PM
rboy1 wrote:
I should have clarified. You will news to create a separate conversion task for each show where you want to force the download details.In the showname filter or filename filter (showname details are compared to the wtv metadata) enter the name of the show you want to limit the series id to.This is a point solution for specific shows. In most cases the download details works well.If multiple shows are returned in the match on tvdb mcebuddy cycles through each show comparing episode names and dates to find a match so usually to finds the correct show.However for a more accurate solution I will request you to upload a copy of the video which is getting the wrong metadata and series Id. I will try to replicate and find a better solution. Do you have the server details to uload the file?
with the latest mcebuddy you can match mutliple titles with corresponding series id's or even replace the titles and correct them from teh conversion task -> expert settings -> corrections button
Marked as answer by rboy1 on 1/29/2014 at 9:16 AM