Video metadata download failure as noted in the logs

Aug 23, 2013 at 7:36 PM
I've tried several different ways to get the metadata download to work, but the log files just report 'failed' when access any of the data bases. Is there some special way to name an episode that will get this working. I put in the series number from thetvdb.com, from imdb.com, but no success. Thanks for your help. - a new donator.


INFORMATION> 2013-08-23T13:00:48 MCEBuddy.Engine.ConversionJob --> Current System language is English (United States) (eng)
INFORMATION> 2013-08-23T13:00:48 MCEBuddy.Engine.ConversionJob --> Getting show information and banner from Internet sources
INFORMATION> 2013-08-23T13:00:48 MCEBuddy.MetaData.VideoMetaData --> Extracting Generic Tags
2013-08-23T13:00:48 MCEBuddy.MetaData.VideoMetaData --> Extracted Generic Tags: Title:
SubTitle:
Description:
Network:
Genres:
Season: 0
Episode: 0
Banner:
Banner URL:
IMDB MovieId: tt2314792
MovieDB MovieId:
TVDB SeriesId:
Is Show Movie: False
OriginalBroadcastDateTime: 1899-12-31T18:00:00
RecordedDateTime: 1899-12-31T18:00:00
CopyProtected: False

WARNING> 2013-08-23T13:00:48 MCEBuddy.MetaData.VideoMetaData --> No recording meta data can be extracted, using Title extracted from file name. If you are running MCEBuddy on a Windows Server, this is normal as the Media Center filters are not available on that platfom.
2013-08-23T13:00:48 MCEBuddy.MetaData.VideoMetaData --> Extracted Showname from Title -> Low Winter Sun
INFORMATION> 2013-08-23T13:00:48 MCEBuddy.MetaData.VideoMetaData --> Downloading Series details
INFORMATION> 2013-08-23T13:00:48 MCEBuddy.MetaData.VideoMetaData --> Skipping downloading Banner file
INFORMATION> 2013-08-23T13:00:48 MCEBuddy.MetaData.VideoMetaData --> Recording Type Show
INFORMATION> 2013-08-23T13:00:48 MCEBuddy.MetaData.VideoMetaData --> Checking TheTVDB
WARNING> 2013-08-23T13:01:30 MCEBuddy.MetaData.VideoMetaData --> TheTVDB failed
INFORMATION> 2013-08-23T13:01:30 MCEBuddy.MetaData.VideoMetaData --> Checking TheMovieDB
WARNING> 2013-08-23T13:02:12 MCEBuddy.MetaData.VideoMetaData --> IMDB failed
INFORMATION> 2013-08-23T13:02:12 MCEBuddy.MetaData.VideoMetaData --> Checking TV.com
WARNING> 2013-08-23T13:02:55 MCEBuddy.MetaData.VideoMetaData --> TV.com failed
2013-08-23T13:02:55 MCEBuddy.MetaData.VideoMetaData --> Video Tags extracted -> Title: Low Winter Sun
SubTitle:
Description:
Network:
Genres:
Season: 0
Episode: 0
Banner:
Banner URL:
IMDB MovieId: tt2314792
MovieDB MovieId:
TVDB SeriesId:
Is Show Movie: False
OriginalBroadcastDateTime: 0001-01-01T00:00:00
RecordedDateTime: 1899-12-31T18:00:00
CopyProtected: False
Coordinator
Aug 24, 2013 at 2:35 AM
Suspect your firewall may be blocking mcebuddy from accessing the Internet.

Can you upload your complete log file after zipping it

Aug 24, 2013 at 3:43 AM
Done - the zipped directory is called metadata issues\video metadata download failure as noted in the logs.

Computer info: Windows 7 64 bit, McAfee Security Center, direct internet connection, no proxy or vpn.
Coordinator
Aug 24, 2013 at 9:33 PM
I see what's going on, it's unable to read your file but for some reason it's also terminating downloading of additional metadata.
INFORMATION> 2013-08-23T07:14:36 MCEBuddy.MetaData.VideoMetaData --> Extracting Generic Tags
WARNING> 2013-08-23T07:14:36 MCEBuddy.MetaData.VideoMetaData --> Unable to extract meta data from file C:\Users\Movie\Downloads\the.bridge.us.s01e07.720p.hdtv.x264-orenji.mkv. Specified argument was out of the range of valid values.
Parameter name: position
Can you upload the original MKV file to the MCEBuddy server
C:\Users\Movie\Downloads\the.bridge.us.s01e07.720p.hdtv.x264-orenji.mkv
so I can analyze it
Coordinator
Aug 24, 2013 at 10:12 PM
I see why it's not working. Here' why:
Specifying the TVDB points MCEBuddy to a specific series (i.e. Title of the show). Now it tried to find which episode/season within the series by extracting the original air date/time from the filename (see below). After this it tries one of these 2 methods to match TVDB.com episodes:
1. Match by Episode name (Subtitle)
2. Match by Original Air Date

In your case in MCEBuddy wasn't able to read the MKV metadata and the Title of the file is not a format recognized by MCEBuddy (see below) it couldn't get either the Episode Name nor the Original Air Date/Time, so it couldn't match against the list of episodes on TVDB hence the overall lookup failed.

MCEBuddy can parse filenames to extract Title and Original Air Date / Time when in these formats:

> SHOWNAME_AIRDATE_AIRTIME.<ext>
Where AIRDATE - YYYYMMDD, AIRTIME - HHMMHHMM (Start and End)
OR
> SHOWNAME.<ext>

So it you rename your files in this format it'll work.


Marked as answer by rboy1 on 4/13/2014 at 11:52 PM
Aug 26, 2013 at 3:30 PM
Thanks, rboy1, so far the filename convention is working great! One more quick question - how would the process work for a movie instead of a tv episode?
Coordinator
Aug 26, 2013 at 5:58 PM
Movies are more straight forward, just the name of the movie is required (i.e. Title) either from metadata or the filename.
If you specify the movieDB id or TvDB id for a movie it'll download the name and details directly.

However, I just noticed that it takes the movie flag from the WTV metadata there is no way for the user to specify it.
Are you using MKV file for movies also?


Aug 26, 2013 at 10:38 PM
Yes to using mkv files for movies also.
Coordinator
Aug 27, 2013 at 2:10 AM
Okay problem solved, in the next BETA build of MCEBuddy you'll find an option in the Conversion settings expert settings page to force the show type as Movies or TV Series.

So for your MKV Movies you can set the task show type as movies and as long as the filename matches the movie it'll do the rest from the internet.


Aug 27, 2013 at 4:12 PM
Thanks, RBoy1, you are doing great work here. While I have your attention, here are a couple of items for your consideration:
  1. When media center displays a wtv file from mcebuddy in the recorded tv section, the show is listed as having a duration of one minute. It also does not have any kind of picture displayed. The file plays perfectly fine, and, when paused, will have the correct duration. This is about (guessing here) giving media center a couple more pieces of information.
  2. Question: can a wtv file contain any other type of media format besides mpeg2, such as wmv perhaps?
Thanks for all your help!
Coordinator
Aug 27, 2013 at 5:12 PM
The answer is no to both the points. Limitation of ffmpeg, I've answered this topic multiple times in this forum. You can run through them for more details.


Apr 12, 2014 at 11:31 PM
I'm also working on getting MCEBuddy to extract data/import from TVDB.

My files are recorded in Argus TV Tuner in TS format. I use webgrabplus to import show information, but on occasion, it fails for some shows.

I will not be able to get argus to output a filename_such as :AIRDATE - YYYYMMDD, AIRTIME - HHMMHHMM (Start and End)

Argus will not give both start time and end time.

I'm interested in the "showtitle.ext" option, but how does MCEBuddy use showtitle.ext to find an episode name/number if it does not have the accurate broadcast time/date?

What argus tag is currently showing in the mcebuddy log:
Title: Shark Tank *
SubTitle:
Description: A service that helps people find and hire music instructors; an idea for preventing accidental fire-sprinkler discharges; and a battery charger that's the brainchild of two friends from Salt Lake City. Also: an update on Ava the Elephant, a medicine dispenser for children invested in by Barbara during Season 1. (new) (cc)(c)
Network: ABC
Parental Rating:
Media Credits:
Genres: Season: 0
Episode: 0
Banner:
Banner URL:
IMDB MovieId:
MovieDB MovieId:
TVDB SeriesId:
Is Show Movie: False
Is Show Sports: False
OriginalBroadcastDateTime: 1899-12-31T19:00:00
RecordedDateTime: 2014-04-11T20:58:01
SeriesPremiereDate: 1899-12-31T19:00:00
CopyProtected: False

Thanks!
Coordinator
Apr 12, 2014 at 11:36 PM
The airdate is important. That is used to match. The time is optional actually.

From your log below the subtitle is missing which is why it can't download. It needs either original broadcast date or subtitle to match information along with the title. (Or tvdb or imdb id - see the thread which explains how metadata downloading works)

Apr 13, 2014 at 6:38 PM
So to confirm, a filename such as the following should work?

ShowName (folder) \ YYYYMMDD.ext

Thanks!
Coordinator
Apr 14, 2014 at 12:38 AM
See this thread:

https://mcebuddy2x.codeplex.com/discussions/432598
SHOWNAME_AIRDATE_AIRTIME.<ext> where AIRDATE is in YYYYMMDD format and AIRTIME is in HHMMHHMM (Start and End) format (AIRTIME is optional)
Marked as answer by rboy1 on 4/13/2014 at 11:51 PM
Apr 19, 2014 at 11:33 PM
What's the convention if showname is two words? It does not seem that the following is working:

Word 1 Word 2_AIRDATE.ext

Thanks.
Coordinator
Apr 20, 2014 at 2:51 AM
It's working fine here for this title:
The Bridges That Built London_20120614.ts
Apr 26, 2014 at 5:25 PM
Most shows work for me using the the TVDB lookup, but certain shows fail. I'm attaching part of the log file for "Shark Tank" which has failed. I have tried setting the series ID for TVDB but that didn't help and neither did changing the title from Shark Tank * to Shark Tank. On my config all new shows are recorded as Show Name *.

In addition, the filename I've created as was discussed previously in this thread: ShowName \ YYYYMMDD.ext

Any help would be greatly appreciated!

INFORMATION> 2014-04-26T09:54:38 MCEBuddy.Engine.ConversionJob --> Current System language is English (United States) (eng)
INFORMATION> 2014-04-26T09:54:38 MCEBuddy.Engine.ConversionJob --> Running custom commands
2014-04-26T09:54:38 MCEBuddy.Transcode.CustomCommand --> Custom command parameters read ->
PreMetaCustomCommandPath =
PreMetaCustomCommandParameters =
PreMetaCustomCommandHangPeriod = 300
PreMetaCustomCommandCritical = False
PreMetaCustomCommandUISession = False
PreMetaCustomCommandShowWindow = True
INFORMATION> 2014-04-26T09:54:38 MCEBuddy.Transcode.CustomCommand --> No custom commands found
2014-04-26T09:54:38 MCEBuddy.Engine.ConversionJob --> Finished pre metadata custom command, source file size [KB] 3,549,556.00
INFORMATION> 2014-04-26T09:54:38 MCEBuddy.Engine.ConversionJob --> Getting show information and banner from Internet sources
INFORMATION> 2014-04-26T09:54:38 MCEBuddy.MetaData.VideoMetaData --> Extracting ARG Tags
2014-04-26T09:54:38 MCEBuddy.MetaData.VideoMetaData --> Extracting ArgusTV meta data
2014-04-26T09:54:38 MCEBuddy.MetaData.VideoMetaData --> Video Tags extracted ->
Title: Shark Tank *
SubTitle:
Description: An 11-year-old fashion designer from Memphis is excited to show Daymond John his line of handcrafted bow ties; and two men from Boston look for an investment in their "epic" obstacle-course business. Also: a hot beverage made from roasted cocoa beans and packed with antioxidants; a blend of nutritional supplements to help brain health; and an update on Marz Sprays, invested in by Lori during Season 4. (new) (cc)(c)
Network: ABC
Parental Rating:
Media Credits:
Genres: Season: 0
Episode: 0
Banner:
Banner URL:
IMDB MovieId:
MovieDB MovieId:
TVDB SeriesId:
Is Show Movie: False
Is Show Sports: False
OriginalBroadcastDateTime: 1899-12-31T19:00:00
RecordedDateTime: 2014-04-25T21:00:01
SeriesPremiereDate: 1899-12-31T19:00:00
CopyProtected: False

2014-04-26T09:54:38 MCEBuddy.MetaData.VideoMetaData --> Checking for metadata title and series correction
2014-04-26T09:54:38 MCEBuddy.MetaData.VideoMetaData --> One metadata correction option detected, matched Original Title -> , Series forcing TVDB -> 100981, IMDB -> tt1442550
2014-04-26T09:54:38 MCEBuddy.MetaData.VideoMetaData --> Forcing show type -> Series
INFORMATION> 2014-04-26T09:54:38 MCEBuddy.MetaData.VideoMetaData --> Downloading Series details
INFORMATION> 2014-04-26T09:54:38 MCEBuddy.MetaData.VideoMetaData --> Recording Type Show
INFORMATION> 2014-04-26T09:54:38 MCEBuddy.MetaData.VideoMetaData --> Checking TheTVDB
WARNING> 2014-04-26T09:54:38 MCEBuddy.MetaData.VideoMetaData --> TheTVDB failed
INFORMATION> 2014-04-26T09:54:38 MCEBuddy.MetaData.VideoMetaData --> Checking TV.com
WARNING> 2014-04-26T09:54:39 MCEBuddy.MetaData.VideoMetaData --> TV.com failed
INFORMATION> 2014-04-26T09:54:39 MCEBuddy.MetaData.VideoMetaData --> Checking IMDB
WARNING> 2014-04-26T09:54:40 MCEBuddy.MetaData.VideoMetaData --> IMDB failed
2014-04-26T09:54:40 MCEBuddy.MetaData.VideoMetaData --> Updated Video Tags after downloading details ->
Title: Shark Tank *
SubTitle:
Description: An 11-year-old fashion designer from Memphis is excited to show Daymond John his line of handcrafted bow ties; and two men from Boston look for an investment in their "epic" obstacle-course business. Also: a hot beverage made from roasted cocoa beans and packed with antioxidants; a blend of nutritional supplements to help brain health; and an update on Marz Sprays, invested in by Lori during Season 4. (new) (cc)(c)
Network: ABC
Parental Rating:
Media Credits:
Genres: Season: 0
Episode: 0
Banner: C:\Lucas Program\Multimedia\Video\MCEbuddy\cache\Shark Tank.jpg
Banner URL:
IMDB MovieId: tt1442550
MovieDB MovieId:
TVDB SeriesId: 100981
Is Show Movie: False
Is Show Sports: False
OriginalBroadcastDateTime: 1899-12-31T19:00:00
RecordedDateTime: 2014-04-25T21:00:01
SeriesPremiereDate: 1899-12-31T19:00:00
CopyProtected: False
Coordinator
Apr 26, 2014 at 8:24 PM
Please post a link to the full log. Also recently we added support for tmdb for TV series metadata look up

Coordinator
Apr 26, 2014 at 11:48 PM
ACtually it's pretty clear, there is no subtitle
SubTitle:
nor is there the original broadcast date
OriginalBroadcastDateTime: 1899-12-31T19:00:00
How do you expect MCEBuddy to match the episode information.
Apr 27, 2014 at 11:50 AM
From looking at the log, I agree that I'm missing subtitle and OriginalBroadcastDateTime. However, from earlier in this thread, I thought this could be fixed by MCEBuddy by naming the file as such:

ShowName (folder) \ YYYYMMDD.ext

That is what I've done with this file. The RecordedDateTime is accurate (and reflects the original broadcast date), as well. Is this not correct?
Coordinator
Apr 27, 2014 at 4:16 PM
Aaah I see what you're saying. Unfortunatley that only works for .TS files or other files when no metadata (embedded or XML is found).

For WTV and DVRMS it depends upon the embedded metadata only unfortunately.


Coordinator
Apr 27, 2014 at 4:20 PM
Also importantly, MCEBuddy need the ORIGINAL broadcast Date (i.e. when it was FIRST broadcast, NOT the recording date). Where will you get that information from?
I can add the code to pick up the date from the filename if the original broadcast date is empty, but again where will you get it from?
Coordinator
Apr 27, 2014 at 4:23 PM
Edited Apr 27, 2014 at 4:23 PM
facted wrote:
From looking at the log, I agree that I'm missing subtitle and OriginalBroadcastDateTime. However, from earlier in this thread, I thought this could be fixed by MCEBuddy by naming the file as such:

ShowName (folder) \ YYYYMMDD.ext

That is what I've done with this file. The RecordedDateTime is accurate (and reflects the original broadcast date), as well. Is this not correct?
BTW, it's NOT
ShowName (folder) \ YYYYMMDD.ext

It is
SHOWNAME_AIRDATE.<ext> where AIRDATE is in YYYYMMDD format
Coordinator
Apr 27, 2014 at 5:02 PM
Okay added support to read the title and if there is no Original Broadcast Date then it'll try to parse the filename title for the original broadcast date in the format
SHOWNAME_AIRDATE_AIRTIME.<ext> where AIRDATE is in YYYYMMDD format and AIRTIME is in HHMMHHMM (Start and End) format (AIRTIME is optional)
May 14, 2014 at 7:01 PM
This is still failing for me at times. Please check the Frontline_20140513.ts log file I've uploaded. In the log, the "OriginalBroadcastDateTime" shows as the correct date 2014-05-13 but the metadata extraction a little higher up in the log shows:

2014-05-13T23:02:26 MCEBuddy.MetaData.VideoMetaData --> Extracted Original Broadcast Date from Title -> YYYY-05-DD

This is happening on a few shows, not just this one.

Thanks.
Coordinator
May 14, 2014 at 8:00 PM
Do you have a .arg file along with your TS file? It seems to be parsing an ARGUS tv metadata file
BTW, side note, noticed your renaming is incorrect, there is a space before the S%season%
Coordinator
May 14, 2014 at 8:05 PM
No it's working fine, what you're seeing is just a bug in printing (will correct it). Scroll down a few lines and see the actual data:

OriginalBroadcastDateTime: 2014-05-13T00:00:00
May 14, 2014 at 11:42 PM
Deleting the arg file pretty much solves it. I can't seem to get Argus to not include an arg file though. Any way to have MCEBuddy ignore it?
Coordinator
May 15, 2014 at 12:37 AM
Nope sorry, but you can write a premeta custom command to delete the argus file.


May 17, 2014 at 7:33 PM
I see where you mention parsing the file name for broadcast date and the formats supported but nowhere do I see Channel being mentioned. When I record a show in MCE on Win7 the default filenames appear as: Grimm_WLTZDT_2014_05_16_20_59_00.wtv with WLTZDT being the channel....is that going to parse correctly? I'm getting multiple shows on a regular basis that are failing the tvdb lookup but the information appears to be present on the site to me. Example:

MCEBuddy unable to download series information
Source Video -> C:\Users\Public\Recorded TV\Grimm_WLTZDT_2014_05_16_20_59_00.wtv
Failed At -> 2014-05-17T00:52:49
Title: Grimm
SubTitle: Blond Ambition
Description: Rosalee and Monroe's big day arrives; a realization shakes Juliette and Nick's relationship to its core; Adalind's plan leads to a catastrophic event.
Network: WLTZDT (WLTZ-DT)
Parental Rating: TV-14
Media Credits: David Giuntoli/Russell Hornsby/Reggie Lee/Silas Weir Mitchell/Sasha Roiz/Bitsie Tulloch/Bree Turner/Claire Coffee;;;Jacqueline Toboni/C. Thomas Howell/Dee Wallace/Chris Mulkey
Genres: Drama,General,Series,Sci-Fi/Fantasy
Season: 0
Episode: 0
Banner:
Banner URL:
IMDB MovieId:
MovieDB MovieId:
TVDB SeriesId:
Is Show Movie: False
Is Show Sports: False
OriginalBroadcastDateTime: 2014-05-16T00:00:00
RecordedDateTime: 2014-05-16T20:59:02
SeriesPremiereDate: 1899-12-31T19:00:00
CopyProtected: False

This was processed with the most recent mcebuddy prior to the release you put out 2 days ago.
Coordinator
May 17, 2014 at 7:43 PM
Parsing the filename is done primarily for TS files as they don't contain metadata and instead the recording software (e.g. Media Portal) name the file such that the original broadcast date is included in the filename. The only way to get metadata from these files.

WTV and DVRMS on the otherhand have a rich set of metata in them which are extracted using the Directshow filters. so there is no need to parse the title as all the information can be found within the file metadata. (the filename only contains the showname and RECORDED DATE, not original broadcast date), however the metadata as you can see contains much more.

I can see why you aren't able to download additional metadata. Try it today and it'll work. Reason being you're recording/processing the same day it is being aired. If you look at the metadata website (theTVDB.com e..g http://thetvdb.com/?tab=seasonall&id=248736&lid=7) you'll see that the information about your episode Blonde Ambition was added AFTER the air date (2014-05-16 was air date, the information was added there after). Hence on the day of airing there was NOTHING to download, hence the metadata download fails.

Nothing MCEBuddy can do about that, the other option is you can manually update the information on the website (these are all user generated content, so someone is updating it) before the show airs and then the show airs mcebuddy will see the information and download it.


May 17, 2014 at 9:56 PM
Thanks for the explanation. I didn't see anything that showed me when the information was added when I looked on tvdb.com. I just saw the information was present when I checked the next day after reading the email alert since the processing occured late that night. I guess I need to find an app that will take the .nfo file generated and redo a lookup then rename it for the files that failed as they get written out as "Grimm-SE-Blond Ambition.mkv"
Coordinator
May 17, 2014 at 10:34 PM
well with some creativity you could potentially have mcebuddy do it.

Write a batch script that checks for an episode in the nfo, if it can't find the episode, move it to another folder and rename it as showname_broadcastdate (see the specific format above). Then create a monitor task which monitors that folder. Create a conversion task that only renames (ensure download metadata is checked) and link the new monitor task only to that conversion task. (ensure you delink the new monitor task from your old conversion task).

Now setup the batch script to run on schedule. Hope this helps


Jan 10, 2015 at 3:30 AM
Edited Jan 10, 2015 at 3:34 AM
rboy1 wrote:
Suspect your firewall may be blocking mcebuddy from accessing the Internet. Can you upload your complete log file after zipping it
Silly question, sorry. I'm having this issue as well. I have files named with the format suggested:

SHOWNAME_AIRDATE_AIRTIME.<ext> where AIRDATE is in YYYYMMDD format and AIRTIME is in HHMMHHMM (Start and End) format (AIRTIME is optional)

I had Community_YYYYMMDD.mp4 or Community_YYMMDD_000000.mp4 (I made up the start and end time, just to see if would parse it). Unfortunately, no luck. I also shutoff my firewall, but to no avail.

Is there any other recommendations?

It use to work, but after the new year, it doesn't seem to be able to get any metadata.

I'm running MCEBuddy 2.3.13 on Win 8. Also, the files are being pulled off my Tablo. I doubt they have metadata inside the file, but the script pulling them off the device does extract the metadata in the file and naming them in this format: SHOW_NAME_AIRDATE.mp4
Coordinator
Jan 10, 2015 at 2:04 PM
I'm running MCEBuddy 2.3.13
There in lies your answer. The website keep changing formats and older versions stop working, that one reason why we are constantly busy updating the program. Upgrade to the latest version and it should solve your issue.