logo       
Google Custom Search
    AddThis Social Bookmark Button
-->

Re: tv_imdb: msg#00104

Subject: Re: tv_imdb
On Wed, 26 Nov 2003 21:13:38 -0700
Jerry Veldhuis <jerry@xxxxxxxxxxx> wrote:

> 
> 
> --On Wednesday, November 26, 2003 2:13 PM -0800 Florian Winterstein 
> <f-win@xxxxxxx> wrote:
> 
> > Is there still development going on for tv_imdb? It was a little painful
> > to install since it:
> > 1. Did not dl the lists (even though it told me it did)
> This isn't a common problem, at least not reported. Could also be that
> not many use the --download option. Can you forward any error messages
> or directory lists before/after that demonstrates the failure ? Do you
> normally use a proxy server for ftp access ?
> 
> > 2. Was not able to unzip them after I downloaded them manually
> This is interesting, can you forward a transcript of the steps your
> taking ? I take it you mean gunzip and not unzip... correct ?

Yes, I used gunzip. Let me see if I can reproduce it for you...

$ tv_imdb --version
XMLTV module version 0.5.23
This is tv_imdb version 1.19, 2003/11/19 22:28:38 

$ tv_imdb --imdbdir /home/florian/tmp/db -prepStage all 
Building indices.  Be warned, this needs a lot of memory for the final stage
(working set about 220 megabytes).

starting prep stage 1 (parsing movies.list)..
readline() on unopened filehandle XMLTV::Gunzip::FH at 
/usr/local/share/perl/5.6.1/XMLTV/IMDB.pm line 1393.
parsing Movies:   0% [*                                                         
                          ]readline()
 on unopened filehandle XMLTV::Gunzip::FH at 
/usr/local/share/perl/5.6.1/XMLTV/IMDB.pm line 1421.
parsing Movies: 100% 
[====================================================================================]--
 DONE --
Parsed 0 titles in 0 seconds
ARG estimate of 370000 for movies needs updating, found 0
writing stage1 data ..
writing titles: (nothing to do)prep stage 1 succeeded with no errors
starting prep stage 2 (parsing directors.list)..
parsing Directors:   0% [*                                                      
                          ]readline()
 on unopened filehandle XMLTV::Gunzip::FH at 
/usr/local/share/perl/5.6.1/XMLTV/IMDB.pm line 1515.
readline() on unopened filehandle XMLTV::Gunzip::FH at 
/usr/local/share/perl/5.6.1/XMLTV/IMDB.pm line 1544.
parsing Directors: 100% 
[=================================================================================]--
 DONE --
Parsed 0 Directors in 0 titles in 0 seconds
ARG estimate of 75500 for directors needs updating, found 0
writing stage2 data ..
writing directors: (nothing to do)prep stage 2 succeeded with no errors
starting prep stage 3 (parsing actors.list)..
parsing Actors:   0% [*                                                         
                          ]readline()
 on unopened filehandle XMLTV::Gunzip::FH at 
/usr/local/share/perl/5.6.1/XMLTV/IMDB.pm line 1515.
readline() on unopened filehandle XMLTV::Gunzip::FH at 
/usr/local/share/perl/5.6.1/XMLTV/IMDB.pm line 1544.
parsing Actors: 100% 
[====================================================================================]--
 DONE --
Parsed 0 Actors in 0 titles in 0 seconds
ARG estimate of 460000 for actors needs updating, found 0
writing stage3 data ..
writing actors: (nothing to do)prep stage 3 succeeded with no errors
starting prep stage 4 (parsing actresses.list)..
parsing Actresses:   0% [*                                                      
                          ]readline()
 on unopened filehandle XMLTV::Gunzip::FH at 
/usr/local/share/perl/5.6.1/XMLTV/IMDB.pm line 1515.
readline() on unopened filehandle XMLTV::Gunzip::FH at 
/usr/local/share/perl/5.6.1/XMLTV/IMDB.pm line 1544.
parsing Actresses: 100% 
[=================================================================================]--
 DONE --
Parsed 0 Actresses in 0 titles in 0 seconds
ARG estimate of 280000 for actresses needs updating, found 0
writing stage4 data ..
writing actresses: (nothing to do)prep stage 4 succeeded with no errors
starting prep stage 5 (parsing genres.list)..
readline() on unopened filehandle XMLTV::Gunzip::FH at 
/usr/local/share/perl/5.6.1/XMLTV/IMDB.pm line 1393.
parsing Genres:   0% [*                                                         
                          ]readline()
 on unopened filehandle XMLTV::Gunzip::FH at 
/usr/local/share/perl/5.6.1/XMLTV/IMDB.pm line 1421.
parsing Genres: 100% 
[====================================================================================]--
 DONE --
Parsed 0 titles in 0 seconds
ARG estimate of 250000 for genres needs updating, found 0
writing stage5 data ..
writing genres: (nothing to do)prep stage 5 succeeded with no errors
starting prep stage 6 (parsing ratings.list)..
readline() on unopened filehandle XMLTV::Gunzip::FH at 
/usr/local/share/perl/5.6.1/XMLTV/IMDB.pm line 1656.
parsing Ratings:   0% [*                                                        
                          ]readline()
 on unopened filehandle XMLTV::Gunzip::FH at 
/usr/local/share/perl/5.6.1/XMLTV/IMDB.pm line 1684.
parsing Ratings: 100% 
[===================================================================================]--
 DONE --
Parsed 0 titles in 0 seconds
ARG estimate of 76000 for ratings needs updating, found 0
writing stage6 data ..
writing ratings: (nothing to do)prep stage 6 succeeded with no errors
starting prep stage 7 (creating indexes..)..
parsing stage 1 data (movie list)..
reading titles: (nothing to do)merging in stage 2 data (directors)..
reading directors: (nothing to do)merging in stage 3 data (actors)..
reading actors: (nothing to do)merging in stage 4 data (actresses)..
reading actresses: (nothing to do)merging in stage 5 data (genres)..
reading genres: (nothing to do)merging in stage 6 data (ratings)..
reading ratings: (nothing to do)computing indexes..
indexing by title: (nothing to do)writing out indexes..
writing index: (nothing to do)running quick sanity check on database indexes...
prep stage 7 failed with 30 errors in /home/florian/tmp/db/stage7.log
        (in cleanup) Can't call method "gzclose" on an undefined value at 
/usr/local/share/perl/5.6.1/XMLTV/Gunzip.pm
 line 194 during global destruction.


> 
> > 3. Was not able to parse one of the lists until I removed some lines of
> > the description
> >
> What kind of failure were you seeing ? tv_imdb in the 0.5.23 has problems
> with stage 5 (genres list) and as a side-effect stage 7 fails. This problem
> has been solved, but didn't require removing lines from the list files. Can
> you post the lines you had to remove ?


After manually unzipping it:

...
writing actresses: 100% 
[=================================================================================]--
 DONE --prep stage 4 succeeded with no errors
starting prep stage 5 (parsing genres.list)..
prep stage 5 failed with 1 errors in /home/florian/tmp/db/stage5.log


db$ cat stage5.log
/home/florian/tmp/db/lists/genres.list: stopping at line 1001, didn't see "8: 
THE GENRES LIST" line


> 
> Can you confirm you're running XMLTV 0.5.23 ?
> 

Please see step 2.


> > Anyway I installed it and think it can be quit useful.
> >
> :)
> 
> > I recognized that categories are only added if no category was present in
> > the original file. Is this intended? Are there options to customize this
> > behavior?
> >
> Does this mean you got it to run ? The default action (without modifying
> the IMDB.pm code) is to add categories and not delete any existing ones.
> Can you give an example ?

Yes, I got it to run. I don't want it to delete the existing information but 
the way it behaves right now is NOT to ADD new categories if a category is 
already present. If I remove the category in the source file it adds the IMDB 
categories! I think it would not hurt to always add the IMDB categories and in 
addition keep the existing ones?

Did you make any tests how many movies are actually match the IMDB movie titles?




> 
> > E.g. is there an option to NOT add the extra title of an close match?
> >
> No, I've kept this in mind while developing, but the only controls
> are via manually changing the IMDB.pm package. It may be some time
> before this becomes controllable.
> 
> > Great application by the way!
> >
> :)
> 
> jerry
> 
> 
> 
> -------------------------------------------------------
> This SF.net email is sponsored by: SF.net Giveback Program.
> Does SourceForge.net help you be more productive?  Does it
> help you create better code?  SHARE THE LOVE, and help us help
> YOU!  Click Here: http://sourceforge.net/donate/
> _______________________________________________
> Xmltv-devel mailing list
> Xmltv-devel@xxxxxxxxxxxxxxxxxxxxx
> https://lists.sourceforge.net/lists/listinfo/xmltv-devel
> 




-------------------------------------------------------
This SF.net email is sponsored by: SF.net Giveback Program.
Does SourceForge.net help you be more productive?  Does it
help you create better code?  SHARE THE LOVE, and help us help
YOU!  Click Here: http://sourceforge.net/donate/


<Prev in Thread] Current Thread [Next in Thread>