Kommentare zu: Nutch – meta description in search results

Von: Volli

Volli — Thu, 26 Aug 2010 00:38:27 +0000

No chance with Nutch 1.1 (for me!).

#x: bin/nutch index crawl/NEWindexes crawl/crawldb crawl/linkdb crawl/segments/*

throws errors:
Indexer: starting
Indexer: java.io.IOException: Job failed!
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1252)
at org.apache.nutch.indexer.Indexer.index(Indexer.java:72)
at org.apache.nutch.indexer.Indexer.run(Indexer.java:92)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.nutch.indexer.Indexer.main(Indexer.java:101)

Afterwards I tried a built (from final 1.1 src) without description-plugin and it worked without any errors.

But I learned a lot ’bout nutch structure and ant compiling. So, thanks for your efforts!

Von: Volli

Volli — Wed, 25 Aug 2010 22:44:37 +0000

-Nutch 1.1; Compiling procedure-
Just a intermediate result (I stopped at point successful building with ant; no further testing yet!!! Maybe completely senseless!? They changed a lot with Nutch 1.1.):

DescriptionIndexer.java:
1) Hellkeeper’s advice.
2) FIND:
Field.Store.YES, Field.Index.UN_TOKENIZED
3) CHANGE:
Field.Store.YES, Field.Index.NOT_ANALYZED

Von: Chris

Chris — Wed, 27 Jan 2010 15:38:30 +0000

Thanks for this tip. It was a big help.

Von: Hellkeeper

Hellkeeper — Tue, 29 Sep 2009 16:36:35 +0000

To get it running in final nutch 1.0 version you have to change line 26 in file DescriptionIndexer.java to this: public abstract class DescriptionIndexer implements IndexingFilter

Thx to Alex for this help!

Von: Alex

Alex — Thu, 09 Apr 2009 20:20:13 +0000

Jacob,
did it work in the meantime? Maybe the content of your description tag is not taken to the index.

Von: Jacob

Jacob — Thu, 02 Apr 2009 16:21:53 +0000

Hi Alex,

Firs of all thanks for your post,

I got a problem because nutch doesn’t find anything when I want to search by description, everything works perfect but when I search some content stored on the description doesn’t find anything, any idea?

Von: Alex

Alex — Sat, 28 Feb 2009 18:58:24 +0000

Hi Mille,

Yes you can pass it with parse.getData().getContentMeta().set(“your_description”, your_data);

Then simply get it using

String desc = parse.getData().getMeta(“your_description”);

and you’re done.

Cheers

Von: MilleB

MilleB — Sat, 28 Feb 2009 16:53:47 +0000

Interesting example, my problem is slightly different.
Instead of looking to metatag, i need to run a regexp on the text to find the tags I’m looking for.

I suppose I can modify the parser for that… so I get a list of tags
do you think I can use :
parse.getData().getContentMeta().set(META_DESCRIPTION_NAME, desc); to pass them on to the indexer ?

Von: Alex

Alex — Fri, 27 Feb 2009 07:58:54 +0000

Didn’t check if it had really an impact in the result-listing, but thought it would look good

Von: Alex

Alex — Fri, 27 Feb 2009 07:57:03 +0000

Because I wanted search results _with_ a description being listed before those without a description.