Please take our Survey
logo       

Choosing A Webhost:
A web hosting service is a type of Internet hosting service that allows individuals and organizations to provide their own website accessible via the World Wide Web. Web hosts are companies that provide space on a server they own for use by their clients as well as providing Internet connectivity, typically in a data center. Web hosts can also provide data center space and connectivity to the Internet for servers they do not own to be located in their data center, called colocation. more...

Spanish stemmer with accents stripped before stemming: msg#00003

search.snowball

Subject: Spanish stemmer with accents stripped before stemming

Hello!

We're trying to fine-tune an applicaiton we're building that searches
mainly Spanish content. We've been working with Lucene and the included
Spanish snowball stemmer.

We are removing accents before stemming because misplaced-accent errors
are extremely common--we cannot expect users to enter correctly accented
terms in their queries.

Our approach so far has been to simply replace accented characters in
the Spanish stemmer Java code with unaccented ones. This has produced a
stemmer that works--to a degree--but some simple terms are no longer
stemmed correctly. Specifically, regular plural masculine nouns
("libros" or "datos") are not stemmed at all.

Still, after reading the explanation of the Spanish algorithm [1] I
can't see why this would be the case--or why the removal of accented
characters from both the code and stemmer input would affect the
algorithm's effectivenes at all.

You can see our code here [2] and here [3].

Any suggestions?

Thanks in advance,
Andrew Green


[1] http://snowball.tartarus.org/algorithms/spanish/stemmer.html
[2]
http://200.67.231.185/svn/pescador/trunk/java_source/net/sf/snowball/ext/Spanish2Stemmer.java
[3]
http://200.67.231.185/svn/pescador/trunk/java_source/org/apache/lucene/analysis/snowball/SnowballAnalyzerWithoutAccents.java


<Prev in Thread] Current Thread [Next in Thread>
Google Custom Search

Recently Viewed:
qnx.openqnx.dev...    gcc.libstdc++.c...    solaris.opensol...    information-ret...    misc.misterhous...    web.catalyst.ge...    apache.webservi...    redhat.release....    hardware.lirc/2...    kernel.autofs/2...    technology.sust...    linux.vdr/2003-...    editors.lyx.gen...    org.user-groups...    netbsd.devel.pk...    xdg.devel/2004-...    version-control...    jakarta.slide.d...    debian.packages...    creativecommons...    ports.ppc.embed...    bug-tracking.bu...   
Home | blog view | USPTO Patent Archive | advertise | OSDir is an inevitable website. super tiny logo

Free Magazines

Cisco News
Receive a free quarterly e-newsletter with exclusive articles on how Cisco IT uses its own products and solutions to enable the business.
subscribe

Systems Management News, the newspaper for IT systems administration and data center managers! Each issue of Systems Management News is chock-full of news and analysis to help you understand what's happening in your field.
subscribe

The Enterprise Newsweekly eWeek is the essential technology information source for builders of e-business.
subscribe

Oracle Magazine Oracle Magazine contains technology strategy articles, sample code, tips, Oracle and partner news, how to articles for developers and DBAs, and more. Oracle (NASDAQ: ORCL) is the world's largest enterprise software company.
subscribe

Total Telecom Total Telecom is "The Economist of the communications industry".
subscribe