plugin.includes nutch-extensionpoints|protocol-(file|pmid)|urlfilter-regex|parse-(text|html|pubmed)|index-basic|query-(basic|site|url) Regular expression naming plugin directory names to include. Any plugin not matching this expression is excluded. In any case you need at least include the nutch-extensionpoints plugin. By default Nutch includes crawling just HTML and plain text via HTTP, and basic indexing and search plugins. urlnormalizer.class org.apache.nutch.net.TrivialUrlNormalizer Name of the class used to normalize URLs. protocol.pmc.colorizer http://oriole.eecs.umich.edu/cgi-bin/colorizeHtmlText.pl Path to PMC abstract/citations colorizer protocol.pmid.pubmed_url http://www\.ncbi\.nlm\.nih\.gov/entrez/query\.fcgi\?cmd=Retrieve&db=pubmed&dopt=Abstract&query_hl=1&itool=pubmed_docsum URL to PubMed Entrez search utility. URLs for protocol-pmid should be of this form, with &list_uids=$PMID on the end. db.max.anchor.length 65536 The maximum number of characters permitted in an anchor. db.ignore.internal.links false If true, when adding new links to a page, links from the same host are ignored. This is an effective way to limit the size of the link database, keeping the only the highest quality links.