Package | Description |
---|---|
org.archive.crawler.deciderules |
Provides classes for a simple decision rules framework.
|
org.archive.crawler.framework | |
org.archive.crawler.frontier | |
org.archive.crawler.postprocessor | |
org.archive.crawler.processor | |
org.archive.crawler.spring | |
org.archive.modules |
The beginnings of a refactored settings framework.
|
org.archive.modules.deciderules | |
org.archive.modules.deciderules.recrawl | |
org.archive.modules.deciderules.surt | |
org.archive.modules.fetcher |
Class and Description |
---|
DecideRule |
MatchesRegexDecideRule
Rule applies configured decision to any CrawlURIs whose String URI
matches the supplied regex.
|
PredicatedDecideRule
Rule which applies the configured decision only if a
test evaluates to true.
|
Class and Description |
---|
DecideRule |
Class and Description |
---|
DecideRule |
Class and Description |
---|
DecideRule |
Class and Description |
---|
DecideRule |
Class and Description |
---|
DecideRule |
Class and Description |
---|
DecideRule |
Class and Description |
---|
ContentTypeMatchesRegexDecideRule
DecideRule whose decision is applied if the URI's content-type
is present and matches the supplied regular expression.
|
DecideResult
The decision of a DecideRule.
|
DecideRule |
ExternalGeoLookupInterface
Interface used by
ExternalImplDecideRule . |
FetchStatusMatchesRegexDecideRule |
MatchesFilePatternDecideRule
Compares suffix of a passed CrawlURI, UURI, or String against a regular
expression pattern, applying its configured decision to all matches.
|
MatchesFilePatternDecideRule.Preset |
MatchesListRegexDecideRule
Rule applies configured decision to any CrawlURIs whose String URI
matches the supplied regexs.
|
MatchesRegexDecideRule
Rule applies configured decision to any CrawlURIs whose String URI
matches the supplied regex.
|
PredicatedDecideRule
Rule which applies the configured decision only if a
test evaluates to true.
|
ResourceNoLongerThanDecideRule
Applies configured decision for URIs with content length less than or equal
to a given threshold length value.
|
Class and Description |
---|
DecideRule |
PredicatedDecideRule
Rule which applies the configured decision only if a
test evaluates to true.
|
Class and Description |
---|
DecideRule |
PredicatedDecideRule
Rule which applies the configured decision only if a
test evaluates to true.
|
Class and Description |
---|
DecideRule |
Copyright © 2003-2014 Internet Archive. All Rights Reserved.