Package | Description |
---|---|
org.archive.crawler.datamodel | |
org.archive.crawler.frontier | |
org.archive.crawler.util |
Class and Description |
---|
UriUniqFilter.CrawlUriReceiver
URIs that pass the filter (are new / unique / not already-seen)
are passed to this object, typically a frontier.
|
Class and Description |
---|
UriUniqFilter
A UriUniqFilter passes URI objects to a destination
(receiver) if the passed URI object has not been previously seen.
|
UriUniqFilter.CrawlUriReceiver
URIs that pass the filter (are new / unique / not already-seen)
are passed to this object, typically a frontier.
|
Class and Description |
---|
UriUniqFilter
A UriUniqFilter passes URI objects to a destination
(receiver) if the passed URI object has not been previously seen.
|
UriUniqFilter.CrawlUriReceiver
URIs that pass the filter (are new / unique / not already-seen)
are passed to this object, typically a frontier.
|
Copyright © 2003-2014 Internet Archive. All Rights Reserved.