Package | Description |
---|---|
org.archive.crawler.framework | |
org.archive.crawler.frontier |
Modifier and Type | Method and Description |
---|---|
Frontier.FrontierGroup |
Frontier.getGroup(CrawlURI curi)
Get the 'frontier group' (usually queue) for the given
CrawlURI.
|
Modifier and Type | Class and Description |
---|---|
class |
BdbWorkQueue
One independent queue of items with the same 'classKey' (eg host).
|
class |
WorkQueue
A single queue of related URIs to visit, grouped by a classKey
(typically "hostname:port" or similar)
|
Modifier and Type | Method and Description |
---|---|
Frontier.FrontierGroup |
BdbFrontier.getGroup(CrawlURI curi) |
Copyright © 2003-2014 Internet Archive. All Rights Reserved.