Package | Description |
---|---|
org.archive.crawler.framework | |
org.archive.crawler.frontier | |
org.archive.crawler.frontier.precedence |
Modifier and Type | Interface and Description |
---|---|
static interface |
Frontier.FrontierGroup
Generic interface representing the internal groupings
of a Frontier's URIs -- usually queues.
|
Modifier and Type | Class and Description |
---|---|
class |
BdbWorkQueue
One independent queue of items with the same 'classKey' (eg host).
|
class |
WorkQueue
A single queue of related URIs to visit, grouped by a classKey
(typically "hostname:port" or similar)
|
Modifier and Type | Class and Description |
---|---|
class |
HighestUriQueuePrecedencePolicy.HighestUriPrecedenceProvider
Helper provider for maintaining the tracked distribution of included
URIs and calculating the queue precedence.
|
class |
PrecedenceProvider
Parent class for precedence-providers, stateful helpers that can be
installed in a WorkQueue to implement various queue-precedence policies.
|
class |
SimplePrecedenceProvider
The most simple precedence provider, simply wrapping a resettable
integer value.
|
Copyright © 2003-2014 Internet Archive. All Rights Reserved.