Package | Description |
---|---|
org.archive.crawler.frontier | |
org.archive.crawler.frontier.precedence | |
org.archive.crawler.prefetch |
Class and Description |
---|
PrecedenceProvider
Parent class for precedence-providers, stateful helpers that can be
installed in a WorkQueue to implement various queue-precedence policies.
|
QueuePrecedencePolicy
Superclass for QueuePrecedencePolicies, which set a integer precedence value
on uri-queues inside the frontier when the uri-queue is first created, and
before the uri-queue is placed on a new internal queue-of-queues.
|
Class and Description |
---|
BaseQueuePrecedencePolicy
QueuePrecedencePolicy that sets a uri-queue's precedence to a configured
single value.
|
BaseUriPrecedencePolicy
UriPrecedencePolicy which assigns URIs a set value (perhaps a overridden
for different URIs).
|
PrecedenceProvider
Parent class for precedence-providers, stateful helpers that can be
installed in a WorkQueue to implement various queue-precedence policies.
|
QueuePrecedencePolicy
Superclass for QueuePrecedencePolicies, which set a integer precedence value
on uri-queues inside the frontier when the uri-queue is first created, and
before the uri-queue is placed on a new internal queue-of-queues.
|
SimplePrecedenceProvider
The most simple precedence provider, simply wrapping a resettable
integer value.
|
UriPrecedencePolicy
Superclass for URI precedence policies, which set a integer
precedence value on individual URIs when they are first
submitted to a frontier for scheduling.
|
Class and Description |
---|
UriPrecedencePolicy
Superclass for URI precedence policies, which set a integer
precedence value on individual URIs when they are first
submitted to a frontier for scheduling.
|
Copyright © 2003-2014 Internet Archive. All Rights Reserved.