org.archive.crawler.frontier

Class QueueAssignmentPolicy

java.lang.Object

org.archive.crawler.frontier.QueueAssignmentPolicy

All Implemented Interfaces:

Serializable, HasKeyedProperties

Direct Known Subclasses:

BucketQueueAssignmentPolicy, URIAuthorityBasedQueueAssignmentPolicy

public abstract class QueueAssignmentPolicy
extends Object
implements Serializable, HasKeyedProperties

Establishes a mapping from CrawlURIs to String keys (queue names).

Author:

gojomo

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
protected KeyedProperties	kp

Constructor Summary

Constructors

Constructor and Description
QueueAssignmentPolicy()

Method Summary

Methods

Modifier and Type	Method and Description
abstract String	getClassKey(CrawlURI cauri) Get the String key (name) of the queue to which the CrawlURI should be assigned.
String	getForceQueueAssignment()
KeyedProperties	getKeyedProperties()
int	maximumNumberOfKeys() Returns the maximum number of different keys this policy can create.
void	setForceQueueAssignment(String forceQueueAssignment)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

kp

protected KeyedProperties kp

Constructor Detail

QueueAssignmentPolicy

public QueueAssignmentPolicy()

Method Detail

getKeyedProperties

public KeyedProperties getKeyedProperties()

Specified by:

getKeyedProperties in interface HasKeyedProperties

getForceQueueAssignment

public String getForceQueueAssignment()

setForceQueueAssignment

public void setForceQueueAssignment(String forceQueueAssignment)

getClassKey

public abstract String getClassKey(CrawlURI cauri)

Get the String key (name) of the queue to which the CrawlURI should be assigned. Note that changes to the CrawlURI, or its associated components (such as CrawlServer), may change its queue assignment.

Parameters:

controller - This crawls' controller.

cauri - CandidateURI to calculate class key for.

Returns:

the String key of the queue to assign the CrawlURI

maximumNumberOfKeys

public int maximumNumberOfKeys()

Returns the maximum number of different keys this policy can create. If there is no maximum, -1 is returned (default).

Returns:

Maximum number of different keys, or -1 if unbounded.