Package | Description |
---|---|
org.archive.crawler.frontier | |
org.archive.crawler.reporting | |
org.archive.modules.deciderules.surt | |
org.archive.modules.seeds |
Modifier and Type | Class and Description |
---|---|
class |
AbstractFrontier
Shared facilities for Frontier implementations.
|
class |
BdbFrontier
A Frontier using several BerkeleyDB JE Databases to hold its record of
known hosts (queues), and pending URIs.
|
class |
WorkQueueFrontier
A common Frontier base using several queues to hold pending URIs.
|
Modifier and Type | Class and Description |
---|---|
class |
StatisticsTracker
This is an implementation of the AbstractTracker.
|
Modifier and Type | Class and Description |
---|---|
class |
NotOnDomainsDecideRule
Rule applies configured decision to any URIs that are
*not* in one of the domains in the configured set of
domains, filled from the seed set.
|
class |
NotOnHostsDecideRule
Rule applies configured decision to any URIs that
are *not* on one of the hosts in the configured set of
hosts, filled from the seed set.
|
class |
NotSurtPrefixedDecideRule
Rule applies configured decision to any URIs that, when
expressed in SURT form, do *not* begin with one of the prefixes
in the configured set.
|
class |
OnDomainsDecideRule
Rule applies configured decision to any URIs that
are on one of the domains in the configured set of
domains, filled from the seed set.
|
class |
OnHostsDecideRule
Rule applies configured decision to any URIs that
are on one of the hosts in the configured set of
hosts, filled from the seed set.
|
class |
SurtPrefixedDecideRule
Rule applies configured decision to any URIs that, when
expressed in SURT form, begin with one of the prefixes
in the configured set.
|
Modifier and Type | Field and Description |
---|---|
protected Set<SeedListener> |
SeedModule.seedListeners |
Modifier and Type | Method and Description |
---|---|
Set<SeedListener> |
SeedModule.getSeedListeners() |
Modifier and Type | Method and Description |
---|---|
void |
SeedModule.addSeedListener(SeedListener sl) |
Modifier and Type | Method and Description |
---|---|
void |
SeedModule.setSeedListeners(Set<SeedListener> seedListeners) |
Copyright © 2003-2014 Internet Archive. All Rights Reserved.