Package | Description |
---|---|
org.archive.crawler.framework | |
org.archive.crawler.frontier | |
org.archive.crawler.postprocessor | |
org.archive.crawler.prefetch | |
org.archive.crawler.processor |
Modifier and Type | Field and Description |
---|---|
protected Frontier |
CrawlController.frontier
The frontier to use for the crawl.
|
protected Frontier |
ActionDirectory.frontier
autowired frontier for actions
|
Modifier and Type | Method and Description |
---|---|
Frontier |
CrawlController.getFrontier() |
Frontier |
ActionDirectory.getFrontier() |
Modifier and Type | Method and Description |
---|---|
void |
CrawlController.setFrontier(Frontier frontier) |
void |
ActionDirectory.setFrontier(Frontier frontier) |
Modifier and Type | Class and Description |
---|---|
class |
AbstractFrontier
Shared facilities for Frontier implementations.
|
class |
BdbFrontier
A Frontier using several BerkeleyDB JE Databases to hold its record of
known hosts (queues), and pending URIs.
|
class |
WorkQueueFrontier
A common Frontier base using several queues to hold pending URIs.
|
Modifier and Type | Method and Description |
---|---|
static void |
FrontierJournal.importRecoverLog(org.json.JSONObject params,
Frontier frontier)
Utility method for scanning a recovery journal and applying it to
a Frontier.
|
Modifier and Type | Field and Description |
---|---|
protected Frontier |
CandidatesProcessor.frontier
The frontier to use.
|
Modifier and Type | Method and Description |
---|---|
Frontier |
CandidatesProcessor.getFrontier() |
Modifier and Type | Method and Description |
---|---|
void |
CandidatesProcessor.setFrontier(Frontier frontier) |
Modifier and Type | Field and Description |
---|---|
protected Frontier |
QuotaEnforcer.frontier |
Modifier and Type | Method and Description |
---|---|
Frontier |
QuotaEnforcer.getFrontier() |
Modifier and Type | Method and Description |
---|---|
void |
QuotaEnforcer.setFrontier(Frontier frontier) |
Modifier and Type | Field and Description |
---|---|
protected Frontier |
LexicalCrawlMapper.frontier |
protected Frontier |
HashCrawlMapper.frontier |
Modifier and Type | Method and Description |
---|---|
Frontier |
LexicalCrawlMapper.getFrontier() |
Frontier |
HashCrawlMapper.getFrontier() |
Modifier and Type | Method and Description |
---|---|
void |
LexicalCrawlMapper.setFrontier(Frontier frontier) |
void |
HashCrawlMapper.setFrontier(Frontier frontier) |
Copyright © 2003-2014 Internet Archive. All Rights Reserved.