public class PersistLoadProcessor extends PersistOnlineProcessor
Modifier and Type | Field and Description |
---|---|
protected ConfigPath |
preloadSource
A source (either log file or BDB directory) from which to copy history
information into the current store at startup.
|
protected String |
preloadSourceUrl
A log file source url from which to copy history information into the
current store at startup.
|
bdb, historyDb, historyDbName, store
HISTORY_DB_CONFIG, URI_HISTORY_DBNAME
onlyStoreIfWriteTagPresent
Constructor and Description |
---|
PersistLoadProcessor() |
Modifier and Type | Method and Description |
---|---|
ConfigPath |
getPreloadSource() |
String |
getPreloadSourceUrl() |
protected void |
innerProcess(CrawlURI curi)
Actually performs the process.
|
void |
setPreloadSource(ConfigPath preloadSource) |
void |
setPreloadSourceUrl(String preloadSourceUrl) |
protected boolean |
shouldProcess(CrawlURI uri)
Determines whether the given uri should be processed by this
processor.
|
void |
start() |
getHistoryDbName, isRunning, setBdbModule, setHistoryDbName, stop
copyPersistSourceToHistoryMap, copyPersistSourceToHistoryMap, main, persistKeyFor, persistKeyFor, populatePersistEnv, setupCopyEnvironment, setupCopyEnvironment
getOnlyStoreIfWriteTagPresent, hasWriteTag, setOnlyStoreIfWriteTagPresent, shouldLoad, shouldStore
doCheckpoint, finishCheckpoint, flattenVia, fromCheckpointJson, getBeanName, getEnabled, getKeyedProperties, getRecordedSize, getShouldProcessRule, getURICount, hasHttpAuthenticationCredential, innerProcessResult, innerRejectProcess, isSuccess, process, report, setBeanName, setEnabled, setRecoveryCheckpoint, setShouldProcessRule, startCheckpoint, toCheckpointJson
protected ConfigPath preloadSource
protected String preloadSourceUrl
public ConfigPath getPreloadSource()
public void setPreloadSource(ConfigPath preloadSource)
public String getPreloadSourceUrl()
public void setPreloadSourceUrl(String preloadSourceUrl)
protected void innerProcess(CrawlURI curi) throws InterruptedException
Processor
#ENABLED
, the
#DECIDE_RULES
and the #shouldProcess(ProcessorURI)
tests.innerProcess
in class Processor
curi
- the URI to processInterruptedException
- if the thread is interruptedprotected boolean shouldProcess(CrawlURI uri)
Processor
shouldProcess
in class Processor
uri
- the URI to testpublic void start()
start
in interface org.springframework.context.Lifecycle
start
in class PersistOnlineProcessor
Copyright © 2003-2014 Internet Archive. All Rights Reserved.