public class PersistStoreProcessor extends PersistOnlineProcessor
bdb, historyDb, historyDbName, store
HISTORY_DB_CONFIG, URI_HISTORY_DBNAME
onlyStoreIfWriteTagPresent
Constructor and Description |
---|
PersistStoreProcessor() |
Modifier and Type | Method and Description |
---|---|
protected void |
innerProcess(CrawlURI curi)
Actually performs the process.
|
protected boolean |
shouldProcess(CrawlURI uri)
Determines whether the given uri should be processed by this
processor.
|
getHistoryDbName, isRunning, setBdbModule, setHistoryDbName, start, stop
copyPersistSourceToHistoryMap, copyPersistSourceToHistoryMap, main, persistKeyFor, persistKeyFor, populatePersistEnv, setupCopyEnvironment, setupCopyEnvironment
getOnlyStoreIfWriteTagPresent, hasWriteTag, setOnlyStoreIfWriteTagPresent, shouldLoad, shouldStore
doCheckpoint, finishCheckpoint, flattenVia, fromCheckpointJson, getBeanName, getEnabled, getKeyedProperties, getRecordedSize, getShouldProcessRule, getURICount, hasHttpAuthenticationCredential, innerProcessResult, innerRejectProcess, isSuccess, process, report, setBeanName, setEnabled, setRecoveryCheckpoint, setShouldProcessRule, startCheckpoint, toCheckpointJson
protected void innerProcess(CrawlURI curi) throws InterruptedException
Processor
#ENABLED
, the
#DECIDE_RULES
and the #shouldProcess(ProcessorURI)
tests.innerProcess
in class Processor
curi
- the URI to processInterruptedException
- if the thread is interruptedprotected boolean shouldProcess(CrawlURI uri)
Processor
shouldProcess
in class Processor
uri
- the URI to testCopyright © 2003-2014 Internet Archive. All Rights Reserved.