public class Preselector extends Scoper
fileLogger, isRunning, loggerModule, scope
beanName, kp, recoveryCheckpoint, uriCount
Constructor and Description |
---|
Preselector()
Constructor.
|
Modifier and Type | Method and Description |
---|---|
String |
getAllowByRegex() |
boolean |
getBlockAll() |
String |
getBlockByRegex() |
boolean |
getRecheckScope() |
protected void |
innerProcess(CrawlURI puri)
Actually performs the process.
|
protected ProcessResult |
innerProcessResult(CrawlURI puri) |
void |
setAllowByRegex(String regex) |
void |
setBlockAll(boolean recheck) |
void |
setBlockByRegex(String regex) |
void |
setRecheckScope(boolean recheck) |
protected boolean |
shouldProcess(CrawlURI puri)
Determines whether the given uri should be processed by this
processor.
|
getLoggerModule, getLogToFile, getScope, isInScope, isRunning, outOfScope, setLoggerModule, setLogToFile, setScope, start, stop
doCheckpoint, finishCheckpoint, flattenVia, fromCheckpointJson, getBeanName, getEnabled, getKeyedProperties, getRecordedSize, getShouldProcessRule, getURICount, hasHttpAuthenticationCredential, innerRejectProcess, isSuccess, process, report, setBeanName, setEnabled, setRecoveryCheckpoint, setShouldProcessRule, startCheckpoint, toCheckpointJson
public boolean getRecheckScope()
public void setRecheckScope(boolean recheck)
public boolean getBlockAll()
public void setBlockAll(boolean recheck)
public String getBlockByRegex()
public void setBlockByRegex(String regex)
public String getAllowByRegex()
public void setAllowByRegex(String regex)
protected boolean shouldProcess(CrawlURI puri)
Processor
shouldProcess
in class Processor
puri
- the URI to testprotected void innerProcess(CrawlURI puri)
Processor
#ENABLED
, the
#DECIDE_RULES
and the #shouldProcess(ProcessorURI)
tests.innerProcess
in class Processor
puri
- the URI to processprotected ProcessResult innerProcessResult(CrawlURI puri)
innerProcessResult
in class Processor
Copyright © 2003-2014 Internet Archive. All Rights Reserved.