public class FrontierJournal extends CrawlerJournal
Modifier and Type | Field and Description |
---|---|
static String |
F_ADD |
static String |
F_DISREGARD |
static String |
F_EMIT |
static String |
F_FAILURE |
static String |
F_INCLUDE |
static String |
F_REENQUEUED |
static String |
F_SUCCESS |
static String |
LOGNAME_RECOVER |
gzipFile, lines, LOG_ERROR, LOG_TIMESTAMP, out, timestamp_interval
Constructor and Description |
---|
FrontierJournal(String path,
String filename)
Create a new recovery journal at the given location
|
Modifier and Type | Method and Description |
---|---|
void |
added(CrawlURI curi) |
void |
emitted(CrawlURI curi) |
void |
finishedDisregard(CrawlURI curi) |
void |
finishedFailure(CrawlURI curi) |
void |
finishedSuccess(CrawlURI curi) |
static void |
importRecoverLog(org.json.JSONObject params,
Frontier frontier)
Utility method for scanning a recovery journal and applying it to
a Frontier.
|
void |
included(CrawlURI curi) |
void |
reenqueued(CrawlURI curi) |
void |
writeLongUriLine(String tag,
CrawlURI curi) |
close, considerTimestamp, initialize, noteLine, rotateForCheckpoint, seriousError, writeLine, writeLine
public static final String LOGNAME_RECOVER
public static final String F_ADD
public static final String F_EMIT
public static final String F_INCLUDE
public static final String F_DISREGARD
public static final String F_REENQUEUED
public static final String F_SUCCESS
public static final String F_FAILURE
public FrontierJournal(String path, String filename) throws IOException
path
- Directory to make the recovery journal in.filename
- Name to use for recovery journal file.IOException
public void added(CrawlURI curi)
public void finishedSuccess(CrawlURI curi)
public void emitted(CrawlURI curi)
public void included(CrawlURI curi)
public void finishedFailure(CrawlURI curi)
public void finishedDisregard(CrawlURI curi)
public void reenqueued(CrawlURI curi)
public static void importRecoverLog(org.json.JSONObject params, Frontier frontier) throws IOException
params
- JSONObject of import parameters; see Frontier.importURIS()controller
- CrawlController of crawl to updateIOException
Frontier.importURIs(String)
Copyright © 2003-2014 Internet Archive. All Rights Reserved.