public class CrawlStatSnapshot extends Object
Modifier and Type | Field and Description |
---|---|
long |
averageDepth |
int |
busyThreads |
long |
bytesProcessed |
float |
congestionRatio |
double |
currentDocsPerSecond |
long |
currentKiBPerSec |
long |
deepestUri |
long |
discoveredUriCount |
double |
docsPerSecond |
long |
downloadDisregards |
long |
downloadedUriCount |
long |
downloadFailures |
long |
elapsedMilliseconds |
long |
finishedUriCount |
long |
futureUriCount |
long |
queuedUriCount |
long |
timestamp |
long |
totalKiBPerSec |
long |
urisFetched |
Constructor and Description |
---|
CrawlStatSnapshot() |
Modifier and Type | Method and Description |
---|---|
void |
collect(CrawlController controller,
StatisticsTracker stats)
Collect all relevant snapshot samples, from the given CrawlController
and StatisticsTracker (which also provides the previous snapshot
for rate-calculations.
|
String |
getProgressStatisticsLine()
Return one line of current progress-statistics
|
int |
percentOfDiscoveredUrisCompleted()
This returns the number of completed URIs as a percentage of the total
number of URIs encountered (should be inverse to the discovery curve)
|
boolean |
sameProgressAs(CrawlStatSnapshot lastSnapshot)
Return true if this snapshot shows no tangible progress in
its URI counts over the supplied snapshot.
|
long |
totalCount() |
public long timestamp
public long urisFetched
public long bytesProcessed
public long discoveredUriCount
public long queuedUriCount
public long futureUriCount
public long finishedUriCount
public long downloadedUriCount
public long downloadFailures
public long downloadDisregards
public long elapsedMilliseconds
public double docsPerSecond
public double currentDocsPerSecond
public long totalKiBPerSec
public long currentKiBPerSec
public int busyThreads
public float congestionRatio
public long deepestUri
public long averageDepth
public void collect(CrawlController controller, StatisticsTracker stats)
controller
- stats
- public String getProgressStatisticsLine()
now
- public long totalCount()
public int percentOfDiscoveredUrisCompleted()
public boolean sameProgressAs(CrawlStatSnapshot lastSnapshot)
lastSnapshot
- Copyright © 2003-2014 Internet Archive. All Rights Reserved.