FetchStats (Heritrix 3 3.2.0 API)

java.lang.Object
- org.archive.modules.fetcher.FetchStats

All Implemented Interfaces:

Serializable, FetchStatusCodes, org.archive.util.Reporter
```
public class FetchStats
extends Object
implements Serializable, FetchStatusCodes, org.archive.util.Reporter
```
Collector of statistics for a 'subset' of a crawl, such as a server (host:port), host, or frontier group (eg queue).

Author:

gojomo

See Also:
Serialized Form

Nested Class Summary

Nested Classes
Modifier and Type Class and Description

static interface FetchStats.CollectsFetchStats

static interface FetchStats.HasFetchStats

static class FetchStats.Stage

Nested Classes
Modifier and Type	Class and Description
`static interface`	`FetchStats.CollectsFetchStats`
`static interface`	`FetchStats.HasFetchStats`
`static class`	`FetchStats.Stage`

Field Summary

Fields
Modifier and Type	Field and Description
`protected long`	`dupByHashBytes`
`protected long`	`dupByHashUrls`
`protected long`	`fetchDisregards`
`protected long`	`fetchFailures`
`protected long`	`fetchNonResponses`
`protected long`	`fetchResponses`
`protected long`	`fetchSuccesses`
`protected long`	`lastSuccessTime`
`protected long`	`notModifiedBytes`
`protected long`	`notModifiedUrls`
`protected long`	`novelBytes`
`protected long`	`novelUrls`
`protected long`	`robotsDenials`
`protected long`	`successBytes`
`protected long`	`totalBytes`
`protected long`	`totalScheduled`

Constructor Summary

Constructors
Constructor and Description

FetchStats()

Constructors
Constructor and Description
`FetchStats()`

Method Summary

Methods
Modifier and Type	Method and Description
`long`	`getDupByHashBytes()`
`long`	`getDupByHashUrls()`
`long`	`getFetchDisregards()`
`long`	`getFetchNonResponses()`
`long`	`getFetchResponses()`
`long`	`getFetchSuccesses()`
`long`	`getLastSuccessTime()`
`long`	`getNotModifiedBytes()`
`long`	`getNotModifiedUrls()`
`long`	`getNovelBytes()`
`long`	`getNovelUrls()`
`long`	`getRecordedFinishes()`
`long`	`getRemaining()`
`long`	`getRobotsDenials()`
`long`	`getSuccessBytes()`
`long`	`getTotalBytes()`
`long`	`getTotalScheduled()`
`void`	`reportTo(PrintWriter writer)`
`String`	`shortReportLegend()`
`String`	`shortReportLine()`
`void`	`shortReportLineTo(PrintWriter writer)`
`Map<String,Object>`	`shortReportMap()`
`void`	`tally(CrawlURI curi, FetchStats.Stage stage)`

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

totalScheduled
```
protected long totalScheduled
```

fetchSuccesses
```
protected long fetchSuccesses
```

fetchFailures
```
protected long fetchFailures
```

fetchDisregards
```
protected long fetchDisregards
```

fetchResponses
```
protected long fetchResponses
```

robotsDenials
```
protected long robotsDenials
```

successBytes
```
protected long successBytes
```

totalBytes
```
protected long totalBytes
```

fetchNonResponses
```
protected long fetchNonResponses
```

novelBytes
```
protected long novelBytes
```

novelUrls
```
protected long novelUrls
```

notModifiedBytes
```
protected long notModifiedBytes
```

notModifiedUrls
```
protected long notModifiedUrls
```

dupByHashBytes
```
protected long dupByHashBytes
```

dupByHashUrls
```
protected long dupByHashUrls
```

lastSuccessTime
```
protected long lastSuccessTime
```

Constructor Detail
- FetchStats
```
public FetchStats()
```

Method Detail

tally

public void tally(CrawlURI curi,
         FetchStats.Stage stage)

getFetchSuccesses
```
public long getFetchSuccesses()
```

getFetchResponses
```
public long getFetchResponses()
```

getSuccessBytes
```
public long getSuccessBytes()
```

getTotalBytes
```
public long getTotalBytes()
```

getFetchNonResponses
```
public long getFetchNonResponses()
```

getTotalScheduled
```
public long getTotalScheduled()
```

getFetchDisregards
```
public long getFetchDisregards()
```

getRobotsDenials
```
public long getRobotsDenials()
```

getRemaining
```
public long getRemaining()
```

getRecordedFinishes
```
public long getRecordedFinishes()
```

getNovelBytes
```
public long getNovelBytes()
```

getNovelUrls
```
public long getNovelUrls()
```

getNotModifiedBytes
```
public long getNotModifiedBytes()
```

getNotModifiedUrls
```
public long getNotModifiedUrls()
```

getDupByHashBytes
```
public long getDupByHashBytes()
```

getDupByHashUrls
```
public long getDupByHashUrls()
```

reportTo
```
public void reportTo(PrintWriter writer)
```
Specified by:

reportTo in interface org.archive.util.Reporter

shortReportLegend
```
public String shortReportLegend()
```
Specified by:

shortReportLegend in interface org.archive.util.Reporter

shortReportLine
```
public String shortReportLine()
```

shortReportLineTo
```
public void shortReportLineTo(PrintWriter writer)
```
Specified by:

shortReportLineTo in interface org.archive.util.Reporter

shortReportMap
```
public Map<String,Object> shortReportMap()
```
Specified by:

shortReportMap in interface org.archive.util.Reporter

getLastSuccessTime
```
public long getLastSuccessTime()
```

Class FetchStats

Nested Class Summary

Field Summary

Fields inherited from interface org.archive.modules.fetcher.FetchStatusCodes

Constructor Summary

Method Summary

Methods inherited from class java.lang.Object

Field Detail

totalScheduled

fetchSuccesses

fetchFailures

fetchDisregards

fetchResponses

robotsDenials

successBytes

totalBytes

fetchNonResponses

novelBytes

novelUrls

notModifiedBytes

notModifiedUrls

dupByHashBytes

dupByHashUrls

lastSuccessTime

Constructor Detail

FetchStats

Method Detail

tally

getFetchSuccesses

getFetchResponses

getSuccessBytes

getTotalBytes

getFetchNonResponses

getTotalScheduled

getFetchDisregards

getRobotsDenials

getRemaining

getRecordedFinishes

getNovelBytes

getNovelUrls

getNotModifiedBytes

getNotModifiedUrls

getDupByHashBytes

getDupByHashUrls

reportTo

shortReportLegend

shortReportLine

shortReportLineTo

shortReportMap

getLastSuccessTime