Package org.archive.modules.fetcher

Interface Summary

Interface	Description
CookieStorage
FetchStats.CollectsFetchStats
FetchStats.HasFetchStats
FetchStatusCodes	Constant flag codes to be used, in lieu of per-protocol codes (like HTTP's 200, 404, etc.), when network/internal/ out-of-band conditions occur.
HostResolver
UserAgentProvider

Class Summary

Class	Description
AbstractCookieStorage
BdbCookieStorage	CookieStorage using BDB, so that cookies accumulated in large crawls do not outgrow RAM.
DefaultServerCache	Server and Host cache.
FetchDNS	Processor to resolve 'dns:' URIs.
FetchErrors
FetchFTP	Fetches documents and directory listings using FTP.
FetchHTTP	HTTP fetcher that uses Apache Jakarta Commons HttpClient library.
FetchStats	Collector of statistics for a 'subset' of a crawl, such as a server (host:port), host, or frontier group (eg queue).
FetchWhois	WHOIS Fetcher (RFC 3912).
HeritrixHttpMethodRetryHandler	Retry handler that tries ten times to establish connection and then once established, if a GET method, tries ten times to get response (If POST, it tries once only).
HeritrixProtocolSocketFactory	Version of protocol socket factory that tries to get IP from heritrix IP cache -- if its been set into the HttpConnectionParameters.
HeritrixSSLProtocolSocketFactory	Implementation of the commons-httpclient SSLProtocolSocketFactory so we can return SSLSockets whose trust manager is ConfigurableX509TrustManager.
SimpleCookieStorage

Enum Summary

Enum	Description
FetchStats.Stage
FetchWhois.UrlStatus