Package | Description |
---|---|
org.archive.bdb | |
org.archive.crawler.framework | |
org.archive.crawler.frontier | |
org.archive.crawler.reporting | |
org.archive.modules.net | |
org.archive.util |
Modifier and Type | Method and Description |
---|---|
<V extends IdentityCacheable> |
BdbModule.getObjectCache(String dbName,
boolean recycle,
Class<V> valueClass) |
<V extends IdentityCacheable> |
BdbModule.getObjectCache(String dbName,
boolean recycle,
Class<V> declaredClass,
Class<? extends V> valueClass)
Get an ObjectIdentityCache, backed by a BDB Database of the given
name, with objects of the given valueClass type.
|
<V extends IdentityCacheable> |
BdbModule.getOIBCCache(String dbName,
boolean recycle,
Class<? extends V> valueClass)
Get an ObjectIdentityBdbCache, backed by a BDB Database of the
given name, with the given value class type.
|
Modifier and Type | Interface and Description |
---|---|
static interface |
Frontier.FrontierGroup
Generic interface representing the internal groupings
of a Frontier's URIs -- usually queues.
|
Modifier and Type | Class and Description |
---|---|
class |
BdbWorkQueue
One independent queue of items with the same 'classKey' (eg host).
|
class |
WorkQueue
A single queue of related URIs to visit, grouped by a classKey
(typically "hostname:port" or similar)
|
Modifier and Type | Class and Description |
---|---|
class |
SeedRecord
Record of all interesting info about the most-recent
processing of a specific seed.
|
Modifier and Type | Class and Description |
---|---|
class |
CrawlHost
Represents a single remote "host".
|
class |
CrawlServer
Represents a single remote "server".
|
Modifier and Type | Class and Description |
---|---|
class |
ObjectIdentityBdbCache<V extends IdentityCacheable>
A BDB JE backed object cache.
|
class |
ObjectIdentityBdbManualCache<V extends IdentityCacheable>
A BDB JE backed object cache.
|
interface |
ObjectIdentityCache<V extends IdentityCacheable>
An object cache for create-once-by-name-and-then-reuse objects.
|
class |
ObjectIdentityMemCache<V extends IdentityCacheable>
Trivial all-in-memory object cache, using a single internal
ConcurrentHashMap.
|
Modifier and Type | Class and Description |
---|---|
class |
IdentityCacheableWrapper<K>
Wrapper allowing other objects to be held in an ObjectIdentityCache.
|
Copyright © 2003-2014 Internet Archive. All Rights Reserved.