Package | Description |
---|---|
org.archive.crawler.util |
Modifier and Type | Class and Description |
---|---|
class |
BdbUriUniqFilter
A BDB implementation of an AlreadySeen list.
|
class |
BloomUriUniqFilter
An implementation of an AlreadySeen list based on the MG4J BloomFilter.
|
class |
FPUriUniqFilter
UriUniqFilter storing 64-bit UURI fingerprints, using an internal LongFPSet
instance.
|
class |
MemUriUniqFilter
A purely in-memory UriUniqFilter based on a HashSet, which remembers
every full URI string it sees.
|
class |
NoopUriUniqFilter
A UriUniqFilter that doesn't actually provide any uniqueness
filter on presented items: all are passed through.
|
Copyright © 2003-2014 Internet Archive. All Rights Reserved.