public class MemFPMergeUriUniqFilter extends FPMergeUriUniqFilter
FPMergeUriUniqFilter.PendingItem
UriUniqFilter.CrawlUriReceiver
Modifier and Type | Field and Description |
---|---|
protected it.unimi.dsi.fastutil.longs.LongArrayList |
allFps |
protected it.unimi.dsi.fastutil.longs.LongArrayList |
newFps |
DEFAULT_MAX_PENDING, FLUSH_DELAY_FACTOR, maxPending, mergeDupAtLast, mergeDuplicateCount, nextFlushAllowableAfter, pendDupAtLast, pendDuplicateCount, pendingSet, profileLog, quickCache, quickDupAtLast, quickDuplicateCount, receiver
Constructor and Description |
---|
MemFPMergeUriUniqFilter() |
Modifier and Type | Method and Description |
---|---|
protected void |
addNewFp(long currFp)
Add an FP (which may be an old or new FP) to the new complete
list.
|
protected it.unimi.dsi.fastutil.longs.LongIterator |
beginFpMerge()
Begin merging pending candidates with complete list.
|
long |
count() |
protected void |
finishFpMerge()
Complete the merge of candidate and previously-known FPs (closing
files/iterators as appropriate).
|
add, addForce, addNow, close, createFp, flush, forget, note, pend, pending, profileLog, requestFlush, setDestination, setMaxPending, setProfileLog
protected it.unimi.dsi.fastutil.longs.LongArrayList allFps
protected it.unimi.dsi.fastutil.longs.LongArrayList newFps
protected it.unimi.dsi.fastutil.longs.LongIterator beginFpMerge()
FPMergeUriUniqFilter
beginFpMerge
in class FPMergeUriUniqFilter
protected void addNewFp(long currFp)
FPMergeUriUniqFilter
addNewFp
in class FPMergeUriUniqFilter
currFp
- the FP to addprotected void finishFpMerge()
FPMergeUriUniqFilter
finishFpMerge
in class FPMergeUriUniqFilter
public long count()
Copyright © 2003-2014 Internet Archive. All Rights Reserved.