org.archive.modules.seeds

Class SeedModule

java.lang.Object

org.archive.modules.seeds.SeedModule

All Implemented Interfaces:

Serializable

Direct Known Subclasses:

TextSeedModule

public abstract class SeedModule
extends Object
implements Serializable

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
protected Set<SeedListener>	seedListeners
protected boolean	sourceTagSeeds Whether to tag seeds with their own URI as a heritable 'source' String, which will be carried-forward to all URIs discovered on paths originating from that seed.

Constructor Summary

Constructors

Constructor and Description
SeedModule()

Method Summary

Methods

Modifier and Type	Method and Description
abstract void	actOn(File f)
abstract void	addSeed(CrawlURI curi)
void	addSeedListener(SeedListener sl)
abstract void	announceSeeds()
Set<SeedListener>	getSeedListeners()
boolean	getSourceTagSeeds()
protected void	publishAddedSeed(CrawlURI curi)
protected void	publishConcludedSeedBatch()
protected void	publishNonSeedLine(String line)
void	setSeedListeners(Set<SeedListener> seedListeners)
void	setSourceTagSeeds(boolean sourceTagSeeds)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

sourceTagSeeds

protected boolean sourceTagSeeds

Whether to tag seeds with their own URI as a heritable 'source' String, which will be carried-forward to all URIs discovered on paths originating from that seed. When present, such source tags appear in the second-to-last crawl.log field.

seedListeners

protected Set<SeedListener> seedListeners

Constructor Detail

SeedModule

public SeedModule()

Method Detail

getSourceTagSeeds

public boolean getSourceTagSeeds()

setSourceTagSeeds

public void setSourceTagSeeds(boolean sourceTagSeeds)

getSeedListeners

public Set<SeedListener> getSeedListeners()

setSeedListeners

public void setSeedListeners(Set<SeedListener> seedListeners)

publishAddedSeed

protected void publishAddedSeed(CrawlURI curi)

publishNonSeedLine

protected void publishNonSeedLine(String line)

publishConcludedSeedBatch

protected void publishConcludedSeedBatch()

announceSeeds

public abstract void announceSeeds()

actOn

public abstract void actOn(File f)

addSeed

public abstract void addSeed(CrawlURI curi)

addSeedListener

public void addSeedListener(SeedListener sl)