Package | Description |
---|---|
org.archive.modules |
The beginnings of a refactored settings framework.
|
org.archive.modules.extractor |
Modifier and Type | Method and Description |
---|---|
LinkContext |
CrawlURI.getViaContext() |
Modifier and Type | Method and Description |
---|---|
CrawlURI |
CrawlURI.makeConsequentCandidate(String destination,
LinkContext lc,
Hop hop)
Create a consequent CrawlURI from this one, given the
additional parameters
|
Constructor and Description |
---|
CrawlURI(UURI u,
String pathFromSeed,
UURI via,
LinkContext viaContext) |
Modifier and Type | Class and Description |
---|---|
class |
HTMLLinkContext
XPath-like context for HTML discovered URIs.
|
static class |
LinkContext.SimpleLinkContext
Class for representing handy default LinkContext values.
|
Modifier and Type | Field and Description |
---|---|
static LinkContext |
LinkContext.EMBED_MISC
Stand-in value for embeds without other context.
|
static LinkContext |
LinkContext.INFERRED_MISC
Stand-in value for inferred urls without other context.
|
static LinkContext |
LinkContext.JS_MISC
Stand-in value for JavaScript-discovered urls without other context.
|
static LinkContext |
LinkContext.NAVLINK_MISC
Stand-in value for navlink urls without other context.
|
static LinkContext |
LinkContext.PREREQ_MISC
Stand-in value for prerequisite urls without other context.
|
static LinkContext |
LinkContext.SPECULATIVE_MISC
Stand-in value for speculative/aggressively extracted urls without
other context.
|
Modifier and Type | Method and Description |
---|---|
LinkContext |
Link.getContext() |
Modifier and Type | Method and Description |
---|---|
static void |
Link.add(CrawlURI uri,
int max,
String newUri,
LinkContext context,
Hop hop) |
protected void |
Extractor.addOutlink(CrawlURI curi,
String uri,
LinkContext context,
Hop hop)
Create and add a 'Link' to the CrawlURI with given URI/context/hop-type
|
static void |
Link.addRelativeToBase(CrawlURI uri,
int max,
String newUri,
LinkContext context,
Hop hop) |
static void |
Link.addRelativeToVia(CrawlURI uri,
int max,
String newUri,
LinkContext context,
Hop hop) |
Constructor and Description |
---|
Link(CharSequence source,
CharSequence destination,
LinkContext context,
Hop hop)
Create a Link with the given fields.
|
Copyright © 2003-2014 Internet Archive. All Rights Reserved.