Uses of Class
org.archive.modules.net.RobotsDirectives

Packages that use RobotsDirectives

Package	Description
org.archive.modules.net

Uses of RobotsDirectives in org.archive.modules.net

Fields in org.archive.modules.net declared as RobotsDirectives

Modifier and Type	Field and Description
protected static RobotsDirectives	Robotstxt.NO_DIRECTIVES
protected RobotsDirectives	Robotstxt.wildcardDirectives

Fields in org.archive.modules.net with type parameters of type RobotsDirectives

Modifier and Type	Field and Description
protected Map<String,RobotsDirectives>	Robotstxt.agentsToDirectives

Methods in org.archive.modules.net that return RobotsDirectives

Modifier and Type	Method and Description
RobotsDirectives	Robotstxt.getDirectivesFor(String userAgent) Return directives to use for the given User-Agent, resorting to wildcard rules or the default no-directives if necessary.
RobotsDirectives	Robotstxt.getDirectivesFor(String ua, boolean useFallbacks) Return the RobotsDirectives, if any, appropriate for the given User-Agent string.