crawlercommons.robots
Classes
BaseRobotRules
BaseRobotsParser
SimpleRobotRules
SimpleRobotRules.RobotRule
SimpleRobotRulesParser
Enums
SimpleRobotRules.RobotRulesMode