Package | Description |
---|---|
crawlercommons.fetcher |
The main fetching package within Crawler Commons, this package defines base fetching
and encoding classes, Enum's to determine reasoning behind typical fetching behaviour
as well as the base Exceptions which may be used.
|
crawlercommons.fetcher.file |
SimpleFileFetcher code which extends the BaseFetcher . |
crawlercommons.fetcher.http |
This package concerns the fetching of files over the HTTP protocol:
Extending from
BaseHttpFetcher (which itself extends BaseFetcher ) the
SimpleHttpFetcher provides the Crawler Commons HTTP fetching implementation. |
Class and Description |
---|
AbortedFetchReason |
BaseFetchException |
EncodingUtils.ExpandedResult |
FetchedResult |
Payload |
RedirectFetchException.RedirectExceptionReason |
Class and Description |
---|
BaseFetcher |
BaseFetchException |
FetchedResult |
Payload |
Class and Description |
---|
BaseFetcher |
BaseFetchException |
FetchedResult |
Payload |
Copyright © 2015. All rights reserved.