1
0
mirror of https://github.com/crawler-commons/crawler-commons synced 2024-09-23 17:33:23 +02:00
crawler-commons/src
Ken Krugler b5704684ff Clarify which method is preferred
Generally better to call parseSiteMap w/o passing an explicit
contentType, as web servers lie all the time - so let Tika figure it
out.
2015-12-30 22:14:21 -08:00
..
main Clarify which method is preferred 2015-12-30 22:14:21 -08:00
test Fix sitemap extraction from robots.txt 2015-12-30 22:03:49 -08:00