1
0
mirror of https://github.com/crawler-commons/crawler-commons synced 2024-09-25 01:50:39 +02:00
crawler-commons/src
Sebastian Nagel 95c6e3886a EffectiveTldFinder to parse Internationalized Domain Names (IDN),
fixes #179
- allow eTLDs to appear as IDN variants
  * one or more dot-separated parts as IDN,
  * optionally others as punycoded IDNA
- speed-up lookup of public suffixes / eTLDs using a suffix trie
- update public suffix list to recent version
- add unit tests to test for wildcard eTLDs
2017-12-06 21:47:01 +01:00
..
main EffectiveTldFinder to parse Internationalized Domain Names (IDN), 2017-12-06 21:47:01 +01:00
test EffectiveTldFinder to parse Internationalized Domain Names (IDN), 2017-12-06 21:47:01 +01:00