1
0
mirror of https://github.com/crawler-commons/crawler-commons synced 2024-09-20 08:42:15 +02:00

[BasicNormalizer] Trailing question mark in url query test should be added,

fixes #247
This commit is contained in:
Sebastian Nagel 2019-10-17 11:58:36 +02:00
parent e38bb95b4c
commit 2979aaf4aa
2 changed files with 5 additions and 1 deletions

View File

@ -1,6 +1,7 @@
Crawler-Commons Change Log
Current Development 1.1-SNAPSHOT (yyyy-mm-dd)
- [BasicNormalizer] Trailing question mark in url query test should be added (Chaiavi, sebastian-nagel) #247
- EffectiveTldFinder to validate returned domain names for length restrictions (sebastian-nagel, Chaiavi) #251
- Upgrade unit tests to use JUnit v5.x and parameterized tests (Chaiavi) #249, #253, #255
- [Robots] Robots parser to always handle absolute sitemap URL even without valid base URL (pr3mar, kkrugler, sebastian-nagel) #240

View File

@ -126,4 +126,7 @@ file:///foo/bar.txt, file:///foo/bar.txt
ftp:/, ftp:/
http:, http:/
http:////, http:/
http:///////, http:/
http:///////, http:/
# empty path with trailing question mark (empty query) #247
http://example.com?,http://example.com/?

1 # Weird URL, Normalized URL
126
127
128
129
130
131
132