mirror of
https://github.com/crawler-commons/crawler-commons
synced 2024-05-03 22:26:15 +02:00
Update CHANGES.txt for release of crawler-commons 1.4
This commit is contained in:
parent
2b8717d9e5
commit
ce9cf46020
|
@ -1,6 +1,6 @@
|
|||
Crawler-Commons Change Log
|
||||
|
||||
Current Development 1.4-SNAPSHOT (yyyy-mm-dd)
|
||||
Release 1.4 (2023-07-13)
|
||||
- [Robots.txt] Implement Robots Exclusion Protocol (REP) IETF Draft: port unit tests (sebastian-nagel, Richard Zowalla) #245, #360
|
||||
- [Robots.txt] Close groups of rules as defined in RFC 9309 (kkrugler, garyillyes, jnioche, sebastian-nagel) #114, #390, #430
|
||||
- [Robots.txt] Empty disallow statement not to clear other rules (sebastian-nagel, jnioche) #422, #424
|
||||
|
|
Loading…
Reference in New Issue