mirror/ crawler-commons
1
0
Fork 0
mirror of https://github.com/crawler-commons/crawler-commons synced 2024-05-03 22:26:15 +02:00
Code Issues

Release 1.4 

- update news section
- add 1.4 Javadocs to README
This commit is contained in:
Sebastian Nagel 2023-07-18 13:44:15 +02:00
parent 0e1758fcee
commit a3ff95502f
1 changed files with 14 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

16
README.md
View File

@ -16,6 +16,7 @@ These components benefit from collaboration among various existing web crawler p
# User Documentation
## Javadocs
* [1.4](https://crawler-commons.github.io/crawler-commons/1.4/)
* [1.3](https://crawler-commons.github.io/crawler-commons/1.3/)
* [1.2](https://crawler-commons.github.io/crawler-commons/1.2/)
* [1.1](https://crawler-commons.github.io/crawler-commons/1.1/)
@ -37,19 +38,30 @@ Using Maven, add the following dependency to your pom.xml:
<dependency>
<groupId>com.github.crawler-commons</groupId>
<artifactId>crawler-commons</artifactId>
<version>1.3</version>
<version>1.4</version>
</dependency>
~~~
Using Gradle, add the folling to your build file:
```groovy
dependencies {
implementation group: 'com.github.crawler-commons', name: 'crawler-commons', version: '1.3'
implementation group: 'com.github.crawler-commons', name: 'crawler-commons', version: '1.4'
}
```
# News
## 18th July 2022 - crawler-commons 1.4 released
We are pleased to announce the 1.4 release of Crawler-Commons.
The new release includes many improvements and bug fixes, several dependency upgrades and improvements to the automatic build system. The following are the most notable improvements and changes:
- Java 11 is now required to run or build crawler-commons
- the robots.txt parser (SimpleRobotRulesParser) is now compliant with [RFC 9309](https://www.rfc-editor.org/rfc/rfc9309.html) and provides a new [API entry point](https://crawler-commons.github.io/crawler-commons/1.4/crawlercommons/robots/SimpleRobotRulesParser.html#parseContent(java.lang.String,byte%5B%5D,java.lang.String,java.util.Collection)) accepting a collection of single-word user-agent product tokens which allows for faster and RFC-compliant matching of robots.txt user-agent lines.
See the [CHANGES.txt](https://github.com/crawler-commons/crawler-commons/blob/crawler-commons-1.4/CHANGES.txt) file included with the release for the detailed list of changes.
## 28th July 2022 - crawler-commons 1.3 released
We are glad to announce the 1.3 release of Crawler-Commons. See the [CHANGES.txt](https://github.com/crawler-commons/crawler-commons/blob/crawler-commons-1.3/CHANGES.txt) file included with the release for a complete list of details.