Wikidata-Toolkit 0.12.0

The twelfth release of the Wikidata Toolkit. Addition of OAuth authentication to the Wikibase API client and a lot of code cleanup.

Artefacts are released on Maven Central and it is strongly recommended to use them.

More detailed release notes are available in the RELEASE-NOTES file.

Wikidata-Toolkit 0.11.1

Patch release.

Fixes a authorization bug with Wikidata API due to cookie issues and updates dependencies.

Wikidata-Toolkit 0.11.0

The eleventh release of the Wikidata Toolkit. It adds support for Wikimedia Commons MediaInfo entities, MediaWiki edit tags and a lot of improvements on the RDF converter. WikidataToolkit Client has been removed.

Artefacts are released on Maven Central and it is strongly recommended to use them.

More detailed release notes are available in the RELEASE-NOTES file.

Wikidata-Toolkit 0.10.0

The tenth release of the Wikidata Toolkit. It mostly updates dependencies and contains some small bug fixes.

Artifacts are released on Maven Central and it is strongly recommended to use them.

More detailed release note are available in the RELEASE-NOTES file.

Wikidata-Toolkit 0.9.0

The ninth release of the Wikidata Toolkit. It adds compatibility with JDK 10 and Android, basic support of Wikibase Lexeme, and a lot of new features related to editing. It drops also support for JDK 7. The RDF converter now uses the same format as the Wikibase RDF dumps and query.wikidata.org.

Artifacts are released on Maven Central and it is strongly recommended to use them.

More detailed release note are available in the RELEASE-NOTES file.

Wikidata-Toolkit 0.8.0

The eight release of the Wikidata Toolkit mainly adds support for JDK 9 and several fixes that are needed to keep Wikidata Toolkit working with the changes done on Wikidata.

It also provides two features related to the Wikibase API: it is now possible to edit labels, descriptions and aliases using the WikibaseDataEditor (this is a work in progress that is likely to change) and there is now a wrapper for the wbEntitySearch API action.

We have made a short survey to help us doing some technical choices for the future versions of the Wikidata Toolkit. It should take less than a minute to fill: https://docs.google.com/forms/d/e/1FAIpQLSdN25X2sTv2wQe-y56d0hC4QmU06s6crr1GoGqx3qVNv3Fz5A/viewform

Bug fixes:

Quantities bounds are now optional following the change in Wikibase
Add the "id" field to entity id JSON serialization following the change in Wikibase
Do not fail when logging in
Do not fail when reading redirections in daily XML dumps
Do not fail when new datatypes are introduced in Wikibase
Make sure that API warnings are read for all requests
Do not fail when reading a bz2 compressed dump when a gzip dump was expected
WikibaseDataFetcher is now able to retrieve more than 50 entities at once
Switch to the new way of retrieving MediaWiki API tokens

Artifacts are also released on Maven Central and it is strongly recommend to use them. To do this, insert the following dependency into your pom.xml:

org.wikidata.wdtk wdtk-dumpfiles 0.8.0

Similar configurations can be used for other modules (e.g., wdtk-rdf or wdtk-datamodel), but most dependencies will be resolved for you by Maven. An example Java project using this library are the Wikidata Toolkit Examples. Further instructions are given in the Wikidata Toolkit user documentation.

Alternatively, you can also use the JAR packages attached to this release.

Wikidata Toolkit 0.7.0

The seventh release of the Wikidata Toolkit mainly adds several fixes that are needed to use Wikidata Toolkit in the face of changes in the file formats and Web addresses used by Wikidata/Wikibase.

As a new feature, it includes the command-line client action "sqid" that computes the JSON statistics files that are the basis for the SQID Wikidata Browser. See the SQID project repository for usage instructions. Note that, as long as the online instance of SQID is maintained, you can also just download the latest JSON files from there.

Bug fixes:

• Make JSON parser more tolerant towards unknown keys; avoids breaking on recent API changes
• Update Wikimedia dump location to https so that dump downloads work again
• Fix JavaDoc errors to enable build using Java 8 (with doclint)

Artifacts are also released on Maven Central and it is strongly recommend to use them. To do this, insert the following dependency into your pom.xml:

<dependency>
    <groupId>org.wikidata.wdtk</groupId>
    <artifactId>wdtk-dumpfiles</artifactId>
    <version>0.7.0</version>
</dependency>

Similar configurations can be used for other modules (e.g., wdtk-rdf or wdtk-datamodel), but most dependencies will be resolved for you by Maven. An example Java project using this library are the Wikidata Toolkit Examples. Further instructions are given in the Wikidata Toolkit user documentation.

Alternatively, you can also use the JAR packages attached to this release.

Wikidata Toolkit 0.6.0

The sixth release of the Wikidata Toolkit introduces support for two new Wikidata property types (external ids and math), adds several functions for creating bots, introduces additional helper methods to simplify your code, and fixes a prior incompatibility with the Web API. Main changes to the library are:

New features:

• Support for new Wikidata property type "external identifier"
• Support for new Wikidata property type "math"
• Bots: support maxlag parameter and edit-rate throttling
• Bots: better Wikidata API error handling
• Bots: several real-world bot examples
• New convenience methods for accessing Wikidata Java objects, for simpler code
• full compatibility with Java 8

Bug fixes:

• Fix NullPointerException when trying to establish API connection (issue #217)
• Avoid test failures on some platforms (based on too strict assumptions)

Artifacts are also released on Maven Central and it is strongly recommend to use them. To do this, insert the following dependency into your pom.xml:

<dependency>
    <groupId>org.wikidata.wdtk</groupId>
    <artifactId>wdtk-dumpfiles</artifactId>
    <version>0.6.0</version>
</dependency>

Similar configurations can be used for other modules (e.g., wdtk-rdf or wdtk-datamodel), but most dependencies will be resolved for you by Maven. An example Java project using this library are the Wikidata Toolkit Examples. Further instructions are given in the Wikidata Toolkit user documentation.

Alternatively, you can also use the JAR packages attached to this release.

Wikidata Toolkit 0.5.0

The fifth release of the Wikidata Toolkit introduces support for data reading and writing via the Web API of Wikidata (or any Wikibase site) new Wikidata features, introduces support for units of measurement (also new in Wikibase), adds more helpers to simplify your code, and fixes some compatibility issues. Main changes to the library are:

• Support for reading and writing live entity data from wikidata.org or any other Wikibase site (issue #162)
• New examples for illustrating read/write API support
• Support for quantities with units of measurement (new feature in Wikibase; still beta)
• New builder classes to simplify construction of EntityDocuments, Statements, and References
• Support processing of local dump files by file name in code and command-line client (issue #136)
• New example WorldMapProcessor that shows the generation of maps from geographic data
• Improved output file naming for examples, taking dump date into account
• RDF export uses property register for fewer Web requests during export
• RDF export supports Wikidata's P1921 URI patterns to create links to external RDF datasets

Minor compatibility changes:

• EntityDocumentProcessorFilter has a modified constructor that requires a filter object to be given. The direct set methods to define the filter are no longer available.

Artifacts are also released on Maven Central and it is strongly recommend to use this. To do this, insert the following dependency into your pom.xml:

<dependency>
    <groupId>org.wikidata.wdtk</groupId>
    <artifactId>wdtk-dumpfiles</artifactId>
    <version>0.5.0</version>
</dependency>

Similar configurations can be used for other modules (e.g., wdtk-rdf or wdtk-datamodel), but most dependencies will be resolved for you by Maven. Detailed instructions are given in the Wikidata Toolkit user documentation.

Wikidata Toolkit 0.4.0

The fourth release of the Wikidata Toolkit introduces support for a variety of new Wikidata features, restores compatibility with current Wikidata file exports, and adds a stand-alone command-line client that can be used to process data. Main changes to the library are:

• Support statements on property documents
• More robust JSON parsing: recover after errors to process remaining file
• Improved JSON serialization + an example program showing how to do it
• Standard (POJO) datamodel implementation now is Serializable
• Deep copy functionality for changing between datamodel implementations (DatamodelConverter)
• Support for filtering data during copying (e.g., to keep only some languages/properties/sites).
• Dependency on JSON.org has been removed to use the faster Jackson library everywhere

Important compatibility changes:

• The datatype of all values in GlobeCoordinateValue (latitude, longitude, precision) has changed from long (fixed precision number) to double (floating point number) to match the JSON.
• The JSON serializer class org.wikidata.wdtk.datamodel.json.JsonSerializer has vanished. It is replaced by the org.wikidata.wdtk.datamodel.json.jackson.JsonSerializer (almost same interface).

Artifacts are also released on Maven Central and it is strongly recommend to use this. To do this, insert the following dependency into your pom.xml:

<dependency>
    <groupId>org.wikidata.wdtk</groupId>
    <artifactId>wdtk-dumpfiles</artifactId>
    <version>0.4.0</version>
</dependency>

Similar configurations can be used for other modules (e.g., wdtk-rdf or wdtk-datamodel), but most dependencies will be resolved for you by Maven. Detailed instructions are given in the Wikidata Toolkit user documentation.