Skip to content
This repository has been archived by the owner on Nov 23, 2024. It is now read-only.

Latest commit

 

History

History
39 lines (29 loc) · 1003 Bytes

README.md

File metadata and controls

39 lines (29 loc) · 1003 Bytes

Dofus Scraper

Cloudscraper based encyclopedia scraping to JSON and API creation client with Python.

Usage

Install dependencies (Python 3) pip install -r requirements.txt

The script should be used like a CLI. See the usage with python3 scraper.py --help.

Example

Scraping all data to JSON.

$ python3 scraper.py --scrape --check

Scraping all not found to JSON. If still be not found, try again later.

$ python3 scraper.py --notfound --check

Call API to create english items via JSON data on the API.

$ python3 scraper.py --api --create

Only update languages data to the API.

$ python3 scraper.py --api --lang

Notice

This script was build for populating the Dofus API. The needed steps might not suit your use case. Furthermore, the script is not perfect - a few categories could need multiple tries to get the JSON or API calls right.

License

Author: Christopher Sieh [email protected]

This project is licensed under the GPLv3 License.