Eurovision Scraper is a web scraper designed to collect publicly available data from Wikipedia about the Eurovision Song Contest. It gathers voting results and participant details from all contest years (1956 to the present). This can be useful for analysis, visualizations, or building applications related to the Eurovision Song Contest.
- Python 3.x
- Scrapy (can be installed via
pip install scrapy)
- Clone the repository:
git clone https://github.com/jekrch/eurovision-scraper.git - Navigate to the project directory:
cd eurovision-scraper - Install the required dependencies:
pip install -r requirements.txt
-
Execute the voting data scraper:
scrapy crawl eurovision_vote- voting data is saved to
/eurovision_vote_data.csv
- voting data is saved to
-
Execute the participant data scraper:
scrapy crawl eurovision_participant- participant data is saved to
/eurovision_participant_data.csv
- participant data is saved to
-
Execute the result data scraper:
scrapy crawl eurovision_results- result data is saved to
/eurovision_result_data.csv
- result data is saved to
- Build the Docker image:
docker-compose build - Run the scraper:
docker-compose up- voting data is saved to
/eurovision_vote_data.csv - participant data is saved to
eurovision_participant_data.csv - result data is saved to
eurovision_result_data.csv
- voting data is saved to
Contributions are welcome. If you find any issues or have suggestions for improvements, please open an issue or submit a pull request.
This project is licensed under the MIT License.