Skip to content

hatnote/hashtags

Folders and files

NameName
Last commit message
Last commit date
Mar 5, 2016
May 7, 2016
Jul 26, 2015
Jan 26, 2018
Feb 27, 2018
Feb 27, 2018
Jan 29, 2018
Jul 26, 2015
Feb 27, 2018
Mar 5, 2016

Repository files navigation

Wikipedia Hashtags

A set of scripts to cache Wikipedia Hashtag.

This script connects to the Wikipedia database replica on Wikimedia Tool Labs, searches for hashtags, and then stores it in another database with nice indexes for searching. See hashtag search. On Tool Labs, the database is kept up-to-date on 10-20 minute interval scheduled via crontab.

Usage

$ python update.py --lang <two letter language code>

Options:

$ python update.py --help

  -h, --help     show this help message and exit
  --lang LANG
  --hours HOURS
  --debug

TODOs

  • Add support for other Wikimedia projects
  • Add additional lanugages

Notes

Connect to the hashtag database on Tool Labs:

mysql --defaults-file=${HOME}/replica.my.cnf -h s1.labsdb s52467__hashtags