Crawling articles easier

Crawling research articles with Selenium, BeautifulSoup in Python.

Available websites

Chrome driver issues

Chromedriver usage with wd.Chrome(service=Service(ChromeDriverManager().install())) unavailable due to Chrome version (≥115)
The argument driver_dir must be provided.

How to use

Select a crawling site (among the available lists above).
Type keyword to keyword argument.
Run {}_crawling function.

TODO

RISS