Skip to content

Learning to use python by writing a scraper for Andrew Gelman's blog

Notifications You must be signed in to change notification settings

stellaywong/scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Scraper

Learning to use python by writing a scraper for Andrew Gelman's blog, based on this New Year's post 🎉. Try it out!

The first csv file looks like this:

2021 Blog

Post Title Post Date Unique Commenters URL
What we did in 2020, and thanks to all our collaborators and many more 2021-01-01 12 https://statmodeling.stat.columbia.edu/2021/01/01/what-we-did-in-2020/#comments
Typos of the day 2021-01-04 4 https://statmodeling.stat.columbia.edu/2021/01/05/typo-of-the-day/#comments
xkcd: "Curve-fitting methods and the messages they send" 2021-01-07 28 https://statmodeling.stat.columbia.edu/2021/01/07/xkcd-curve-fitting-methods-and-the-messages-they-send/#comments

The second csv file looks like this:

2021 Commenters

Commenters Total Response Rate Number of Posts
Jane Smith 286 88
Jane Doe 1089 162

The data visualizations (from Gelman's annual charts) look like this:

Histogram

Scatterplot

About

Learning to use python by writing a scraper for Andrew Gelman's blog

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published