Tiny project to help collect URLs from pages banning autmated data collection.
-
Clone the GitHub repo or download from the GitHub page and extract to your prefered location.
git clone [email protected]:agnesk92/URLScraper.git
-
On Chrome: Manage Extensions
-
Set the mode to Developer on the top right corner
-
Select the option 'Load unpacked', and choose the directory you downloaded the project in the first step.
-
Now you can enable the extension.
To copy URL's: push shift+c.
When you release these keys, the extension will stop the collection.
Repeat to continue.
When you are ready, you can click on the extension icon and select the option 'Export to CSV' to download the results.
Icons made by Freepik from www.flaticon.com