Skip to content

Latest commit

 

History

History
17 lines (12 loc) · 537 Bytes

README.md

File metadata and controls

17 lines (12 loc) · 537 Bytes

Sitemap Web Scraper

Sitemap Web Scraper (sws) is a tool for simple, flexible, and yet performant web pages scraping.

It consists of a CLI written in Rust that crawls web pages and executes a Lua JIT script to scrap them, outputting results to a CSV file.

sws crawl --script examples/fandom_mmh7.lua -o result.csv

Check out the doc for more details.