Skip to content

Simple web scraper to test out real world OCaml (WIP)

License

Notifications You must be signed in to change notification settings

vkitchen/crawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

d1e0cc2 · Mar 23, 2024

History

37 Commits
Mar 23, 2024
Jan 21, 2024
Jan 8, 2021
Jan 8, 2021
Feb 27, 2024
Feb 27, 2024
May 21, 2021
Jan 11, 2021
Jan 11, 2021
Jan 10, 2021
Feb 5, 2024
Feb 26, 2024
May 21, 2021
Mar 25, 2022

Repository files navigation

Scraper

What will be a simple web scraper in OCaml to try out using the language on a real world project

Building

First you will need to make sure you have ocaml, opam and dune instealled. Then you will need to install the dependencies like so opam install cohttp-lwt-unix lwt_ppx lambdasoup finally run dune build main.exe which will build in _build/default/main.exe

N.B. if building on OpenBSD you'll likely have to increase your stack size limit during dependency install as parsexp uses a large stack allocated array. This can by done by running ulimit -s 32768 in the shell before you start

About

Simple web scraper to test out real world OCaml (WIP)

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published