Skip to content

tahonaPL/fluent-scrapper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

FluentScrapper

Basically web crawler!

How To use

  FluentScrapper.<String>of("https://site.com")
                .startPage("/some/path/")
                .linksContainsAny("work", "user") //optional restriction for url 
                .linksLimit(1000)
                .depthLevel(3)
                .omitNullData() 
                .fetcher(Fetchers.email()) // can use own fetchers
                .dataStore(DataStores.csvFile("~/user/myData.csv", ImmutableList::of))  // Save to 
                .crawl();

How I use

Use for getting emails or phones. :D

Install

Well if you need that give me an info. I will publish it to the mvn repo.

About

Basically web crawler!

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages