YAKE (Yet Another Keyword Extractor)

Yake is a language agnostic statistical keyword extractor weighing several factors such as acronyms, position in paragraph, capitalization, how many sentences the keyword appears in, stopwords, punctuation and more. Details are in these papers: brief, extended.

This crate is ported and is close as possible to the reference implementation.

Example

use yake_rust::*;

fn main() {
    let text = r#"
    Google is acquiring data science community Kaggle. Sources tell us that Google is acquiring Kaggle, a platform that hosts data science and machine learning 
    competitions. Details about the transaction remain somewhat vague, but given that Google is hosting its Cloud 
    Next conference in San Francisco this week, the official announcement could come as early as tomorrow. 
    Reached by phone, Kaggle co-founder CEO Anthony Goldbloom declined to deny that the acquisition is happening. 
    Google itself declined 'to comment on rumors'. Kaggle, which has about half a million data scientists on its platform, 
    was founded by Goldbloom  and Ben Hamner in 2010. 
    The service got an early start and even though it has a few competitors like DrivenData, TopCoder and HackerRank, 
    it has managed to stay well ahead of them by focusing on its specific niche. 
    The service is basically the de facto home for running data science and machine learning competitions. 
    With Kaggle, Google is buying one of the largest and most active communities for data scientists - and with that, 
    it will get increased mindshare in this community, too (though it already has plenty of that thanks to Tensorflow 
    and other projects). Kaggle has a bit of a history with Google, too, but that's pretty recent. Earlier this month, 
    Google and Kaggle teamed up to host a $100,000 machine learning competition around classifying YouTube videos. 
    That competition had some deep integrations with the Google Cloud Platform, too. Our understanding is that Google 
    will keep the service running - likely under its current name. While the acquisition is probably more about 
    Kaggle's community than technology, Kaggle did build some interesting tools for hosting its competition 
    and 'kernels', too. On Kaggle, kernels are basically the source code for analyzing data sets and developers can 
    share this code on the platform (the company previously called them 'scripts'). 
    Like similar competition-centric sites, Kaggle also runs a job board, too. It's unclear what Google will do with 
    that part of the service. According to Crunchbase, Kaggle raised $12.5 million (though PitchBook says it's $12.75) 
    since its   launch in 2010. Investors in Kaggle include Index Ventures, SV Angel, Max Levchin, Naval Ravikant,
    Google chief economist Hal Varian, Khosla Ventures and Yuri Milner 
    "#;

    let now = std::time::Instant::now();

    let keywords = 
        Yake::new(StopWords::predefined("en").unwrap(), Config::default())
            .get_n_best(text, Some(10));

    println!("{:?}", keywords);
    println!("Elapsed: {:.2?}", now.elapsed());
}

Results:

keyword	raw	score
kaggle	Kaggle	0.20846279315962324
google	Google	0.23676437642810488
acquiring kaggle	acquiring Kaggle	0.3017882425537463
data science	data science	0.30873986543219967
google cloud	Google Cloud	0.40955463454967833
google cloud platform	Google Cloud Platform	0.5018536215405839
acquiring data science	acquiring data science	0.5494143207629893
san francisco	San Francisco	0.7636151899513093
ceo anthony goldbloom	CEO Anthony Goldbloom	0.8166005339007906
science community kaggle	science community Kaggle	0.8690005548383123