Intelligently matching term:[phrase] to other phrase forms

[ronaldtse]

e.g. in metanorma/stepmod-utils#23

The directive of term:[individual products] is provided but the actual term is "individual product".

By using word stemmers we could potentially match the words used in the definitions to the defined terms of the document.

• https://github.com/aurelian/ruby-stemmer (ruby-c)
• https://github.com/ealdent/uea-stemmer (pure Ruby)

For example, ruby-stemmer uses Snowball which converts both the singular "individual product" and "individual products" into "individu product".

There is certainly an issue if the dictionary contains very short phrases like "to" then there is a problem.

There are 2 steps we can do this:

1. Automatically, by checking all matches in definition text (e.g. definition contains "individual products", we match it to "individual product".
2. When the user specifies (e.g. term:[individual products] instead of term:[individual products, individual product])

[ronaldtse]

https://github.com/yohasebe/lemmatizer/ may also be an option but it requires a dictionary.