Is knowledge contribution repeating training?

[jeremycaine]

The current request is to contribute source information (in a repo) that attributes back to only Wikipedia articles. Fine.
The LLMs we will use for fine-tuning are likely already trained on Wikipedia data already.

Therefore what sort of knowledge is a useful additional contribution?

For the example, the guidance example of the 96th Academy Awards and you follow to the repo of information is a copy of the wikipedia article which the LLM likely already has knowledge of.

Example, following the introduction instructions and running ilab chat with the question "who directed the film Jaws?" already returns "The film 'Jaws' was directed by Steven Spielberg,..."

Can a knowledge contribution be some authored text - say, a reflection on the filming of Jaws and how the broken special effects Shark led to moody music filming that actually created the tension the film was famous for; along with referencing the Wikipedia Jaws film page.

[jeremycaine]

moved to slack

[jeremycaine]

admin can delete