An Infinite number of error messages appear after git push

[Phobooky]

After instaling worddumb-8a3f79e422791c3d20a66ad96007c187fc915369, it appears this extrange behabiour.
Preferences->Customize ePub Dictionary->Select Spanish (in my case). An Infinite number of error messages appear. The only way is cancel Calibre.
Aspect (the shadow in the images is related with a lot of winwdows):

[xxyzz]

I added IPA and POS column to the lemmas table in the previous commits, you'll need to delete the old wiktionary_* files in the worddumb-lemmas folder.

[Phobooky]

Just after solving the previous problem, now new issues arise.
All books produce error when generating x-ray and wordwise.
Example:

calibre, version 6.2.0 (win32, embedded-python: True)
Tonnerre de Brest!: An error occurred, please copy error message then report bug at GitHub.


Starting job: Generating Word Wise and X-Ray for The Kill Artist 
Job: "Generating Word Wise and X-Ray for The Kill Artist" failed with error: 
Traceback (most recent call last):
  File "calibre\gui2\threaded_jobs.py", line 82, in start_work
  File "calibre_plugins.worddumb.parse_job", line 154, in do_job
  File "calibre_plugins.worddumb.parse_job", line 305, in create_files
  File "calibre_plugins.worddumb.epub", line 191, in modify_epub
  File "calibre_plugins.worddumb.epub", line 310, in create_word_wise_footnotes
ValueError: not enough values to unpack (expected 4, got 3)
 
Called with args: ((161, 'EPUB', 'C:\\Archivos de Programas\\Calibre\\Calibre Library\\Daniel Silva\\The Kill Artist (161)\\The Kill Artist - Daniel Silva.epub', <calibre.ebooks.metadata.book.base.Metadata object at 0x00000195F6675060>, {'spacy': 'en_core_web_', 'wiki': 'en', 'kaikki': 'English'}), True, True) {'notifications': <queue.Queue object at 0x00000195F6676230>, 'abort': <threading.Event object at 0x00000195F66744F0>, 'log': <calibre.utils.logging.GUILog object at 0x00000195F6674A00>} 

Another one:

Tonnerre de Brest!: An error occurred, please copy error message then report bug at GitHub.

Starting job: Generating Word Wise and X-Ray for La última noche en Tremore Beach 
Job: "Generating Word Wise and X-Ray for La última noche en Tremore Beach" failed with error: 
Traceback (most recent call last):
  File "calibre\gui2\threaded_jobs.py", line 82, in start_work
  File "calibre_plugins.worddumb.parse_job", line 154, in do_job
  File "calibre_plugins.worddumb.parse_job", line 305, in create_files
  File "calibre_plugins.worddumb.epub", line 191, in modify_epub
  File "calibre_plugins.worddumb.epub", line 310, in create_word_wise_footnotes
ValueError: not enough values to unpack (expected 4, got 3)
 
Called with args: ((155, 'EPUB', 'C:\\Archivos de Programas\\Calibre\\Calibre Library\\Mikel Santiago\\La ultima noche en Tremore Beach (155)\\La ultima noche en Tremore Beac - Mikel Santiago.epub', <calibre.ebooks.metadata.book.base.Metadata object at 0x000001960B5306A0>, {'spacy': 'es_core_news_', 'wiki': 'es', 'kaikki': 'Spanish'}), True, True) {'notifications': <queue.Queue object at 0x000001960B530CA0>, 'abort': <threading.Event object at 0x000001960DFA3400>, 'log': <calibre.utils.logging.GUILog object at 0x000001960DFA3D30>} 

[xxyzz]

Maybe you didn't delete the old wiktionary_es_dump file?

[Phobooky]

Yes, I deleted it, but the new one generated is very small comparing with the previous one:

[xxyzz]

I deleted some words that have the "misspelling", "form-of" and "alt-of" tags.

[Phobooky]

And... I was supposed to do something with the errors generating files?

[xxyzz]

I'm not sure what you mean, did you encounter another error?

[Phobooky]

I mean.... you told me that you had deleted some words. But I don not what it does mean in reference to my problem. My conversions still goes wrong with the last git push.

[xxyzz]

I said I deleted some words to answer your question about the decreased Wiktionary file size. I though the not enough values to unpack error was solved once you deleted all the old wiktioanry_* files and created the new files. I tried to add Word Wise to a Spanish EPUB book and the job finished without an error.

[xxyzz]

There suppose to be a "wiktionary_es_tst" file in the folder created by the latest commit plugin, but your screenshot doesn't have it. It's only used for searching lemma but it's not there, kind strange.

[Phobooky]

I've check the complete installation and it already works perfectly now. But, I have a doubt. The wiktionary_es.json file size has decreased a lot. Do you think it is correct?

Another thing. I've observed that many activated words in previous version of "Customize EPUB Wiktionary", now are disabled (maked as false). For example, the word "ramshackle" was marked as true and now it is marked as false. I can control the level of difficulty in Kindle Word Wise using the device. But when I generate an epub with wordwise using "Customize EPUB Wiktionary", as every word has not level of difficulty.... How can I manage the level of difficulty generanding WordWise in EPUBs?

[xxyzz]

I removed some inflected words from the Spanish Wiktionary in recent commits, that's why the file size decreased.

"ramshackle": fixed in 763f159

Difficulty is only used on Kindle. Word Wise is added as footnote on EPUB, I don't think EPUB can filter footnotes.

[Phobooky]

Now I can see it is alright. Thanks.

[Phobooky]

But, related with the fact that difficulty is only used on Kindle, I can see the percentaje of words with Word Wise on EPUB is very diferent depending of the language as you can see in these two pages. I don't know if it would have a meaning.

[xxyzz]

I only enabled English Wiktionary words that are enabled for Kindle. For other languages I enabled all of them because I don't have the similar prevalence data as English.

[Phobooky]

Ok. I understand. :)