Saving setting not working #869

nateray42 · 2023-10-15T16:39:23Z

nateray42
Oct 15, 2023

Windows 10, 19045.3570
WSL 2
LANraragi v.0.8.90 got from .msi
installed at the default location (C:...\roaming)
contents directory: F:\

46:M 15 Oct 2023 11:31:19.609 # Error trying to rename the temporary AOF file temp-rewriteaof-bg-214.aof into appendonly.aof: No such file or directory
46:M 15 Oct 2023 11:31:19.710 * Background append only file rewriting started by pid 215
46:M 15 Oct 2023 11:31:19.737 * AOF rewrite child asks to stop sending diffs.
215:C 15 Oct 2023 11:31:19.737 * Parent agreed to stop sending diffs. Finalizing AOF...
215:C 15 Oct 2023 11:31:19.737 * Concatenating 0.00 MB of AOF diff received from parent.
215:C 15 Oct 2023 11:31:19.745 * SYNC append only file rewrite performed
215:C 15 Oct 2023 11:31:19.745 * AOF rewrite: 0 MB of memory used by copy-on-write
46:M 15 Oct 2023 11:31:19.810 * Background AOF rewrite terminated with success
46:M 15 Oct 2023 11:31:19.811 * Residual parent diff successfully flushed to the rewritten AOF (0.00 MB)
46:M 15 Oct 2023 11:31:19.811 # Error trying to rename the temporary AOF file temp-rewriteaof-bg-215.aof into appendonly.aof: No such file or directory
46:M 15 Oct 2023 11:31:19.912 * Background append only file rewriting started by pid 216
46:M 15 Oct 2023 11:31:19.939 * AOF rewrite child asks to stop sending diffs.
216:C 15 Oct 2023 11:31:19.939 * Parent agreed to stop sending diffs. Finalizing AOF...
216:C 15 Oct 2023 11:31:19.939 * Concatenating 0.00 MB of AOF diff received from parent.
216:C 15 Oct 2023 11:31:19.947 * SYNC append only file rewrite performed
216:C 15 Oct 2023 11:31:19.947 * AOF rewrite: 0 MB of memory used by copy-on-write
46:M 15 Oct 2023 11:31:20.012 * Background AOF rewrite terminated with success
46:M 15 Oct 2023 11:31:20.013 * Residual parent diff successfully flushed to the rewritten AOF (0.00 MB)
46:M 15 Oct 2023 11:31:20.013 # Error trying to rename the temporary AOF file temp-rewriteaof-bg-216.aof into appendonly.aof: No such file or directory

Whenever I tried to save a settings, it saved properly during the program was open, but the setting reset after the program stopped and ran again.

Seems like when saving settings, it failed to convert the temp file into appendonly.

I tried three methods:

clean reinstall
That mean, I deleted .db file and .aof files in contents folder and entire install folder
delete appendonly.aof
Didn't work, it just keep generating temp files
Try another content folder in F:\

All those three methods didn't work.

Answered by Difegue

Nov 8, 2023

Future nightly windows builds now use a native Redis server - I've ran some tests and minion support seems iffy (I blame my unfinished backend tbh), but the server itself seems stable under WSL1 again.

Ironically it's worse on WSL2 now because mirrored networking isn't a default yet, so the distro won't be able to communicate with the native database. That's something I hope will improve in the future since microsoft is still working on that version though!

View full answer

Difegue · 2023-10-16T19:54:22Z

Difegue
Oct 16, 2023
Maintainer

👋 What filesystem are you using on F:/ ? I've seen cases where non-NTFS filesystems caused issues with WSL. #701 (comment)

0 replies

pandafeliz · 2023-10-20T05:40:48Z

pandafeliz
Oct 20, 2023

Having the same issue on the latest nightly (LANraragi 0.9.0). A sure way to trigger the error is to clean the database after it finishes indexing the files for the first time.

My 0.8.90 installation works fine and the filesystem where my database.rdb and appendonly folders and files reside is NTFS.
Windows 11
WSL1

23:M 19 Oct 2023 23:19:31.057 # WARNING: The TCP backlog setting of 511 cannot be enforced because /proc/sys/net/core/somaxconn is set to the lower value of 128.
23:M 19 Oct 2023 23:19:31.057 # Server initialized
23:M 19 Oct 2023 23:19:31.060 * Successfully migrated an old-style AOF file (appendonly.aof) into the AOF directory (appendonlydir).
23:M 19 Oct 2023 23:19:31.066 * Reading RDB preamble from AOF file...
23:M 19 Oct 2023 23:19:31.066 * Loading RDB produced by version 5.0.14
23:M 19 Oct 2023 23:19:31.066 * RDB age 78859 seconds
23:M 19 Oct 2023 23:19:31.066 * RDB memory usage when created 458.78 Mb
23:M 19 Oct 2023 23:19:31.066 * RDB has an AOF tail
23:M 19 Oct 2023 23:19:35.533 * Done loading RDB, keys loaded: 245861, keys expired: 0.
23:M 19 Oct 2023 23:19:35.533 * Reading the remaining AOF tail...
23:M 19 Oct 2023 23:19:35.533 * DB loaded from base file appendonly.aof: 4.474 seconds
23:M 19 Oct 2023 23:19:35.533 * DB loaded from append only file: 4.476 seconds
23:M 19 Oct 2023 23:19:35.535 * Creating AOF incr file appendonly.aof.1.incr.aof on server start
23:M 19 Oct 2023 23:19:35.535 * Ready to accept connections
23:M 19 Oct 2023 23:25:18.312 * 500 changes in 60 seconds. Saving...
23:M 19 Oct 2023 23:25:18.416 * Background saving started by pid 74
74:C 19 Oct 2023 23:25:18.673 # Write error saving DB on disk(rdbSaveRio): Function not implemented
23:M 19 Oct 2023 23:25:18.722 # Background saving error
23:M 19 Oct 2023 23:25:18.823 * Starting automatic rewriting of AOF on 132% growth
23:M 19 Oct 2023 23:25:18.825 * Creating AOF incr file appendonly.aof.2.incr.aof on background rewrite
23:M 19 Oct 2023 23:25:18.908 * Background append only file rewriting started by pid 75
75:C 19 Oct 2023 23:25:19.164 # Write error writing append only file on disk: Function not implemented
23:M 19 Oct 2023 23:25:19.210 # Background AOF rewrite terminated with error
23:M 19 Oct 2023 23:25:19.311 * Starting automatic rewriting of AOF on 132% growth
23:M 19 Oct 2023 23:25:19.314 * Creating AOF incr file appendonly.aof.3.incr.aof on background rewrite
23:M 19 Oct 2023 23:25:19.396 * Background append only file rewriting started by pid 76
76:C 19 Oct 2023 23:25:19.636 # Write error writing append only file on disk: Function not implemented
23:M 19 Oct 2023 23:25:19.700 # Background AOF rewrite terminated with error
23:M 19 Oct 2023 23:25:19.801 * Starting automatic rewriting of AOF on 132% growth
23:M 19 Oct 2023 23:25:19.803 * Creating AOF incr file appendonly.aof.4.incr.aof on background rewrite
23:M 19 Oct 2023 23:25:19.897 * Background append only file rewriting started by pid 77
77:C 19 Oct 2023 23:25:20.148 # Write error writing append only file on disk: Function not implemented
23:M 19 Oct 2023 23:25:20.201 # Background AOF rewrite terminated with error
23:M 19 Oct 2023 23:25:20.303 # Background AOF rewrite has repeatedly failed and triggered the limit, will retry in 1 minutes

[Mojolicious] [NFC-w_rQWLKV] [del] MISCONF Redis is configured to save RDB snapshots, but it's currently unable to persist to disk. Commands that may modify the data set are disabled, because this instance is configured to report errors during writes if RDB snapshotting fails (stop-writes-on-bgsave-error option). Please check the Redis logs for details about the RDB error.,  at /usr/local/share/perl5/site_perl/Redis.pm line 321.

Let me know if there is anything else I can share to help.

2 replies

Difegue Oct 20, 2023
Maintainer

Thanks, this is helpful. Function not implemented errors means the bitrot of WSL1 is starting to settle in and new linux kernel functions aren't working properly.
0.9.0 goes up by two redis releases for windows, so I'm guessing the new version is what contains the breaking change -- I might be able to use an older redis version here?

WSL2 fixes this but comes with its own lot of issues as documented (poor LAN support, no filewatching)

Difegue Oct 20, 2023
Maintainer

For the record, we use Alpine 3.18, which ships Redis 7.0.14.
Previous win version used 3.12, which ships Redis 5.0.14..

Difegue · 2023-10-27T23:00:00Z

Difegue
Oct 27, 2023
Maintainer

I tried this on Windows nightlies using WSL1/Alpine3.18/Redis 7.0.11 and 7.0.14 and couldn't actually reproduce the issue;
Settings seem to save fine on my end and RDB/AOF bgsaves work as expected after running DB cleans.

So I'm not sure how you can end up with Function not implementeds here... I don't think Microsoft has shipped any enhancements to WSL1 in a while so we should be running the same version?

This is what I get with a wsl --version: (keeping in mind the WSL version here has nothing to do with the WSL1/2 monikers, in classic microsoft fashion)

WSL version: 1.2.5.0
Kernel version: 5.15.90.1
WSLg version: 1.0.51
MSRDC version: 1.2.3770
Direct3D version: 1.608.2-61064218
DXCore version: 10.0.25131.1002-220531-1700.rs-onecore-base2-hyp
Windows version: 10.0.22631.2500

                _._                                                  
           _.-``__ ''-._                                             
      _.-``    `.  `_.  ''-._           Redis 7.0.11 (00000000/0) 64 bit
  .-`` .-```.  ```\/    _.,_ ''-._                                  
 (    '      ,       .-`  | `,    )     Running in standalone mode
 |`-._`-...-` __...-.``-._|'` _.-'|     Port: 6379
 |    `-._   `._    /     _.-'    |     PID: 19
  `-._    `-._  `-./  _.-'    _.-'                                   
 |`-._`-._    `-.__.-'    _.-'_.-'|                                  
 |    `-._`-._        _.-'_.-'    |           https://redis.io       
  `-._    `-._`-.__.-'_.-'    _.-'                                   
 |`-._`-._    `-.__.-'    _.-'_.-'|                                  
 |    `-._`-._        _.-'_.-'    |                                  
  `-._    `-._`-.__.-'_.-'    _.-'                                   
      `-._    `-.__.-'    _.-'                                       
          `-._        _.-'                                           
              `-.__.-'                                               

19:M 28 Oct 2023 00:43:41.899 # WARNING: The TCP backlog setting of 511 cannot be enforced because /proc/sys/net/core/somaxconn is set to the lower value of 128.
19:M 28 Oct 2023 00:43:41.899 # Server initialized
19:M 28 Oct 2023 00:43:41.900 * Loading RDB produced by version 7.0.11
19:M 28 Oct 2023 00:43:41.900 * RDB age 14254118 seconds
19:M 28 Oct 2023 00:43:41.900 * RDB memory usage when created 3.48 Mb
19:M 28 Oct 2023 00:43:41.907 * Done loading RDB, keys loaded: 316, keys expired: 1129.
19:M 28 Oct 2023 00:43:41.907 * DB loaded from disk: 0.008 seconds
19:M 28 Oct 2023 00:43:41.907 * Ready to accept connections
19:M 28 Oct 2023 00:43:42.938 * Creating AOF incr file temp-appendonly.aof.incr on background rewrite
19:M 28 Oct 2023 00:43:42.942 * Background append only file rewriting started by pid 23
23:C 28 Oct 2023 00:43:43.006 * Successfully created the temporary AOF base file temp-rewriteaof-bg-23.aof
23:C 28 Oct 2023 00:43:43.008 * Fork CoW for AOF rewrite: current 0 MB, peak 0 MB, average 0 MB
19:M 28 Oct 2023 00:43:43.012 * Background AOF rewrite terminated with success
19:M 28 Oct 2023 00:43:43.013 * Successfully renamed the temporary AOF base file temp-rewriteaof-bg-23.aof into appendonly.aof.2.base.rdb
19:M 28 Oct 2023 00:43:43.014 * Successfully renamed the temporary AOF incr file temp-appendonly.aof.incr into appendonly.aof.2.incr.aof
19:M 28 Oct 2023 00:43:43.036 * Removing the history file appendonly.aof.1.incr.aof in the background
19:M 28 Oct 2023 00:43:43.086 * Removing the history file appendonly.aof.1.base.rdb in the background
19:M 28 Oct 2023 00:43:43.103 * Background AOF rewrite finished successfully
19:M 28 Oct 2023 00:44:42.042 * 500 changes in 60 seconds. Saving...
19:M 28 Oct 2023 00:44:42.045 * Background saving started by pid 149
149:C 28 Oct 2023 00:44:42.132 * DB saved on disk
149:C 28 Oct 2023 00:44:42.133 * Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB
19:M 28 Oct 2023 00:44:42.146 * Background saving terminated with success

                _._                                                  
           _.-``__ ''-._                                             
      _.-``    `.  `_.  ''-._           Redis 7.0.14 (00000000/0) 64 bit
  .-`` .-```.  ```\/    _.,_ ''-._                                  
 (    '      ,       .-`  | `,    )     Running in standalone mode
 |`-._`-...-` __...-.``-._|'` _.-'|     Port: 6379
 |    `-._   `._    /     _.-'    |     PID: 57
  `-._    `-._  `-./  _.-'    _.-'                                   
 |`-._`-._    `-.__.-'    _.-'_.-'|                                  
 |    `-._`-._        _.-'_.-'    |           https://redis.io       
  `-._    `-._`-.__.-'_.-'    _.-'                                   
 |`-._`-._    `-.__.-'    _.-'_.-'|                                  
 |    `-._`-._        _.-'_.-'    |                                  
  `-._    `-._`-.__.-'_.-'    _.-'                                   
      `-._    `-.__.-'    _.-'                                       
          `-._        _.-'                                           
              `-.__.-'                                               

57:M 28 Oct 2023 00:47:10.099 # WARNING: The TCP backlog setting of 511 cannot be enforced because /proc/sys/net/core/somaxconn is set to the lower value of 128.
57:M 28 Oct 2023 00:47:10.100 # Server initialized
57:M 28 Oct 2023 00:47:10.101 * Loading RDB produced by version 7.0.11
57:M 28 Oct 2023 00:47:10.101 * RDB age 148 seconds
57:M 28 Oct 2023 00:47:10.101 * RDB memory usage when created 2.10 Mb
57:M 28 Oct 2023 00:47:10.104 * Done loading RDB, keys loaded: 319, keys expired: 13.
57:M 28 Oct 2023 00:47:10.104 * DB loaded from disk: 0.004 seconds
57:M 28 Oct 2023 00:47:10.104 * Ready to accept connections
57:M 28 Oct 2023 00:47:11.006 * Creating AOF incr file temp-appendonly.aof.incr on background rewrite
57:M 28 Oct 2023 00:47:11.009 * Background append only file rewriting started by pid 61
61:C 28 Oct 2023 00:47:11.099 * Successfully created the temporary AOF base file temp-rewriteaof-bg-61.aof
61:C 28 Oct 2023 00:47:11.101 * Fork CoW for AOF rewrite: current 0 MB, peak 0 MB, average 0 MB
57:M 28 Oct 2023 00:47:11.111 * Background AOF rewrite terminated with success
57:M 28 Oct 2023 00:47:11.111 * Successfully renamed the temporary AOF base file temp-rewriteaof-bg-61.aof into appendonly.aof.3.base.rdb
57:M 28 Oct 2023 00:47:11.112 * Successfully renamed the temporary AOF incr file temp-appendonly.aof.incr into appendonly.aof.3.incr.aof
57:M 28 Oct 2023 00:47:11.132 * Removing the history file appendonly.aof.2.incr.aof in the background
57:M 28 Oct 2023 00:47:11.133 * Removing the history file appendonly.aof.2.base.rdb in the background
57:M 28 Oct 2023 00:47:11.157 * Background AOF rewrite finished successfully
57:M 28 Oct 2023 00:48:11.065 * 500 changes in 60 seconds. Saving...
57:M 28 Oct 2023 00:48:11.069 * Background saving started by pid 115
115:C 28 Oct 2023 00:48:11.141 * DB saved on disk
115:C 28 Oct 2023 00:48:11.143 * Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB
57:M 28 Oct 2023 00:48:11.170 * Background saving terminated with success

5 replies

pandafeliz Oct 30, 2023

it seems I have the same wsl version

WSL version: 1.2.5.0
Kernel version: 5.15.90.1
WSLg version: 1.0.51
MSRDC version: 1.2.3770
Direct3D version: 1.608.2-61064218
DXCore version: 10.0.25131.1002-220531-1700.rs-onecore-base2-hyp
Windows version: 10.0.22621.2428

Just to add some more background to this, my folder structure is

C:\main content lrr folder
G:\location of where my content is stored

All my content folders are linked inside the main content lrr folder using junctions because those are stored in a regular hdd and I want the db file running on my ssd.
Could this be an issue with folder permissions? I tried running the app as administrator but it had the same behavior.

I remember I was running one of the earlier 0.9.0 nightlies just fine but after one of the updates I started getting this issue so I just reverted back to the stable builds.
Is there a way to get older nightlies? that way I can try them and tell you exactly at which one I get the breaking issues.

Difegue Oct 30, 2023
Maintainer

You can get older nightlies from the GH actions tab: https://github.com/Difegue/LANraragi/actions

Builds are only kept for around 3 months though, so I think one of the oldest ones I have would be https://github.com/Difegue/LANraragi/actions/runs/5766306129 .

pandafeliz Oct 31, 2023

ok, I tried the build you linked and that one throws the error right at the start, no interaction needed

[LANraragi] [info] LANraragi 0.9.0 (re-)started. (Debug Mode)
[LANraragi] [info] Plugin Detected: Chaika.moe
[LANraragi] [info] Plugin Detected: Chaika.moe api.json
[LANraragi] [info] Plugin Detected: ComicInfo
[LANraragi] [info] Plugin Detected: Tag Copier
[LANraragi] [info] Plugin Detected: Add Timestamp Tag
[LANraragi] [info] Plugin Detected: E-Hentai
[LANraragi] [info] Plugin Detected: eze
[LANraragi] [info] Plugin Detected: FAKKU
[LANraragi] [info] Plugin Detected: Hdoujin
[LANraragi] [info] Plugin Detected: Hentag
[LANraragi] [info] Plugin Detected: Hentag Online Lookups
[LANraragi] [info] Plugin Detected: Hitomi
[LANraragi] [info] Plugin Detected: koromo
[LANraragi] [info] Plugin Detected: Koushoku
[LANraragi] [info] Plugin Detected: Mayriad's EH Master Script
[LANraragi] [info] Plugin Detected: Filename Parsing
[LANraragi] [info] Plugin Detected: nHentai
[LANraragi] [info] Script Detected: Blacklist Migration
[LANraragi] [info] Script Detected: Subfolders to Categories
[LANraragi] [info] Script Detected: Source Finder
[LANraragi] [info] Script Detected: nHentai Source Converter
[LANraragi] [info] Downloader Detected: Chaika.moe Downloader
[LANraragi] [info] Downloader Detected: E*Hentai Downloader
[LANraragi] [info] Downloader Detected: Koushoku Downloader
Minion will use the Redis database at 127.0.0.1:6379/1
[LANraragi] [info] Successfully connected to Minion database.
[LANraragi] [debug] Registered tasks with Minion.
[Minion] [info] Starting new Minion worker in subprocess with 12 parallel jobs.
[Minion] [info] Minion worker 28 started
[LANraragi] [debug] Shinobu Worker new PID is 34
[LANraragi] [info] Routing done! Ready to receive requests.
[2023-10-30 19:58:27.16672] [28] [debug] Process 40 is performing job "46309" with task "build_stat_hashes"
[2023-10-30 19:58:27.27266] [12] [info] Listening at "http://*:3000"
Web application available at http://127.0.0.1:3000
[2023-10-30 19:58:27.27356] [12] [info] Manager 12 started
[2023-10-30 19:58:27.28568] [46] [info] Worker 46 started
[2023-10-30 19:58:27.29650] [52] [info] Worker 52 started
[2023-10-30 19:58:27.30382] [58] [info] Worker 58 started
[2023-10-30 19:58:27.31040] [12] [info] Creating process id file "/home/koyomi/lanraragi/public/temp/server.pid"
[2023-10-30 19:58:27.31140] [64] [info] Worker 64 started
[Tag Stats] [info] Building stat indexes... (76043 archives)
[Shinobu] [info] Shinobu File Watcher started.
[Shinobu] [info] Content folder is /mnt/c/lrr/manga.
[Shinobu] [info] Scanning content folder for changes...
[Shinobu] [info] Found 0 new files.
[Shinobu] [debug] Number of available cores for processing: 12
[Shinobu] [info] Initial scan complete! Adding watcher to content folder to monitor for further file edits.
[Shinobu] [debug] Watcher class is File::ChangeNotify::Watcher::Inotify
[Shinobu] [info] All done! Now dutifully watching your files.
Can't load application from file "/home/koyomi/lanraragi/script/lanraragi": MISCONF Redis is configured to save RDB snapshots, but it's currently unable to persist to disk. Commands that may modify the data set are disabled, because this instance is configured to report errors during writes if RDB snapshotting fails (stop-writes-on-bgsave-error option). Please check the Redis logs for details about the RDB error. at /usr/local/share/perl5/site_perl/Mojo/Redis/Database.pm line 156.
Compilation failed in require at (eval 131) line 1.
[2023-10-30 20:03:07.84304] [12] [info] Creating process id file "/home/koyomi/lanraragi/public/temp/server.pid"
[Tag Stats] [info] Stat indexes built! (76043 archives)
Can't load application from file "/home/koyomi/lanraragi/script/lanraragi": MISCONF Redis is configured to save RDB snapshots, but it's currently unable to persist to disk. Commands that may modify the data set are disabled, because this instance is configured to report errors during writes if RDB snapshotting fails (stop-writes-on-bgsave-error option). Please check the Redis logs for details about the RDB error. at /usr/local/share/perl5/site_perl/Mojo/Redis/Database.pm line 156.
Compilation failed in require at (eval 131) line 1.
[2023-10-30 20:03:09.84480] [12] [info] Creating process id file "/home/koyomi/lanraragi/public/temp/server.pid"

19:C 30 Oct 2023 19:58:20.595 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
19:C 30 Oct 2023 19:58:20.595 # Redis version=7.0.12, bits=64, commit=00000000, modified=0, pid=19, just started
19:C 30 Oct 2023 19:58:20.595 # Configuration loaded
19:M 30 Oct 2023 19:58:20.596 * Increased maximum number of open files to 10032 (it was originally set to 1024).
19:M 30 Oct 2023 19:58:20.596 * monotonic clock: POSIX clock_gettime
                _._                                                  
           _.-``__ ''-._                                             
      _.-``    `.  `_.  ''-._           Redis 7.0.12 (00000000/0) 64 bit
  .-`` .-```.  ```\/    _.,_ ''-._                                  
 (    '      ,       .-`  | `,    )     Running in standalone mode
 |`-._`-...-` __...-.``-._|'` _.-'|     Port: 6379
 |    `-._   `._    /     _.-'    |     PID: 19
  `-._    `-._  `-./  _.-'    _.-'                                   
 |`-._`-._    `-.__.-'    _.-'_.-'|                                  
 |    `-._`-._        _.-'_.-'    |           https://redis.io       
  `-._    `-._`-.__.-'_.-'    _.-'                                   
 |`-._`-._    `-.__.-'    _.-'_.-'|                                  
 |    `-._`-._        _.-'_.-'    |                                  
  `-._    `-._`-.__.-'_.-'    _.-'                                   
      `-._    `-.__.-'    _.-'                                       
          `-._        _.-'                                           
              `-.__.-'                                               

19:M 30 Oct 2023 19:58:20.597 # WARNING: The TCP backlog setting of 511 cannot be enforced because /proc/sys/net/core/somaxconn is set to the lower value of 128.
19:M 30 Oct 2023 19:58:20.598 # Server initialized
19:M 30 Oct 2023 19:58:20.600 * Successfully migrated an old-style AOF file (appendonly.aof) into the AOF directory (appendonlydir).
19:M 30 Oct 2023 19:58:20.605 * Reading RDB preamble from AOF file...
19:M 30 Oct 2023 19:58:20.605 * Loading RDB produced by version 5.0.14
19:M 30 Oct 2023 19:58:20.605 * RDB age 63035 seconds
19:M 30 Oct 2023 19:58:20.605 * RDB memory usage when created 461.00 Mb
19:M 30 Oct 2023 19:58:20.605 * RDB has an AOF tail
19:M 30 Oct 2023 19:58:24.999 * Done loading RDB, keys loaded: 246534, keys expired: 0.
19:M 30 Oct 2023 19:58:24.999 * Reading the remaining AOF tail...
19:M 30 Oct 2023 19:58:25.000 * DB loaded from base file appendonly.aof: 4.400 seconds
19:M 30 Oct 2023 19:58:25.000 * DB loaded from append only file: 4.402 seconds
19:M 30 Oct 2023 19:58:25.002 * Creating AOF incr file appendonly.aof.1.incr.aof on server start
19:M 30 Oct 2023 19:58:25.002 * Ready to accept connections
19:M 30 Oct 2023 20:03:02.465 * 500 changes in 60 seconds. Saving...
19:M 30 Oct 2023 20:03:02.599 * Background saving started by pid 71
71:C 30 Oct 2023 20:03:02.880 # Write error saving DB on disk(rdbSaveRio): Function not implemented
19:M 30 Oct 2023 20:03:02.905 # Background saving error
19:M 30 Oct 2023 20:03:03.006 * Starting automatic rewriting of AOF on 132% growth
19:M 30 Oct 2023 20:03:03.009 * Creating AOF incr file appendonly.aof.2.incr.aof on background rewrite
19:M 30 Oct 2023 20:03:03.102 * Background append only file rewriting started by pid 72
72:C 30 Oct 2023 20:03:03.380 # Write error writing append only file on disk: Function not implemented
19:M 30 Oct 2023 20:03:03.404 # Background AOF rewrite terminated with error
19:M 30 Oct 2023 20:03:03.506 * Starting automatic rewriting of AOF on 132% growth
19:M 30 Oct 2023 20:03:03.508 * Creating AOF incr file appendonly.aof.3.incr.aof on background rewrite
19:M 30 Oct 2023 20:03:03.582 * Background append only file rewriting started by pid 73
73:C 30 Oct 2023 20:03:03.858 # Write error writing append only file on disk: Function not implemented
19:M 30 Oct 2023 20:03:03.885 # Background AOF rewrite terminated with error
19:M 30 Oct 2023 20:03:03.987 * Starting automatic rewriting of AOF on 132% growth
19:M 30 Oct 2023 20:03:03.989 * Creating AOF incr file appendonly.aof.4.incr.aof on background rewrite
19:M 30 Oct 2023 20:03:04.072 * Background append only file rewriting started by pid 74
74:C 30 Oct 2023 20:03:04.356 # Write error writing append only file on disk: Function not implemented
19:M 30 Oct 2023 20:03:04.374 # Background AOF rewrite terminated with error
19:M 30 Oct 2023 20:03:04.475 # Background AOF rewrite has repeatedly failed and triggered the limit, will retry in 1 minutes
19:M 30 Oct 2023 20:03:08.002 * 500 changes in 60 seconds. Saving...
19:M 30 Oct 2023 20:03:08.095 * Background saving started by pid 75
75:C 30 Oct 2023 20:03:08.354 # Write error saving DB on disk(rdbSaveRio): Function not implemented
19:M 30 Oct 2023 20:03:08.398 # Background saving error
19:M 30 Oct 2023 20:03:14.027 * 500 changes in 60 seconds. Saving...
19:M 30 Oct 2023 20:03:14.100 * Background saving started by pid 76
76:C 30 Oct 2023 20:03:14.343 # Write error saving DB on disk(rdbSaveRio): Function not implemented
19:M 30 Oct 2023 20:03:14.401 # Background saving error
19:M 30 Oct 2023 20:03:20.025 * 500 changes in 60 seconds. Saving...
19:M 30 Oct 2023 20:03:20.107 * Background saving started by pid 77
77:C 30 Oct 2023 20:03:20.347 # Write error saving DB on disk(rdbSaveRio): Function not implemented
19:M 30 Oct 2023 20:03:20.408 # Background saving error
19:M 30 Oct 2023 20:03:26.033 * 500 changes in 60 seconds. Saving...
19:M 30 Oct 2023 20:03:26.108 * Background saving started by pid 78
78:C 30 Oct 2023 20:03:26.347 # Write error saving DB on disk(rdbSaveRio): Function not implemented
19:M 30 Oct 2023 20:03:26.410 # Background saving error
19:M 30 Oct 2023 20:03:32.035 * 500 changes in 60 seconds. Saving...
19:M 30 Oct 2023 20:03:32.114 * Background saving started by pid 79
79:C 30 Oct 2023 20:03:32.352 # Write error saving DB on disk(rdbSaveRio): Function not implemented
19:M 30 Oct 2023 20:03:32.416 # Background saving error
19:M 30 Oct 2023 20:03:38.040 * 500 changes in 60 seconds. Saving...
19:M 30 Oct 2023 20:03:38.118 * Background saving started by pid 80
80:C 30 Oct 2023 20:03:38.357 # Write error saving DB on disk(rdbSaveRio): Function not implemented
19:M 30 Oct 2023 20:03:38.420 # Background saving error
19:M 30 Oct 2023 20:03:44.043 * 500 changes in 60 seconds. Saving...
19:M 30 Oct 2023 20:03:44.124 * Background saving started by pid 81
81:C 30 Oct 2023 20:03:44.360 # Write error saving DB on disk(rdbSaveRio): Function not implemented
19:M 30 Oct 2023 20:03:44.426 # Background saving error
19:M 30 Oct 2023 20:03:50.050 * 500 changes in 60 seconds. Saving...
19:M 30 Oct 2023 20:03:50.122 * Background saving started by pid 82
82:C 30 Oct 2023 20:03:50.362 # Write error saving DB on disk(rdbSaveRio): Function not implemented
19:M 30 Oct 2023 20:03:50.424 # Background saving error

maybe there is a problem with my db file? my library is kinda large (76k+ files) but I haven't had any issues with it until now, everything works just fine in the current stable version.

pandafeliz Oct 31, 2023

Just as a follow up to this, I just tried the latest nightly using a clean install (no previous database file, just one archive in a subfolder) and it works correctly.

So the issue appears after converting my old database to the new format, it seems it just chokes after a few minutes and breaks mid conversion because of the amount of entries.

it never generates this file "appendonly.aof.1.base.rdb" which I assume is the new file that it previously was database.rdb

Edit: After further testing it seems it chokes under wsl1 but works fine when it tries to handle it under wsl2. I tried to revert back to wsl1 after it started successfully for the first under wsl2 but it will break again so I assume is because of how big is my library and wsl1 can't handle it under this new format.

Difegue Oct 31, 2023
Maintainer

I've seen some SO links about this problem w/ Redis on WSL1, but it doesn't look like there are any solutions --
https://stackoverflow.com/questions/75408884/write-error-saving-db-on-diskrdbsaverio-function-not-implemented
https://stackoverflow.com/questions/72308223/redis-exceptions-responseerror-misconf-redis-is-configured-to-save-rdb-snapshot

You should always have the database.rdb file though, AOF is just an additional layer of data safety/faster DB saving.
Maybe just disabling AOF for WSL1 would fix it?
That'd be toggling appenonly to no in redis.conf (I'm not too certain that'd help considering the function that fails is called rdbSaveRio, but it's worth a try)

Difegue · 2023-10-31T11:35:11Z

Difegue
Oct 31, 2023
Maintainer

An outlandish suggestion would also be to try using the Windows Redis port (https://github.com/redis-windows/redis-windows) with the redis.conf from LRR - That'd sidestep any WSL issues as it's native.

Since the database and app communicate through TCP, they should interop just fine. 🤔

1 reply

pandafeliz Oct 31, 2023

I give it a try to both suggestions, thanks.

EDIT: Using the Windows Redist port worked but it appears to be slower on startup, gonna give it a spin for a few days to see if there aren't any issues during regular usage.

Making sure the WSL distro is using specified WSL mode: 1.
The distribution is already the requested version.
Error code: Wsl/Service/WSL_E_VM_MODE_INVALID_STATE
Executing the following command on WSL: export LRR_NETWORK=http://*:3000 && export LRR_DATA_DIRECTORY='/mnt/c/lrr/manga' && export LRR_THUMB_DIRECTORY='/mnt/c/cache/lrr' && cd /home/koyomi/lanraragi && rm -f public/temp/server.pid && mkdir -p log && mkdir -p content && mkdir -p database && sysctl vm.overcommit_memory=1 && redis-server /home/koyomi/lanraragi/tools/build/docker/redis.conf --dir '/mnt/c/lrr/manga/' --daemonize yes && perl ./script/launcher.pl -f ./script/lanraragi
vm.overcommit_memory = 1
Server PID will be at /home/koyomi/lanraragi/public/temp/server.pid


ｷﾀ━━━━━━(ﾟ∀ﾟ)━━━━━━!!!!!
[LANraragi] [info] LANraragi 0.9.0 started. (Production Mode)
[LANraragi] [info] Plugin Detected: Chaika.moe
[LANraragi] [info] Plugin Detected: Chaika.moe api.json
[LANraragi] [info] Plugin Detected: ComicInfo
[LANraragi] [info] Plugin Detected: Tag Copier
[LANraragi] [info] Plugin Detected: Add Timestamp Tag
[LANraragi] [info] Plugin Detected: E-Hentai
[LANraragi] [info] Plugin Detected: eze
[LANraragi] [info] Plugin Detected: FAKKU
[LANraragi] [info] Plugin Detected: Hdoujin
[LANraragi] [info] Plugin Detected: Hentag
[LANraragi] [info] Plugin Detected: Hentag Online Lookups
[LANraragi] [info] Plugin Detected: Hitomi
[LANraragi] [info] Plugin Detected: koromo
[LANraragi] [info] Plugin Detected: Koushoku.yaml
[LANraragi] [info] Plugin Detected: Mayriad's EH Master Script
[LANraragi] [info] Plugin Detected: Filename Parsing
[LANraragi] [info] Plugin Detected: nHentai
[LANraragi] [info] Script Detected: Subfolders to Categories
[LANraragi] [info] Script Detected: Source Finder
[LANraragi] [info] Script Detected: nHentai Source Converter
[LANraragi] [info] Downloader Detected: Chaika.moe Downloader
[LANraragi] [info] Downloader Detected: E*Hentai Downloader
Killing process 27 from /home/koyomi/lanraragi/public/temp/minion.pid
Minion will use the Redis database at 127.0.0.1:6379/1
[LANraragi] [info] Successfully connected to Minion database.
[Minion] [info] Starting new Minion worker in subprocess with 12 parallel jobs.
[Minion] [info] Minion worker 29 started
Killing process 33 from /home/koyomi/lanraragi/public/temp/shinobu.pid
[LANraragi] [info] Routing done! Ready to receive requests.
[2023-10-31 17:27:08.94048] [16] [info] Listening at "http://*:3000"
Web application available at http://127.0.0.1:3000
[2023-10-31 17:27:08.94096] [16] [info] Manager 16 started
[2023-10-31 17:27:08.95166] [47] [info] Worker 47 started
[2023-10-31 17:27:08.96024] [53] [info] Worker 53 started
[2023-10-31 17:27:08.96882] [59] [info] Worker 59 started
[2023-10-31 17:27:08.97696] [16] [info] Creating process id file "/home/koyomi/lanraragi/public/temp/server.pid"
[2023-10-31 17:27:08.97786] [65] [info] Worker 65 started
[Tag Stats] [info] Building stat indexes... (76043 archives)
[Shinobu] [info] Shinobu File Watcher started.
[Shinobu] [info] Content folder is /mnt/c/lrr/manga.
[Shinobu] [info] Scanning content folder for changes...
[Shinobu] [info] Found 0 new files.
[Shinobu] [info] 0 files were found on the filemap but not on the filesystem.
[Shinobu] [info] Initial scan complete! Adding watcher to content folder to monitor for further file edits.
[Shinobu] [info] All done! Now dutifully watching your files.
[Tag Stats] [info] Stat indexes built! (76043 archives)

78:C 31 Oct 2023 17:26:28.757 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
78:C 31 Oct 2023 17:26:28.757 # Redis version=7.0.14, bits=64, commit=00000000, modified=0, pid=78, just started
78:C 31 Oct 2023 17:26:28.757 # Configuration loaded
78:M 31 Oct 2023 17:26:28.757 # You requested maxclients of 10000 requiring at least 10032 max file descriptors.
78:M 31 Oct 2023 17:26:28.757 # Server can't set maximum open files to 10032 because of OS error: Operation not permitted.
78:M 31 Oct 2023 17:26:28.758 # Current maximum open files is 3200. maxclients has been reduced to 3168 to compensate for low ulimit. If you need higher maxclients increase 'ulimit -n'.
78:M 31 Oct 2023 17:26:28.758 * monotonic clock: POSIX clock_gettime
                _._
           _.-``__ ''-._
      _.-``    `.  `_.  ''-._           Redis 7.0.14 (00000000/0) 64 bit
  .-`` .-```.  ```\/    _.,_ ''-._
 (    '      ,       .-`  | `,    )     Running in standalone mode
 |`-._`-...-` __...-.``-._|'` _.-'|     Port: 6379
 |    `-._   `._    /     _.-'    |     PID: 78
  `-._    `-._  `-./  _.-'    _.-'
 |`-._`-._    `-.__.-'    _.-'_.-'|
 |    `-._`-._        _.-'_.-'    |           https://redis.io
  `-._    `-._`-.__.-'_.-'    _.-'
 |`-._`-._    `-.__.-'    _.-'_.-'|
 |    `-._`-._        _.-'_.-'    |
  `-._    `-._`-.__.-'_.-'    _.-'
      `-._    `-.__.-'    _.-'
          `-._        _.-'
              `-.__.-'

78:M 31 Oct 2023 17:26:28.761 # Server initialized
78:M 31 Oct 2023 17:26:28.766 * Successfully migrated an old-style AOF file (appendonly.aof) into the AOF directory (appendonlydir).
78:M 31 Oct 2023 17:26:28.766 * Reading RDB preamble from AOF file...
78:M 31 Oct 2023 17:26:28.767 * Loading RDB produced by version 5.0.14
78:M 31 Oct 2023 17:26:28.767 * RDB age 71948 seconds
78:M 31 Oct 2023 17:26:28.767 * RDB memory usage when created 460.08 Mb
78:M 31 Oct 2023 17:26:28.767 * RDB has an AOF tail
78:M 31 Oct 2023 17:26:30.710 * Done loading RDB, keys loaded: 246538, keys expired: 0.
78:M 31 Oct 2023 17:26:30.710 * Reading the remaining AOF tail...
78:M 31 Oct 2023 17:26:30.710 * DB loaded from base file appendonly.aof: 1.944 seconds
78:M 31 Oct 2023 17:26:30.710 * DB loaded from append only file: 1.948 seconds
78:M 31 Oct 2023 17:26:30.713 * Creating AOF incr file appendonly.aof.1.incr.aof on server start
78:M 31 Oct 2023 17:26:30.713 * Ready to accept connections
78:M 31 Oct 2023 17:34:27.190 * 500 changes in 60 seconds. Saving...
78:M 31 Oct 2023 17:34:27.668 * Background saving started by pid 79
79:C 31 Oct 2023 17:34:31.003 * DB saved on disk
79:C 31 Oct 2023 17:34:31.003 * Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB
78:M 31 Oct 2023 17:34:31.089 * Background saving terminated with success
78:M 31 Oct 2023 17:34:31.203 * Starting automatic rewriting of AOF on 132% growth
78:M 31 Oct 2023 17:34:31.206 * Creating AOF incr file appendonly.aof.2.incr.aof on background rewrite
78:M 31 Oct 2023 17:34:31.640 * Background append only file rewriting started by pid 80
80:C 31 Oct 2023 17:34:34.944 * Successfully created the temporary AOF base file temp-rewriteaof-bg-80.aof
80:C 31 Oct 2023 17:34:34.944 * Fork CoW for AOF rewrite: current 0 MB, peak 0 MB, average 0 MB
78:M 31 Oct 2023 17:34:34.999 * Background AOF rewrite terminated with success
78:M 31 Oct 2023 17:34:35.001 * Successfully renamed the temporary AOF base file temp-rewriteaof-bg-80.aof into appendonly.aof.2.base.rdb
78:M 31 Oct 2023 17:34:35.004 * Removing the history file appendonly.aof.1.incr.aof in the background
78:M 31 Oct 2023 17:34:35.004 * Removing the history file appendonly.aof in the background
78:M 31 Oct 2023 17:34:35.049 * Background AOF rewrite finished successfully

pandafeliz · 2023-11-07T23:07:56Z

pandafeliz
Nov 7, 2023

Just to follow up, I've been using 0.9.0 (WSL1) alongside Redis 7.0.14 for Windows this past week as my main setup and it has been working fine.
Is definitely slower during start up and after doing a db clear (a 5 minutes increase give or take) compared to 0.8.90 but I don't know if is because of the redis changes and the size of my library and I can't really compare because the default setup still breaks under both WSL1 and WSL2.
Adding and deleting files and any tags operations still work as fast as they did in 0.8.90.

1 reply

Difegue Nov 7, 2023
Maintainer

Thanks for the information - I'm likely going to work towards shipping this in 0.9.10 just so I can lessen the Windows version's reliance on WSL.
(which i wouldn't have to do if microsoft got their shit together but it can't be helped)

Additionally, I'm somewhat hopeful switching to native redis will fix the issues with adding a large amount of files not completing on some Windows machines!

Difegue · 2023-11-08T19:33:33Z

Difegue
Nov 8, 2023
Maintainer

Future nightly windows builds now use a native Redis server - I've ran some tests and minion support seems iffy (I blame my unfinished backend tbh), but the server itself seems stable under WSL1 again.

Ironically it's worse on WSL2 now because mirrored networking isn't a default yet, so the distro won't be able to communicate with the native database. That's something I hope will improve in the future since microsoft is still working on that version though!

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Saving setting not working #869

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 6 comments 9 replies

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Select a reply

Saving setting not working #869

nateray42 Oct 15, 2023

Replies: 6 comments · 9 replies

Difegue Oct 16, 2023 Maintainer

pandafeliz Oct 20, 2023

Difegue Oct 20, 2023 Maintainer

Difegue Oct 20, 2023 Maintainer

Difegue Oct 27, 2023 Maintainer

pandafeliz Oct 30, 2023

Difegue Oct 30, 2023 Maintainer

pandafeliz Oct 31, 2023

pandafeliz Oct 31, 2023

Difegue Oct 31, 2023 Maintainer

Difegue Oct 31, 2023 Maintainer

pandafeliz Oct 31, 2023

pandafeliz Nov 7, 2023

Difegue Nov 7, 2023 Maintainer

Difegue Nov 8, 2023 Maintainer

nateray42
Oct 15, 2023

Replies: 6 comments 9 replies

Difegue
Oct 16, 2023
Maintainer

pandafeliz
Oct 20, 2023

Difegue Oct 20, 2023
Maintainer

Difegue Oct 20, 2023
Maintainer

Difegue
Oct 27, 2023
Maintainer

Difegue Oct 30, 2023
Maintainer

Difegue Oct 31, 2023
Maintainer

Difegue
Oct 31, 2023
Maintainer

pandafeliz
Nov 7, 2023

Difegue Nov 7, 2023
Maintainer

Difegue
Nov 8, 2023
Maintainer