Add improvements and fixes to upstream#227

Open

sskalnik wants to merge 21 commits intoStability-AI:mainfrom

sskalnik:sat-pr-v2

Commits on Sep 14, 2025

Commits on Sep 25, 2025

Initial commit of working SAO-1.0 and SAO-small training configs and scripts. Update .gitignore to ignore raw audio file dataset folder and outputs folder.
sskalnik
committed
Create TRAINING_FOR_NOOBS.md
sskalnik
authored
Update TRAINING_FOR_NOOBS.md for clarity regarding /rawfiles.
sskalnik
authored

Commits on Sep 29, 2025

Add support for AdamW8bit from bitsandbytes. Improve custom metadata module logic. Fix issue with FutureWarning about torch.cuda.amp.autocast() vs torch.amp.autocast("cuda").
sskalnik
committed

Commits on Oct 5, 2025

Add experimental support for google/t5gemma-b-b-ul2. Remove spurious whitespace from TRAINING_FOR_NOOBS.md.
sskalnik
committed

Commits on Oct 6, 2025

Change learning rate to 5e-5 (still experimenting with SAO-small). Use StatefulDataLoader from torchdata so we can resume from mid-epoch checkpoints.
sskalnik
committed

Commits on Oct 8, 2025

Freeze requirements for 2025 Oct 07.
sskalnik
committed

Commits on Oct 10, 2025

Commits on Oct 18, 2025

Remove onesided=True from mel_spectrogram_op. Add config files for kickbass_v1 example/experiment and validation example.
sskalnik
committed

Commits on Oct 21, 2025

Add support for CosineAnnealingWarmRestarts.
sskalnik
committed

Commits on Oct 30, 2025

Add zip files to .gitignore.
sskalnik
committed

Commits on Nov 1, 2025