feat: add mixed-precision and agc to gradaccum optimizer#131

Open

dPys wants to merge 30 commits intoandreped:mainfrom dPys:optimizer-refactor

+731-257

Commits on Jan 21, 2024

feat: upgrade optimizer and agc

Derek Pisner
authored and
Derek Pisner
committed
feat: swap base class for

Derek Pisner
authored and
Derek Pisner
committed

Commits on Jan 30, 2024

fix: change to absolute imports for clarity and ease of testing

Derek Pisner
authored and
Derek Pisner
committed

Commits on Feb 5, 2024

fix: install, lint, black

Derek Pisner
authored and
Derek Pisner
committed
revert: relative imports

Derek Pisner
authored and
Derek Pisner
committed
revert: setup.py

Derek Pisner
authored and
Derek Pisner
committed
revert: __init__.py

Derek Pisner
authored and
Derek Pisner
committed
chore: linted

Derek Pisner
authored and
Derek Pisner
committed
revert: grad clipping, address in follow-up PR

Derek Pisner
authored and
Derek Pisner
committed
fix: uncomment broken unit test

Derek Pisner
authored and
Derek Pisner
committed
chore: move to utils

Derek Pisner
authored and
Derek Pisner
committed

Commits on Feb 6, 2024

chore: re-lint

Derek Pisner
authored and
Derek Pisner
committed
fix: failing unit test

Derek Pisner
authored and
Derek Pisner
committed
test: update mixed_precision unit test to also test optimizer

Derek Pisner
authored and
Derek Pisner
committed
fix: broken import (agc)

Derek Pisner
authored and
Derek Pisner
committed

Commits on Feb 7, 2024

feat: revert test_mixed_precision

Derek Pisner
authored and
Derek Pisner
committed

Commits on Feb 8, 2024

feat: increase test coverage

Derek Pisner
authored and
Derek Pisner
committed
feat: cover parse_grad

Derek Pisner
authored and
Derek Pisner
committed
fix: missing var def

Derek Pisner
authored and
Derek Pisner
committed
chore: update codecov.yml

Derek Pisner
authored and
Derek Pisner
committed
fix: failing unit test

Derek Pisner
authored and
Derek Pisner
committed

Commits on Feb 11, 2024

test: update test_optimizer with additional coverage

Derek Pisner
authored and
Derek Pisner
committed
test: add support for gradients property, clip factor to agc

Derek Pisner
authored and
Derek Pisner
committed
test: fix lr test

Derek Pisner
authored and
Derek Pisner
committed
chore: lint

Derek Pisner
authored and
Derek Pisner
committed
fix: clip_factor -> clipvalue

Derek Pisner
authored and
Derek Pisner
committed
chore: lint

Derek Pisner
authored and
Derek Pisner
committed
chore: lint

Derek Pisner
authored and
Derek Pisner
committed
chore: lint

Derek Pisner
authored and
Derek Pisner
committed
test(cov): lr setter

Derek Pisner
authored and
Derek Pisner
committed