Skip to content

v0.3.0
Compare
Choose a tag to compare
@andreped andreped released this 29 Jan 17:21
· 410 commits to main since this release
v0.3.0
dc3137a

What's changed

  • Added experimental Optimizer wrapper solution through GAOptimizerWrapper by @andreped in #28
  • Added experimental multi-GPU support through GAModelWrapperV2 by @andreped in #28
  • Added reduction method to Optimizer wrapper and set it to MEAN by default by @andreped in #29
  • Added fix related to model subclassing, see #23
  • Added support for and verified that macOS M1 silicon works
  • Added GAOptimizerWrapper CI unit test

How to install?

pip install gradient-accumulator==0.3.0

How to use?

Method Usage
GAModelWrapper model = GAModelWrapper(accum_steps=4, inputs=model.input, outputs=model.output)
GAOptimizerWrapper opt = GAOptimizerWrapper(accum_steps=4, optimizer=tf.keras.optimizers.Adam(1e-3))

Full Changelog: v0.2.2...v0.3.0

Contributors

andreped
Assets 3
Loading