Code

FP8 Support for MCore MoE#648

Code

Merged

ptrendx merged 4 commits intoNVIDIA:mainNVIDIA/TransformerEngine:mainfrom Victarry:denliu/moe_fp8Victarry/TransformerEngine:denliu/moe_fp8Copy head branch name to clipboardApr 29, 2024

+92-24

Commits

Commits on Apr 16, 2024

• Add support for MoE with FP8.

  Show description for fde3bae
  Victarry

  committed
  fde3bae

  Copy full SHA for fde3bae

• Fix unittest.

  Show description for d79d661
  Victarry

  committed
  d79d661

  Copy full SHA for d79d661

• Fix error in linear backward.

  Show description for 883178e
  Victarry

  committed
  883178e

  Copy full SHA for 883178e

Commits on Apr 25, 2024

• Merge branch 'main' into denliu/moe_fp8

  ptrendx

  authored
  edba411

  Copy full SHA for edba411