Examples of Cutlass / CuTe in practice

[jeromeku]

What are good open source examples of cutlass / cute in practice?

I'm aware of Flash-Attention, xformers, pytorch (inductor alternative GEMM backend), DeepSpeed, ...

[hwu36]

are you asking which oss projects are using cutlass?

[jeromeku]

@hwu36
Yes -- OSS libraries that are using Cutlass and you would consider good usage patterns.

[hwu36]

@mnicely

[mnicely]

AITemplate - https://github.com/facebookincubator/AITemplate
Alibaba MNN - https://github.com/alibaba/MNN
TVM - https://github.com/apache/tvm
tiny-cuda-nn - https://github.com/NVlabs/tiny-cuda-nn
PaddlePaddle - https://github.com/PaddlePaddle/Paddle
FasterTransformer - https://github.com/NVIDIA/FasterTransformer

Just do a search for 'cutlass' through out Github and investigate the issues. You'll find many repos using CUTLASS