No model size reduction seen

[sriyachakravarthy]

Hi! I do not see model size reduction after pruning using llmpcompressor framework. Kindly help

[robertgshaw2-neuralmagic]

Can you share any more details of what you did?

[markurtz]

Hi @sriyachakravarthy we'll have some examples up soon (next few weeks) to help guide this. The current issue is that we do not have full support in compressed tensors for storage of sparse models. This is currently in progress with the following PR: neuralmagic/compressed-tensors#167