[HuggingFace-Feature request] Update huggingface-pytorch-inference image

[kurtgdl]

sagemaker-huggingface-inference-toolkit has rolled out its version 2.4 but huggingface-pytorch-inference is still lagging well behind with its version 2.1.
This prevented me from using packages that require newer versions of transformers and pytorch.

Could you please provide new container images for huggingface-pytorch-inference?

[ricor07]

Hello, I'd be glad to work on this. Can i get the issue assigned? Thanks