Add xformers and wandb

[AlpinDale]

Not sure if you had any reasons for not including them, but I'm making this PR entirely for my own convenience's sake.

[ewof]

u will get some cringe error about it installing torch 2.0.1 and xformers requiring 2.0.0 but if this is gonna get merged might as well add deepspeed to it too

[AlpinDale]

u will get some cringe error about it installing torch 2.0.1 and xformers requiring 2.0.0 but if this is gonna get merged might as well add deepspeed to it too

That's hasn't been an issue for me if xformers is installed from the git source. It uses the latest pytorch.

[ewof]

nvm yea i was using pip not git