Skip to content

Commit

Permalink
addded torchrun
Browse files Browse the repository at this point in the history
  • Loading branch information
wonchul committed Jan 9, 2024
1 parent 2bc5a02 commit d4bbd25
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion _posts/pytorch/2024-01-09-torchrun.md
Original file line number Diff line number Diff line change
Expand Up @@ -146,4 +146,6 @@ train_sampler.set_epoch(epoch)

- [pytorch examples for ddp](https://github.com/pytorch/examples/blob/main/distributed/ddp/README.md)

- [💥 Training Neural Nets on Larger Batches: Practical Tips for 1-GPU, Multi-GPU & Distributed setups](https://medium.com/huggingface/training-larger-batches-practical-tips-on-1-gpu-multi-gpu-distributed-setups-ec88c3e51255)
- [💥 Training Neural Nets on Larger Batches: Practical Tips for 1-GPU, Multi-GPU & Distributed setups](https://medium.com/huggingface/training-larger-batches-practical-tips-on-1-gpu-multi-gpu-distributed-setups-ec88c3e51255)

- [PYTORCH로 분산 어플리케이션 개발하기](https://tutorials.pytorch.kr/intermediate/dist_tuto.html)

0 comments on commit d4bbd25

Please sign in to comment.