added torch.nn

_posts/pytorch/2024-01-21-torch-nn.md

@@ -0,0 +1,14 @@
+---
+layout: post
+title: nn.Module, nn.Sequential, nn.ModuleList, nn.ModuleDict
+category: Pytorch
+tag: torch.nn
+---
+
+- Use `Module` when you have a big block compose of multiple smaller blocks
+- Use `Sequential` when you want to create a small block from layers
+- Use `ModuleList` when you need to iterate through some layers or building blocks and do something
+- Use `ModuleDict` when you need to parametise some blocks of your model, for example an activation function
+
+### references:
+- https://github.com/FrancescoSaverioZuppichini/Pytorch-how-and-when-to-use-Module-Sequential-ModuleList-and-ModuleDict