Skip to content

Commit 35cc242

Browse files
committed
Fix bug in S4Block stepping
1 parent a246043 commit 35cc242

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

src/models/sequence/modules/s4block.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -196,6 +196,7 @@ def step(self, x, state):
196196
if self.bottleneck is not None:
197197
x = self.input_linear(x)
198198
y, next_state = self.layer.step(x, state) # (B C H)
199+
y = self.activation(y)
199200
if self.gate is not None:
200201
y = self.output_gate(y)
201202
y = y * v

0 commit comments

Comments
 (0)