Skip to content

Commit ec1df86

Browse files
committed
minor fix dqn
1 parent 94a000b commit ec1df86

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

models/dqn_cartpole.py

+2-1
Original file line numberDiff line numberDiff line change
@@ -150,7 +150,7 @@ def train_step(state, action, t):
150150
'''
151151
Build ReplayMemory
152152
'''
153-
initial_memory_size = 10
153+
initial_memory_size = 500
154154
replay_memory = ReplayMemory(device=device)
155155

156156
step = 0
@@ -178,6 +178,7 @@ def train_step(state, action, t):
178178
copy_original_every = 1000
179179
eps = Epsilon()
180180

181+
model.copy_original()
181182
for episode in range(n_episodes):
182183
state = env.reset()
183184
terminal = False

0 commit comments

Comments
 (0)