Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add learning agent #31

Merged
merged 280 commits into from
Apr 22, 2024
Merged

Add learning agent #31

merged 280 commits into from
Apr 22, 2024

Conversation

camall3n
Copy link
Owner

No description provided.

camall3n added 30 commits May 13, 2023 14:12
@camall3n
Fix formatting
59b626f
@camall3n
Change var name discs -> discreps
7a4b4f4
@camall3n
Add discrep progress plot for queue search
647ed3f
@camall3n
Refactor optimize_memory_optuna & prepare for other optimizers
7d96616
@camall3n
Refactor learning agent out of search node
1b80306
@camall3n
Refactor search node into utils/discrete_search
cffb1a8
@camall3n
Refactor fifo-queue search into learning agent
06f60d9
@camall3n
Refactor simulated annealing into learning agent
ac8dd88
@camall3n
Refactor all optimizers into optimize_memory()
a78d295
@camall3n
Hook discrete mem optimization script up to args.mem_optimizer
f7f9671
@camall3n
Clean up discrete results folder & hook into study_name
8d8d386
@camall3n
Fix simulated annealing bug where improvements led to overflow
46cefb5
@camall3n
Fix bug in simulated annealing where obs index could go out of bounds
61676b5
@camall3n
Add plot script for discrete experiments
e315044
@camall3n
Fix bug where study_dir wasn't getting set
b316256
@camall3n
Fix bug where study_dir wasn't getting created
b62c9a8
@camall3n
Make policy iteration sane again
0fe6ccb
@camall3n
Switch to hardmax
7f27917
@camall3n
Add tqdm for search-queue and annealing
9a03988
@camall3n
Consolidate tqdm bars for filling replay buffer
92d481f
@camall3n
Add option for pruning queue search when parent node is suboptimal
0b6959a
@camall3n
Add hash function to SearchNode and test with PriorityQueue
01b27fa
@camall3n
Integrate priority queue into queue-based mem search
cdc12be
@camall3n
Disable priority queue by default
a78afce
@camall3n
[WIP] tune annealing to work for tmaze & ~cheese
75bb211
@camall3n
[WIP] slightly better settings(?) and add n_repeats
d08dc11
@camall3n
Stop analytical policy iteration if policy stops changing
6184457
@camall3n
[snapshot] slightly too short to get good cheese performance
9c26bc2
@camall3n
[snapshot] works for tmaze, cheese, 4x3, shuttle; scale by initial la…
121775e 
…mbda discrep
@camall3n
Remove unnecessary deepcopy
3bdd55d
camall3n and others added 28 commits February 12, 2024 10:52
@camall3n
Update compare script
039c2d9
@taodav
revert back to non-jitted memory improvement, and add mem_tde_01 runs
92213e6
@camall3n
Clean up TD-error script, add bar plots
a1af23b
@taodav
add interleave hyperparams
c493163
@taodav
remove unneeded arguments
582622d
@taodav
add log_every
4b990d3
@taodav
add --objective
b36b272
@taodav
new interleave runs
bbb71f2
@taodav
add batch_run fixes
47aa192
@taodav
Merge pull request #19 from taodav/interleave
df7b0ad 
Interleave
@taodav
fix interleave
542d613
@taodav
fix batch_run
d2dbdc7
@taodav
add residual arg
94cb140
@taodav
add plotting grads script
91be4d3
@taodav
fix policy iteration
dcdec22
@camall3n
Add example 26 (and alternate)
b52422b
@camall3n
Add script to check example 26
d00d808
@taodav
add initial implementation for four_tmaze
596084c
@taodav
add compass world
715baee
@taodav
move goal position to middle of left wall for compass world
181cf10
@taodav
add batch_run_kitchen_sinks
19ceab2
@taodav
running batch kitchen sinks
0ab6922
@taodav
add batch_run_kitchen
ddff824
@camall3n
[Merge] taodav/main into learning-agent
e714078
@camall3n
Remove duplicate value_error implementation
38a9533
@camall3n
[Merge] PR #20 - Add script to compare error signals
e579f3e
@camall3n
[Sync] with taodav/main
737a50a
@camall3n
Add hill climbing for MSTDE
ac05b27
@camall3n camall3n merged commit 16a72e6 into main Apr 22, 2024
1 check failed
@camall3n camall3n deleted the learning-agent branch April 22, 2024 21:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@taodav taodav Awaiting requested review from taodav

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@camall3n @taodav