Skip to content

Simple OpenAI gym compatible environments to help develop DRL agents.

Notifications You must be signed in to change notification settings

aakash94/SimpleEnv

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 

Repository files navigation

SimpleEnv

Simple OpenAI gym compatible environments to help develop DRL agents. Standard gym environments don't provide enough feedback for algorithm development and debugging. Goal here is to have environments that help develop bug free agents and algorithms. At current state the project is very basic. Open to suggestions. Feel free to contribute.

What does it have?

Simple gym environment, with continuous state and action space. State has 4 dimensions. Action has 2 dimension. Each episode will run for 1024 time steps.

all_ones

Can the agent learn to output(action) all ones irrespective of the input(state).

State : State is a numpy array with random values between 0 and 1. At every step new values are set randomly.

Reward : Reward is the negative l1 loss between the action and an array of 1s.

copy_cat

Can the agent output(action) all ones or all zeros depending on the input(state)

State : State is either an array of all ones or all zeros, chosen randomly at each time step.

Reward : Reward is the negative MSE between the action and an array of 1s.

How to setup ?

  • Clone the repo
  • Go to SimpleEnv directory
  • run pip install -e .
    This will install simple-env

How to use?

import gym
import simple_env

env_all_ones = gym.make('all_ones-v0')
env_copy_cat = gym.make('copy_cat-v0')

The environments are good for use now.

What's next?

  • Making it available via pypi
  • Adding more simple environments for different types of agents
  • Maybe, add testcases for some standard functions and operations
    (Project is not in active development right now)

About

Simple OpenAI gym compatible environments to help develop DRL agents.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages