You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In the LogWrapper initialization, both returned_episode_returns and returned_episode_lengths are set to 0.
Since 0 is a valid return for many environments, is it impossible (in isolation) to tell apart an initial return of 0 and a non-terminated first episode.
In order to indicate missing data before the first episode terminates, these should be set to NaN (or None).
The text was updated successfully, but these errors were encountered:
In the
LogWrapper
initialization, bothreturned_episode_returns
andreturned_episode_lengths
are set to 0.Since 0 is a valid return for many environments, is it impossible (in isolation) to tell apart an initial return of 0 and a non-terminated first episode.
In order to indicate missing data before the first episode terminates, these should be set to
NaN
(orNone
).The text was updated successfully, but these errors were encountered: