• John Schulman's avatar
    Fix atari wrapper (affecting a2c perf) and pposgd mujoco performance · d9f194f7
    John Schulman authored
    - removed vf clipping in pposgd - that was severely degrading performance on mujoco because it didn’t account for scale of returns
    - switched adam epsilon in pposgd_simple
    - brought back no-ops in atari wrapper (oops)
    - added readmes
    - revamped run_X_benchmark scripts to have standard form
    - cleaned up DDPG a little, removed deprecated SimpleMonitor and non-idiomatic usage of logger