1. 28 Aug, 2017 1 commit
    • John Schulman's avatar
      Fix atari wrapper (affecting a2c perf) and pposgd mujoco performance · d9f194f7
      John Schulman authored
      - removed vf clipping in pposgd - that was severely degrading performance on mujoco because it didn’t account for scale of returns
      - switched adam epsilon in pposgd_simple
      - brought back no-ops in atari wrapper (oops)
      - added readmes
      - revamped run_X_benchmark scripts to have standard form
      - cleaned up DDPG a little, removed deprecated SimpleMonitor and non-idiomatic usage of logger