[Back to projects]

Microduck RL


RL training environments for microduck, an 800g bipedal robot. trained it to sprint: median 0.93 m/s, bursts up to 1.21 m/s, about 3.7 body lengths per second. zero falls across 256 test runs, trained on a single RTX 4060 with 4096 parallel sims.


Tech Stack

  • Python
  • Pytorch
  • CUDA
  • Reinforcement Learning
  • MuJoCo

Deliverables & Links