GRPO for robotics

[kassasin]

Recently,I am reading some papers and articles about grpo, a different reinforcement learning algorithm. It looks like someone that integrate mppi and rl. Does it a good idea for robotics?

[btaba]

Combining MPC and RL indeed seems like an interesting avenue to explore, although I'm not sure how it'll relate to GRPO specifically. I've dabbled previously with MPPI + offline RL (MBOP and POIR). I'm not really familiar with approaches that do this for online RL, hopefully someone else can chime in.

[kassasin]

https://superb-makemake-3a4.notion.site/group-relative-policy-optimization-GRPO-18c41736f0fd806eb39dc35031758885
This is a very simple example for cartpole environment. Grpo seems like a good idea for llm, how about for robotics?