Mixed type multi head policies with different distributions

[redzhepdx]

It is very common to support different types of action spaces like robot joints (continuous) and the gripper (categorical). Yes you can turn them to a single type of action but this usually leads slower convergence and many unexpected behaviors. As example mazerl supports this feature, you can find the details here .