Add a CrossQ agent to the library

[Soralsei]

Hello, would it be possible for the CrossQ algorithm to be added to the library ? I have made an attempt at adding it myself but my inexperience with Jax has made the process exceedingly tedious. Thank you in advance for your consideration and have a nice day.

[Toni-SM]

Hi @Soralsei

Currently I am short of time to be able to add the implementation from zero...but if you have an initial implementation (and a reference code, whatever ML framework is used) please open a PR and I can help with the implementation.

[Soralsei]

Hello @Toni-SM

No worries about being busy haha. Anyway, I believe the original implementation for the algorithm (see https://github.com/adityab/CrossQ) is written with Jax and mirrors Stable-baselines 3's architecture if you're familiar with it but I was unable to wrap my head around how the framework works. I'll try to open a PR soon (whenever I get a bit of free time) but I gave you the link here just in case !

I also currently have a fork of SKRL with an initial (not yet functional though) torch implementation of CrossQ, so I'll probably bundle both in the discussed PR.

[Soralsei]

Hello again @Toni-SM,
I have opened the PR we discussed (see #283).
If you don't have the time to look at it, no worries. Take at look at it whenever you have the time.