Skip to content
Merged
Show file tree
Hide file tree
Changes from 10 commits
Commits
Show all changes
33 commits
Select commit Hold shift + click to select a range
2a658f9
Adds support for Reset in test fixture
arjo129 Oct 11, 2024
053152f
Add support for simulation reset via a publicly callable API
arjo129 Oct 11, 2024
ff468b7
Style
arjo129 Oct 11, 2024
e0ee0dd
Style
arjo129 Oct 11, 2024
047be5b
Style
arjo129 Oct 11, 2024
76adc26
Typo
arjo129 Oct 11, 2024
83b30c2
Adds an initial StableBaselines3 RL environment as an example
arjo129 Nov 7, 2024
c3eea00
Fixed readme instructions
arjo129 Nov 11, 2024
9a2b742
Style
arjo129 Nov 11, 2024
da33f11
Got the gui working. Time for gradient descent by grad student
arjo129 Nov 11, 2024
3e83828
Address feedback
arjo129 Jan 8, 2025
35eca3e
Merge remote-tracking branch 'origin/main' into arjo/feat/server_rese…
arjo129 Jan 8, 2025
15fa867
Add support for individual resets
arjo129 Jan 8, 2025
ed502ee
Merge branch 'main' into arjo/feat/server_reset_public_api
arjo129 Feb 5, 2025
120c1ec
Merge branch 'arjo/feat/server_reset_public_api' into arjo/examples/r…
arjo129 Feb 6, 2025
16d4407
Style
arjo129 Feb 7, 2025
6c8131c
Bind installation directories and install
arjo129 Feb 7, 2025
5117071
Missed the file in the last commit
arjo129 Feb 7, 2025
e602467
Merge remote-tracking branch 'refs/remotes/origin/arjo/examples/rl_ex…
arjo129 Feb 7, 2025
46e3ca8
style
arjo129 Feb 7, 2025
6799df2
Style
arjo129 Feb 10, 2025
ad1ace4
Merge branch 'arjo/feat/server_reset_public_api' into arjo/examples/r…
arjo129 Feb 10, 2025
856f316
Style
arjo129 Feb 10, 2025
f8ddbf6
Enable GUI rollout
arjo129 Mar 5, 2025
648fa11
Merge branch 'main' into arjo/examples/rl_example
j-rivero Mar 13, 2025
5318663
Merge branch 'main' into arjo/examples/rl_example
arjo129 Mar 19, 2025
9cf5b69
Merge branch 'main' into arjo/examples/rl_example
iche033 Apr 16, 2025
e540136
Address feedback and more thorough Docs
arjo129 Apr 17, 2025
3343fe0
Fix SDF file
arjo129 Apr 17, 2025
6c083c6
Fix style
arjo129 Apr 17, 2025
5b8af2a
Merge branch 'main' into arjo/examples/rl_example
iche033 Apr 23, 2025
748d979
Merge branch 'main' into arjo/examples/rl_example
arjo129 May 28, 2025
bb2a515
Fix compilation errors
arjo129 May 28, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
@@ -0,0 +1,44 @@
# Example for Reinforcement Learning (RL) With Gazebo

This demo world shows you an example of how you can use SDFormat, Ray-RLLIB and Gazebo to perform RL with python.
We start with a very simple cart-pole world. This world is defined in our sdf file `cart_pole.sdf`. It is analogous to
the

## Create a VENV

First create a virtual environment using python,
```
python3 -m venv venv
```
Lets activate it and install rayrllib and pytorch.
```
. venv/bin/activate
```

Lets install our dependencies
```
pip install stable-baselines3[extra]
```
For visuallization to work you will also need to:
```
pip uninstall opencv-python
pip install opencv-python-headless
```
This is because `opencv-python` brings in Qt5 by default.

In the same terminal you should add your gazebo python install directory to the `PYTHONPATH`
If you built gazebo from source in the current working directory this would be:
```
export PYTHONPATH=$PYTHONPATH:install/lib/python
```

You will also need to set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION to python due to version
mis-matches.
```
export PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION=python
```


## Exploring the environment

You can see the environment by using `gz sim cart_pole.sdf`.
Loading
Loading