Skip to content

Sentient-Beings/Language-to-Actions

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

37 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Sentient Beings Banner

Pull Requests Welcome first-timers-only Friendly

Agentic Workflow for Robotics

Sentient Beings is a open-source organization that is on a mission to build agentic robots. Each project in this organization is designed to be self-contained and we do that by creating a docker container for each project. That includes the dependencies and source code for that project. This helps us get around the "works on my machine" problem.

Getting Started

This repository focuses on the development of an Agent that can translate the human language to actions. The agent is a simple differential drive robot with a camera and a LIDAR sensor.

demo_reasoning_trace.mp4

Current Implementation

  • briefly explain the architecture and workflow
  • limitations of the current implementation
  • future work

Getting Started

  • add docker details
  • add installation instructions

Running the Demo

  1. Launch the simulation environment:

    ros2 launch rabbit_one launch_sim.launch.py  
  2. Start the sensor processing node:

     ros2 run agent_controller sensor_processor
  3. Start the simple controller node:

     ros2 run agent_controller simple_controller
  4. Initialize the redis server:

     redis-server
  5. Run the agent:

     ros2 run conscience agent
  6. Initialize the streamlit app:

    cd conscience
    streamlit run streamlit_app.py

Project Structure

  • add project structure

Future Work

  • add future work

About

Language to action space for a mobile differential drive robot

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published