List view
AI Tasks: ### RAI: **core:** - stabilization of multiagent and semantic database - operation tracing / stats / diagnostics PoC - add unittests **providers:** - Ollama function calling integration - Claude sonnet 3.5 full integration **interaction:** - TTS integration - ASR stabilisation - HRI Node stabilisation **ui:** - RAI Frontend v1 (web / rviz / foxglove) **nodes:** - diagnostics node **design:** - try the action before execution ** manipulation ** - fine-tuning of OpenVLA SIM Tasks: Manipulation demo - full OpenVLA ~ Moveit integration - OpenVLA - fine tuning PoC - release
Overdue by 1 year(s)•Due by August 2, 2024•2/2 issues closed### Rai: **core:** - migrate to native ros function calling - topics, actions, services, message interface - migration of scenarios to langgraph - task queue PoC - multiagent PoC - caching **interaction**: - ASR integration - HRI Node PoC **nodes:** - flexible knowledge database / semantic map node PoC: [RFC](https://github.com/RobotecAI/rai-private/issues/44) - grounding DINO node **ui:** - GUI requirements: [RFC](https://github.com/RobotecAI/rai-private/issues/47) **prompts/configuration:** - robot identity - define user input to RAI ### Sim/robotics: **General:** - documentation node design/PoC - 1 benchmark environment - example custom ros2 message - for robustness testing w/ unknown ros2 interfaces - high level diagnostics requirements definition **Husarion demo:** - release o3de husarion project w/ hosted docker image to Open Source - exploration w/ NoMaD on Husarion **Agri demo**: (not to be finalized in M1) - agri demo improvements - assets cleanup - new repo - initial nav2 work **Manipulation demo** (not to be finalized in M1) - PoC of OpenVLA integration with Manipulation Demo - connect model to moveit - demo task definition
Overdue by 1 year(s)•Due by July 14, 2024•18/18 issues closed