ESP-AI

简体中文

Provides a complete AI dialogue solution for your development board, including but not limited to the IAT(ASR)+LLM+TTS integration solution for the ESP32 series development boards. It is injected into the project as a dependency without affecting existing projects.

For developing the dialogue functionality of robots, you only need to prepare the IAT(ASR), LLM, and TTS services, and leave the rest to ESP-AI.

The server-side code of this project is based on Node.js, and the hardware code is based on Arduino IDE.

Open source is not easy, click the Star button in the upper right corner to show your support~

Website Homepage

• 中文网站
• English

Features

• Customizable offline voice wake-up
• IAT(ASR) ➡️ LLM/RAG ➡️ TTS
• User command recognition (home appliance control, singing, etc.)
• Configurable
• Plugin-based
• The service and client have a one-to-many relationship
• Server authentication
• Streaming data interaction
• Ready to use

Next Steps

• Provide a no-code access solution
• Integrate AI into the user intent inference process (e.g., "Turn off the light", "Quickly turn on the light", both recognized as the "turn on the light" command)
• Offer both free and paid services
• Online generation of wake words
• Support for writing plugins in other languages (avoiding the need to use Node.js exclusively for plugin development)
• Provide dedicated development boards (to avoid the current complex wiring)

Inject Soul into Your Robot with Just a Few Lines of Code

Below are the Node.js and Arduino codes you need to write if you only require dialogue functionality.

Discussion Group

QQ Discussion Group: 854445223

Detailed Usage Tutorial

Connecting Hardware to Large Language Models (LLM) Made Simple~

Case Study Video

bilibili