LLM-Driven Automation Controller #19
Description
LLM-Driven Automation Controller
Description: Implement an LLM-based controller that can adapt to UI changes and guide browser automation.
Detailed Requirements:
- Create LangChain/LangGraph workflow for UI navigation
- Implement visual element recognition strategies
- Design prompt engineering for navigation tasks
- Add error recovery through visual feedback
- Create element identification fallbacks
- Implement strategy adaptation based on results
Acceptance Criteria:
- LLM can reliably navigate social media interfaces
- System adapts to minor UI changes automatically
- Error recovery works effectively
- Controller maintains session context
- Automation remains stable across platform updates