new api, new extension

[KevinBatdorf]

I wrote some notes on how I picture a new extension that's unique, useful, and maybe a bit in the spirit of val.town

I'll try to work on this when I have time. Any input is welcomes.

In short, I want it to use AI and vals as tools to run the AI, either through Raycast or Val.town built in AI.

So you might ask a question like "What's the weather in Tokyo Japan?" it would look through your tools, invoke a weather val (if you don't have one it can search for one), then include that response it it's reply. If it knew the answer already, I want it to provide an answer first, then use a tool to confirm it. I'll make it configurable but I want the default to always use one tool.

-- Options to include (like settings area)

• use raycast ai or openai (via val.town)
• use which vals? (users? public? private? with regex pattern? all (ai searches)? townie (is it possible to jsut have townie create a val to use?)? )
• rate limit?
• interactive mode? (user presses enter after every tool)
• val descriptions?
• minimum tool pick (e.g. shoudl it always use a tool regardless?)

-- Feature flow

• Get a list of the user's Vals
• behind the scenes, have ai make a summary of the val (readme or if none then code analysis)
• Have a panel with a list of all the vals to choose from (maybe here we summarze)
• user asks a question only.
• send the question with a template (user editable?) that just asks AI to ipck from a tool, and use that tool.
• if the ai knowsn the answer but should still pick a tool, have it say something like "I think the answer is ____ but Im going to use this tool to confirm"
• As the ai picks tools, show status to the user in a log style output
• Keep history?