Prompt caching

[ebudmada]

Can we do prompt caching with ell ?

[gwpl]

Can we do prompt caching with ell ?

To not be confused, some providers offer prompt caching on server side. I guess that's not what you think?

If you want to cache function calls in your script, then it's library independent I guess?

Have you gave a shot to classical Memoization approaches if they work for you:
https://stackoverflow.com/questions/1988804/what-is-memoization-and-how-can-i-use-it-in-python
like functools.cache , DIY @memoize decorators,

[gwpl]

cross-linking: #389