Performant Architecture for a Fast Gen AI User Experience

[nokenwa]

Abstract

More and more developers are being asked to build Generative AI experiences into their web applications everywhere. However, the user's experience with Generative AI can sometimes be slow and frustrating. It’s been years since we would gladly wait over 10 seconds for a response to anything online. As AI processing gets faster, there are new limiting factors that could be negatively affecting your AI user experience.

In this talk, we will cover different ways to minimise laggy experiences in web applications when interacting with third-party Generative AI tools. We’ll be using a practical demonstration to show how you can reduce latency as we build one of my favourite sci fi gadgets, the babel fish.

About Me

Nathaniel is a Developer Evangelist at Twilio working to create magical moments for developers with their products. His life goals are to have Batman's brains, Deadpool's humour, T'Challa's fashion sense, Killmonger's Wokeness, and Thanos' determination! He serves the Javascript community in the UK and the rest of Europe

• I confirm that I will abide by the Code of Conduct

• I confirm my talk is 20 mins long in total.

[admataz]

Hey @nokenwa - thanks for the talk proposal. This is a much needed topic that needs covering. From what I've seen it's an endless tech cycle - new advances and capabilities that our current patterns don't deal with, degrading the UX. Then we catch up with new patterns and inventions. Look forward hearing how we can be using our tools to make better UX for the genAI experience.

I have you confirmed for 23rd October - hope that still suits?

[admataz]

Hey @nokenwa - I hope you are well?

I'm picking up LNUG where we left off nearly a year ago - would you be interested in bringing your talk - or an updated version (given the topic)

It's been a helluva year - and glad to be back to normal. We have a date and venue for 24 September - and are planning for October and November too. Hopefully see you at at least one of these?