[Tutorial] How to setup llama.cpp with AWS EC2 Image Builder

[mcharytoniuk]

I am working on Paddler (stateful llama.cpp load balancer, and I'm making some llama.cpp tutorials along the way).

I specifically wanted to talk about setting up llama.cpp with EC2 Image Builder because that is just one step from using llama.cpp in Auto Scaling and Load Balancers. The tutorial on that is in progress. :)

Setting up llama.cpp on AWS:
https://github.com/distantmagic/paddler/blob/main/infra/tutorial-installing-llamacpp-aws-ec2-image-builder.md

An example Terraform infrastructure files as a reference:
https://github.com/distantmagic/paddler/tree/main/infra/terraform/aws

Let me know what you think!