[Rust] Prototype in-browser serving for small LLMs

[nikg4]

• Understand performance characteristics e.g., latency vs model size, etc
• Potential speedups: GPUs, acceleration, parallelization

Doc link

[nikg4]

See https://github.com/huggingface/candle?tab=readme-ov-file#check-out-our-examples