Large Language Model Text Generation Inference:
https://github.com/huggingface/text-generation-inference
示例：
https://towardsdatascience.com/serve-large-language-models-from-your-computer-with-text-generation-inference-54f4dd8783a7
LLM TGI框架，Rust/python开发
Previous: 多模态的综述论文
Next: AI 代理的框架，Rust/Python