diff --git a/README.md b/README.md index cb4e1ff..120aee4 100644 --- a/README.md +++ b/README.md @@ -283,6 +283,7 @@ If you're interested in the field of LLM, you may find the above list of milesto ## LLM Deployment > Reference: [llm-inference-solutions](https://github.com/mani-kantap/llm-inference-solutions) +- [Helicone](https://github.com/Helicone/helicone) - One-line integration for LLM observability, experimentation, prompt tracking and more. - [SGLang](https://github.com/sgl-project/sglang) - SGLang is a fast serving framework for large language models and vision language models. - [vLLM](https://github.com/vllm-project/vllm) - A high-throughput and memory-efficient inference and serving engine for LLMs. - [TGI](https://huggingface.co/docs/text-generation-inference/en/index) - a toolkit for deploying and serving Large Language Models (LLMs).