VLLM| Launched | |
| Pricing Model | Free |
| Starting Price | |
| Tech used | |
| Tag | Software Development,Data Science |
| Launched | 2024-03 |
| Pricing Model | Freemium |
| Starting Price | $19 /mo |
| Tech used | Next.js,Vercel,Gzip,OpenGraph,Webpack,HSTS |
| Tag | Text Analysis,No-Code,Data Analysis |
| Global Rank | |
| Country | |
| Month Visit |
| Global Rank | 11268274 |
| Country | Germany |
| Month Visit | 87 |
Estimated traffic data from Similarweb
EasyLLM - EasyLLM is an open source project that provides helpful tools and methods for working with large language models (LLMs), both open source and closed source. Get immediataly started or check out the documentation.
LLMLingua - To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.
StreamingLLM - Introducing StreamingLLM: An efficient framework for deploying LLMs in streaming apps. Handle infinite sequence lengths without sacrificing performance and enjoy up to 22.2x speed optimizations. Ideal for multi-round dialogues and daily assistants.
LazyLLM - LazyLLM: Low-code for multi-agent LLM apps. Build, iterate & deploy complex AI solutions fast, from prototype to production. Focus on algorithms, not engineering.