Watch LProDreamAll / mini-llm-infra

mini-llm-infra

Watch LProDreamAll / sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

Watch LProDreamAll / mini-sglang

Watch LProDreamAll / sglang-omni

SGLang Omni: High-Performance Multi-Stage Pipeline Framework for Omni Models

Watch LProDreamAll / sub2api

Sub2API 一站式开源中转服务，让 Claude、Openai 、Gemini、Antigravity订阅统一接入，支持拼车共享，更高效分摊成本，原生工具无缝使用。

Watch LProDreamAll / vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Watch LProDreamAll / cuda-study

Watch LProDreamAll / lectures

Watch LProDreamAll / cpp-tutorial

cpp-tutorial

Watch LProDreamAll / langfuse

🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23