WeiQing Chen

代表作品 / 项目

• vllm-omni⭐ 7046A framework for efficient model inference with omni-modality models
• vllm⭐ 7A high-throughput and memory-efficient inference and serving engine for LLMs
• github-status-monitor⭐ 5
• LM-service⭐ 4
• vllm-ascend⭐ 4Community maintained hardware plugin for vLLM on Ascend