noonghunna/club-3090
Community recipes for serving LLMs on RTX 3090/4090/5090 CUDA gpus. Multi-engine (vLLM, llama.cpp, ik_llama) and model-agnostic. Currently shipping Qwen3.6-27B Qwen3.6 35B Gemma 4 26B Gemma 4 31B configs for 1× and 2× cards.
Community recipes for serving LLMs on RTX 3090. Multi-engine (vLLM, llama.cpp, SGLang) and model-agnostic. Currently shipping Qwen3.6-27B configs for 1× and 2× cards.
Apache-2.0 已发布
Python 1598 stars 86 forks 1598 watching 2.8 综合评分
项目简介
Community recipes for serving LLMs on RTX 3090. Multi-engine (vLLM, llama.cpp, SGLang) and model-agnostic. Currently shipping Qwen3.6-27B configs for 1× and 2× cards.
项目信息
- Stars
- 1598
- Forks
- 86
- 语言
- Python
- 协议
- Apache-2.0
- 分类
- ai-ml
- 更新
- 今天
相关项目推荐
G
GFPGAN
GFPGAN aims at developing Practical Algorithms for Real-world Face Restoration.
V
Vane
Vane is an AI-powered answering engine.
1
100-Days-Of-ML-Code
100 Days of ML Coding
y
yzhao062/agent-style
21 writing rules for AI coding and writing agents. Drop-in for Claude Code, Codex, Copilot, Cursor, and Aider, so their output reads like a tech pro.
s
skyvern
Automate browser based workflows with AI
