Новый проект
truespar/paddock
Native Rust inference server for open models on NVIDIA GPUs. OpenAI- and Anthropic-compatible APIs, GGUF + safetensors, FP8/NVFP4/MXFP4/Q8/Q4, built-in Studio
- Stars
- ★ 38
- Forks
- ⑂ 4
- Язык
- Rust
- Статус
- В канале 1 янв. 1 г.
AI-разбор
Native Rust inference server for open models on NVIDIA GPUs. OpenAI- and Anthropic-compatible APIs, GGUF + safetensors, FP8/NVFP4/MXFP4/Q8/Q4, built-in Studio