Новый проект
Nehanth/swarmllm
Every device brings a slice. Together they run the whole model. Peer-to-peer LLM inference across browser tabs: a from-scratch WebGPU engine and a WebRTC runtime that split a 27B model over the devices in a room.
- Stars
- ★ 71
- Forks
- ⑂ 10
- Язык
- JavaScript
- Статус
- В канале 1 янв. 1 г.
AI-разбор
Every device brings a slice. Together they run the whole model. Peer-to-peer LLM inference across browser tabs: a from-scratch WebGPU engine and a WebRTC runtime that split a 27B model over the devices in a room.