NEW: Real-time conversational AI models can now run 100% locally in your browser! ๐คฏ
๐ Privacy by design (no data leaves your device) ๐ฐ Completely free... forever ๐ฆ Zero installation required, just visit a website โก๏ธ Blazingly-fast WebGPU-accelerated inference
For those interested, here's how it works: - Silero VAD for voice activity detection - Whisper for speech recognition - SmolLM2-1.7B for text generation - Kokoro for text to speech
Powered by Transformers.js and ONNX Runtime Web! ๐ค I hope you like it!
Have you tried out ๐ค Transformers.js v3? Here are the new features: โก WebGPU support (up to 100x faster than WASM) ๐ข New quantization formats (dtypes) ๐ 120 supported architectures in total ๐ 25 new example projects and templates ๐ค Over 1200 pre-converted models ๐ Node.js (ESM + CJS), Deno, and Bun compatibility ๐ก A new home on GitHub and NPM