🛠 Lipflow: Silent Lip-Reading Dictation on Mac

Developer amypretzel released the open-source project Lipflow (GitHub amywork777/lipflow, MIT license): an app for Mac on Apple Silicon where you hold down the right Option key, silently mouth a phrase, and a webcam turns lip movements into text at the cursor position. It works locally, and the model is fine-tuned to your face on 24 silent sentences.

🌍 It shows that visual speech recognition with on-device fine-tuning already works without the cloud: on an M4 Pro, text appears 1–2 seconds after releasing the key.

👤 You can try it for free in an evening: git clone, ./setup.sh (downloads ~1.2 GB of models), calibration takes about 8 minutes. Limitations: English only, macOS 13+, accuracy is unstable — it is noticeably more accurate with a quiet whisper.

Source 1: https://github.com/amywork777/lipflow Source 2: https://x.com/amypretzel/status/2105496934672965669