AudioStreamSpeechWhisper

OpenAI Whisper is a robust offline speech recognition system which runs locally on user device and provides transcription, translation to English, and language recognition of user speech either using a microphone, or by analysing an audio file.

This asset contains native platforms libraries of Whisper.cpp, together with user friendly Editor interface.

This asset also features Voice Activity Detection (VAD) system which is able to adapt to incoming audio and determine when to invoke Whisper recognition automatically - suitable for open mic like scenarios; it's still possible to invoke Whisper manually

Whisper.cpp/Whisper.net - on which this is based upon - do support wide range of platforms, support for WIndows (x86|x64), macOS (both Intel and Apple Silicon), Linux (x64), (recent) Android and iOS are included, Apple Silicon binaries support CoreML.

[additional platforms include e.g. Windows/Linux ARM or tvOS]

It is currently optimized primarily for Apple Silicon (M1 equivalent or better) - but runs elsewhere with higher CPU usage.

For demos please see:

Windows x64 | macOS | Linux (x64) | Android_ChromeOS

Latest documentation is also available here

For support please use Unity forums