Noa — Always-On Speech-to-Text for Frame AR Glasses

A Flutter app for Brilliant Labs Frame AR glasses that provides real-time, always-on speech-to-text transcription displayed directly on the Frame's heads-up display.

What it does

Noa continuously listens through the Frame's microphone, transcribes speech in real-time using Deepgram, and displays the text on the Frame's AR display with speaker diarization (color-coded by speaker).

The app also supports a tap-to-query mode where tapping the glasses captures audio and a photo, sends them to an AI backend, and displays the response on the Frame.

Getting started

1. Ensure you have Xcode and/or Android Studio correctly set up for app development

2. Install Flutter

3. Clone this repository

   git clone https://github.com/Kajabi/noa-flutter.git
   cd noa-flutter

4. Get the required packages

   flutter pub get

5. Copy .env.template to .env and populate it with your API keys

   cp .env.template .env

6. Connect your phone and run the app

   flutter run --release

Hardware requirements

• Brilliant Labs Frame AR glasses
• iOS or Android device with Bluetooth LE support