VoiceBox

VoiceBox: A Unified AI Services Framework for Unity

VoiceBox is a flexible and extensible framework for integrating various AI services into your Unity projects. It provides a unified interface for interacting with different AI APIs, allowing you to easily switch between services and add new ones.

Features

• Unified Service Interfaces: Common interfaces for Chat, Speech-to-Text (STT), and Text-to-Speech (TTS) services.
• Service Agnostic: Easily switch between different AI service providers without changing your core application logic.
• Configuration via ScriptableObjects: Easily configure model selections, service endpoints, audio devices, and other settings in the Unity Editor.
• Audio Streaming Support: Built-in support for streaming audio for TTS, reducing latency and improving user experience.
• Extensible: Designed to be easily extended with new AI services and functionalities.
• Modding Support: Built with game modding applications in mind, providing utilities to make mod creation just as seamless as inside the Unity editor.

Natively Supported Services

• Chat

• Google Gemini
• ChatGPT
• Anthropic
• Ollama
• Deepseek (via Ollama)

• Speech to Text

• Azure Speech services
• Elevenlabs Scribe
• Whisper via WhisperLive

• Text to Speech

• Elevenlabs

Docs

You can find the docs here: https://voicebox.timshaw.dev/