moeru-ai/airi

winget install MoeruAI.AIRI

scoop bucket add airi https://github.com/moeru-ai/airi
scoop install airi/airi

brew install --cask airi

Have you dreamed about having a cyber living being (cyber waifu, digital pet) or digital companion that could play with and talk to you?

With the power of modern large language models like ChatGPT and famous Claude, asking a virtual being to roleplay and chat with us is already easy enough for everyone. Platforms like Character.ai (a.k.a. c.ai) and JanitorAI as well as local playgrounds like SillyTavern are already good-enough solutions for a chat based or visual adventure game like experience.

Perhaps you know Neuro-sama already. She is currently the best virtual streamer capable of playing games, chatting, and interacting with you and the participants. Some also call this kind of being "digital human." Sadly, as it's not open sourced, you cannot interact with her after her live streams go offline.

Therefore, this project, AIRI, offers another possibility here: let you own your digital life, cyber living, easily, anywhere, anytime.

Recent DevLogs & Stories

• DevLog @ 2026.03.23: Mobile performance and game engine exploration - March 23, 2026
• DevLog @ 2026.03.14: VRM stage lifecycle, cache, and observability - March 14, 2026
• DevLog @ 2026.02.16: Dome Keeper data collection and training pipeline - February 16, 2026
• DevLog @ 2026.01.01: AIRI Pocket and FlowChat memory experiments - January 1, 2026
• DevLog @ 2025.10.20: Electron migration, new models, and Moeru AI updates - October 20, 2025
• DevLog @ 2025.08.26: Pure vision progress for airi-factorio - August 26, 2025
• DevLog @ 2025.08.05: AIRI v0.7 release highlights - August 5, 2025
• DevLog @ 2025.08.01: Streaming text animation and grapheme clusters - August 1, 2025
• DevLog @ 2025.07.18: Rethinking airi-factorio with Factorio Learning Environment - July 18, 2025
• DreamLog 0x1: The backstory of Project AIRI - June 16, 2025
• More on the documentation site

What's So Special About This Project?

Unlike the other AI driven VTuber open source projects, アイリ was built with support of many Web technologies such as WebGPU, WebAudio, Web Workers, WebAssembly, WebSocket, etc. from the first day.

This means that アイリ is capable of running on modern browsers and devices and even on mobile devices (already done with PWA support). This brings a lot of possibilities for us (the developers) to build and extend the power of アイリ VTuber to the next level, while still leaving the flexibility for users to enable features that require TCP connections or other non-Web technologies such as connecting to a Discord voice channel or playing Minecraft and Factorio with friends.

Current Progress & Roadmap

Capable of

• [x] Brain- [x] Play [Minecraft](https://www.minecraft.net) - [x] Play [Factorio](https://www.factorio.com) (WIP, but [PoC and demo available](https://github.com/moeru-ai/airi-factorio)) - [x] Play [Kerbal Space Program](https://www.kerbalspaceprogram.com/) (announcement TBD) - [ ] Co-play [Helldivers 2](https://www.playstation.com/en-hk/games/helldivers-2/pc/) (WIP) - [x] Chat in [Telegram](https://telegram.org) - [x] Chat in [Discord](https://discord.com) - [ ] Memory - [x] Pure in-browser database support (DuckDB WASM | `pglite`) - [ ] Memory Alaya (WIP) - [ ] Pure in-browser local (WebGPU) inference
• [x] Ears- [x] Audio input from browser - [x] Audio input from [Discord](https://discord.com) - [x] Client side speech recognition - [x] Client side talking detection
• [x] Mouth- [x] Multi-provider voice synthesis, including [ElevenLabs](https://elevenlabs.io/), Microsoft/Azure Speech, OpenAI-compatible TTS, Alibaba Cloud Model Studio, and local Kokoro TTS
• [x] Body- [x] VRM support - [x] Control VRM model - [x] VRM model animations - [x] Auto blink - [x] Auto look at - [x] Idle eye movement - [x] Live2D support - [x] Control Live2D model - [x] Live2D model animations - [x] Auto blink - [x] Auto look at - [x] Idle eye movement

Development

pnpm i
pnpm dev

Stage Web (Browser Version at airi.moeru.ai)

pnpm dev

Stage Tamagotchi (Desktop Version)

pnpm dev:tamagotchi

A Nix package for Tamagotchi is included. To run airi with Nix, first make sure to enable flakes, then run:

nix run github:moeru-ai/airi

NixOS

Electron requires shared libraries that aren't in standard paths on NixOS. Use the FHS shell defined in flake.nix:

nix develop .#fhs
pnpm dev:tamagotchi

Stage Pocket (Mobile Version)

Start the development server for the capacitor:

pnpm dev:pocket:ios --target <DEVICE_ID_OR_SIMULATOR_NAME>
# Or
CAPACITOR_DEVICE_ID_IOS=<DEVICE_ID_OR_SIMULATOR_NAME> pnpm dev:pocket:ios

You can see the list of available devices and simulators by running pnpm exec cap run ios --list.

If you need to connect server channel on pocket in wireless mode, you need to start tamagotchi as root:

sudo pnpm dev:tamagotchi

Then enable secure websocket in tamagotchi settings/connections.

Documentation Site

pnpm dev:docs

Publish

Run bumpp to update the monorepo version:

npx bumpp --no-commit --no-tag

Support of LLM API Providers (powered by xsai)

• [x] AIHubMix (recommended)
• [x] OpenRouter
• [x] vLLM
• [x] SGLang
• [x] Ollama
• [x] 302.AI (sponsored)
• [x] OpenAI- [x] [Azure OpenAI API](https://learn.microsoft.com/en-us/azure/ai-services/openai/reference)
• [x] Anthropic Claude- [ ] [AWS Claude](https://docs.anthropic.com/en/api/claude-on-amazon-bedrock) (PR welcome)
• [x] DeepSeek
• [x] Qwen
• [x] Google Gemini
• [x] xAI
• [x] Groq
• [x] Mistral
• [x] Cloudflare Workers AI
• [x] Together.ai
• [x] Fireworks.ai
• [x] Novita
• [x] Zhipu
• [x] SiliconFlow
• [x] Stepfun
• [x] Baichuan
• [x] Minimax
• [x] Moonshot AI
• [x] ModelScope
• [x] Player2
• [x] Tencent Cloud
• [ ] Sparks (PR welcome)
• [ ] Volcano Engine (PR welcome)
• [x] Xiaomi Mimo

Sub-projects Born from This Project

• Awesome AI VTuber: A curated list of AI VTubers and related projects
• unspeech: Universal endpoint proxy server for /audio/transcriptions and /audio/speech, like LiteLLM but for any ASR and TTS
• hfup: tools to help on deploying, bundling to HuggingFace Spaces
• xsai-transformers: Experimental 🤗 Transformers.js provider for xsAI.
• WebAI: Realtime Voice Chat: Full example of implementing ChatGPT's realtime voice from scratch with VAD + STT + LLM + TTS.
• @proj-airi/drizzle-duckdb-wasm: Drizzle ORM driver for DuckDB WASM
• @proj-airi/duckdb-wasm: Easy to use wrapper for @duckdb/duckdb-wasm
• AIRI Factorio: Allow AIRI to play Factorio.
• AIRI DomeKeeper: Allow AIRI to play DomeKeeper.
• Factorio RCON API: RESTful API wrapper for Factorio headless server console
• autorio: Factorio automation library
• tstl-plugin-reload-factorio-mod: Reload Factorio mod when developing
• Velin: Use Vue SFC and Markdown to write easy to manage stateful prompts for LLM
• demodel: Easily boost the speed of pulling your models and datasets from various of inference runtimes.
• inventory: Centralized model catalog and default provider configurations backend service
• MCP Launcher: Easy to use MCP builder & launcher for all possible MCP servers, just like Ollama for models!
• 🥺 SAD: Documentation and notes for self-host and browser running LLMs.

%%{ init: { 'flowchart': { 'curve': 'catmullRom' } } }%%

flowchart TD
  Core("Core")
  Unspeech("unspeech")
  DBDriver("@proj-airi/drizzle-duckdb-wasm")
  MemoryDriver("[WIP] Memory Alaya")
  DB1("@proj-airi/duckdb-wasm")
  SVRT("@proj-airi/server-runtime")
  Memory("Memory")
  STT("STT")
  Stage("Stage")
  StageUI("@proj-airi/stage-ui")
  UI("@proj-airi/ui")

  subgraph AIRI
    DB1 --> DBDriver --> MemoryDriver --> Memory --> Core
    UI --> StageUI --> Stage --> Core
    Core --> STT
    Core --> SVRT
  end

  subgraph UI_Components
    UI --> StageUI
    UITransitions("@proj-airi/ui-transitions") --> StageUI
    UILoadingScreens("@proj-airi/ui-loading-screens") --> StageUI
    FontCJK("@proj-airi/font-cjkfonts-allseto") --> StageUI
    FontXiaolai("@proj-airi/font-xiaolai") --> StageUI
  end

  subgraph Apps
    Stage --> StageWeb("@proj-airi/stage-web")
    Stage --> StageTamagotchi("@proj-airi/stage-tamagotchi")
    Core --> RealtimeAudio("@proj-airi/realtime-audio")
    Core --> PromptEngineering("@proj-airi/playground-prompt-engineering")
  end

  subgraph Server_Components
    Core --> ServerSDK("@proj-airi/server-sdk")
    ServerShared("@proj-airi/server-shared") --> SVRT
    ServerShared --> ServerSDK
  end

  STT -->|Speaking| Unspeech
  SVRT -->|Playing Factorio| F_AGENT
  SVRT -->|Playing Minecraft| MC_AGENT

  subgraph Factorio_Agent
    F_AGENT("Factorio Agent")
    F_API("Factorio RCON API")
    factorio-server("factorio-server")
    F_MOD1("autorio")

    F_AGENT --> F_API -.-> factorio-server
    F_MOD1 -.-> factorio-server
  end

  subgraph Minecraft_Agent
    MC_AGENT("Minecraft Agent")
    Mineflayer("Mineflayer")
    minecraft-server("minecraft-server")

    MC_AGENT --> Mineflayer -.-> minecraft-server
  end

  XSAI("xsAI") --> Core
  XSAI --> F_AGENT
  XSAI --> MC_AGENT

  Memory_PGVector("@proj-airi/memory-pgvector") --> Memory

  style Core fill:#f9d4d4,stroke:#333,stroke-width:1px
  style AIRI fill:#fcf7f7,stroke:#333,stroke-width:1px
  style UI fill:#d4f9d4,stroke:#333,stroke-width:1px
  style Stage fill:#d4f9d4,stroke:#333,stroke-width:1px
  style UI_Components fill:#d4f9d4,stroke:#333,stroke-width:1px
  style Server_Components fill:#d4e6f9,stroke:#333,stroke-width:1px
  style Apps fill:#d4d4f9,stroke:#333,stroke-width:1px
  style Factorio_Agent fill:#f9d4f2,stroke:#333,stroke-width:1px
  style Minecraft_Agent fill:#f9d4f2,stroke:#333,stroke-width:1px

  style DBDriver fill:#f9f9d4,stroke:#333,stroke-width:1px
  style MemoryDriver fill:#f9f9d4,stroke:#333,stroke-width:1px
  style DB1 fill:#f9f9d4,stroke:#333,stroke-width:1px
  style Memory fill:#f9f9d4,stroke:#333,stroke-width:1px
  style Memory_PGVector fill:#f9f9d4,stroke:#333,stroke-width:1px

Similar Projects

Open sourced ones

• kimjammer/Neuro: A recreation of Neuro-Sama originally created in 7 days.: very well completed implementation.
• SugarcaneDefender/z-waif: Great at gaming, autonomous, and prompt engineering
• semperai/amica: Great at VRM, WebXR
• elizaOS/eliza: Great examples and software engineering on how to integrate agent into various of systems and APIs
• ardha27/AI-Waifu-Vtuber: Great about Twitch API integrations
• InsanityLabs/AIVTuber: Nice UI and UX
• IRedDragonICY/vixevia
• t41372/Open-LLM-VTuber
• PeterH0323/Streamer-Sales

Non-open-sourced ones

• https://clips.twitch.tv/WanderingCaringDeerDxCat-Qt55xtiGDSoNmDDr https://www.youtube.com/watch?v=8Giv5mupJNE
• https://clips.twitch.tv/TriangularAthleticBunnySoonerLater-SXpBk1dFso21VcWD
• https://www.youtube.com/@NOWA_Mirai

Project Status

Acknowledgements

• Reka UI: for designing the documentation site, the new landing page is based on this, as well as implementing a massive amount of UI components. (shadcn-vue is using Reka UI as the headless, do checkout!)
• pixiv/ChatVRM
• josephrocca/ChatVRM-js: A JS conversion/adaptation of parts of the ChatVRM (TypeScript) code for standalone use in OpenCharacters and elsewhere
• Design of UI and style was inspired by Cookard, UNBEATABLE, and Sensei! I like you so much!, and artworks of Ayame by Mercedes Bazan with Wish by Mercedes Bazan
• mallorbc/whisper_mic
• xsai: Implemented a decent amount of packages to interact with LLMs and models, like Vercel AI SDK but way small.

Supporters

Special Thanks

Special thanks to all contributors for their contributions to Project AIRI ❤️

Star History