# OpenAvatarChat

**Repository Path**: renges/OpenAvatarChat

## Basic Information

- **Project Name**: OpenAvatarChat
- **Description**: Open Avatar Chat 是一个模块化的交互数字人对话实现，能够在单台PC上运行完整功能。
- **Primary Language**: Unknown
- **License**: Apache-2.0
- **Default Branch**: main
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 13
- **Created**: 2026-04-15
- **Last Updated**: 2026-04-15

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

<h1 style='text-align: center; margin-bottom: 1rem'> Open Avatar Chat </h1>

<p align="center">
<strong>中文 | <a href="readme_en.md">English</a></strong>
</p>

<p align="center">
<strong>模块化的交互数字人对话实现。</strong>
</p>

<p align="center" style="display: flex; flex-direction: row; justify-content: center">
 🤗 <a href="https://huggingface.co/spaces/HumanAIGC-Engineering-Team/open-avatar-chat">Demo</a>&nbsp&nbsp|&nbsp&nbsp<img alt="Static Badge" style="height: 10px;" src="./assets/images/modelscope_logo.png"> <a href="https://www.modelscope.cn/studios/HumanAIGC-Engineering/open-avatar-chat">Demo</a>&nbsp&nbsp|&nbsp&nbsp💬 <a href="https://github.com/HumanAIGC-Engineering/OpenAvatarChat/blob/main/assets/images/community_wechat.png">WeChat (微信)</a>&nbsp&nbsp|&nbsp&nbsp📖 <a href="https://humanaigc-engineering.github.io/OpenAvatarChat/">文档</a>
</p>

## 💡 核心亮点

- **多模态交互支持**：支持文本、语音、视频等多种交互方式，提供自然流畅的人机对话体验
- **模块化架构设计**：采用高度模块化设计，可灵活替换 ASR、LLM、TTS、Avatar 等核心组件
- **多样数字人形象**：支持 LiteAvatar、LAM、MuseTalk、FlashHead 等多种数字人技术
- **低延迟优化**：通过 VAD 检测、语音缓冲、帧率控制等机制优化，平均响应时间仅 2.2 秒

## 📢 最新动态

- [2026.04] ⭐️⭐️⭐️ 版本 0.6.0发布:
  - 架构重构，前后端分离，前端仓库 [OpenAvatarChat-WebUI](https://github.com/HumanAIGC-Engineering/OpenAvatarChat-WebUI)
  - 所有数字人均支持手动打断和双工打断模式
  - 优化安装部署和模型下载流程，统一依赖管理和模型下载脚本
  - 接入 [SoulX-FlashHead](https://github.com/Soul-AILab/SoulX-FlashHead) 数字人，基于扩散模型的实时流式说话头生成
- [2025.08.19] ⭐️⭐️⭐️ 版本 0.5.1发布:
  - LiteAvatar支持单机多session
  - 增加对 Qwen-Omni多模态模型的支持

> 📋 [完整更新日志](https://humanaigc-engineering.github.io/OpenAvatarChat/releases/release-notes)

## Demo

### 在线体验

我们部署在
<a href="https://www.modelscope.cn/studios/HumanAIGC-Engineering/open-avatar-chat" target="_blank">ModelScope</a>
和
<a href="https://huggingface.co/spaces/HumanAIGC-Engineering-Team/open-avatar-chat" target="_blank">HuggingFace</a>
上均部署了体验服务，欢迎体验。

### 视频
<table>
  <tr>
    <td align="center">
      <h3>LiteAvatar</h3>
      <video controls src="https://github.com/user-attachments/assets/e2861200-84b0-4c7a-93f0-f46268a0878b"></video>
    </td>
    <td align="center">
      <h3>LAM</h3>
      <video controls src="https://github.com/user-attachments/assets/a72a8c33-39dd-4656-a4a9-b76c5487c711"></video>
    </td>
  </tr>
</table>

## 组件依赖

| 类型       | 开源项目                                |Github地址|模型地址|
|----------|-------------------------------------|---|---|
| RTC      | HumanAIGC-Engineering/gradio-webrtc |[<img src="https://img.shields.io/badge/github-white?logo=github&logoColor=black"/>](https://github.com/HumanAIGC-Engineering/gradio-webrtc)||
| WebUI      | HumanAIGC-Engineering/OpenAvatarChat-WebUI |[<img src="https://img.shields.io/badge/github-white?logo=github&logoColor=black"/>](https://github.com/HumanAIGC-Engineering/OpenAvatarChat-WebUI)||
| VAD      | snakers4/silero-vad                 |[<img src="https://img.shields.io/badge/github-white?logo=github&logoColor=black"/>](https://github.com/snakers4/silero-vad)||
| Avatar   | HumanAIGC/lite-avatar               |[<img src="https://img.shields.io/badge/github-white?logo=github&logoColor=black"/>](https://github.com/HumanAIGC/lite-avatar)||
| TTS      | FunAudioLLM/CosyVoice               |[<img src="https://img.shields.io/badge/github-white?logo=github&logoColor=black"/>](https://github.com/FunAudioLLM/CosyVoice)||
|Avatar|aigc3d/LAM_Audio2Expression|[<img src="https://img.shields.io/badge/github-white?logo=github&logoColor=black"/>](https://github.com/aigc3d/LAM_Audio2Expression)|[🤗](https://huggingface.co/3DAIGC/LAM_audio2exp)|
||facebook/wav2vec2-base-960h||[🤗](https://huggingface.co/facebook/wav2vec2-base-960h)&nbsp;&nbsp;[<img src="./assets/images/modelscope_logo.png" width="20px"></img>](https://modelscope.cn/models/AI-ModelScope/wav2vec2-base-960h)|
|Avatar|TMElyralab/MuseTalk|[<img src="https://img.shields.io/badge/github-white?logo=github&logoColor=black"/>](https://github.com/TMElyralab/MuseTalk)||
|Avatar|Soul-AILab/SoulX-FlashHead|[<img src="https://img.shields.io/badge/github-white?logo=github&logoColor=black"/>](https://github.com/Soul-AILab/SoulX-FlashHead)|[🤗](https://huggingface.co/Soul-AILab/SoulX-FlashHead-1_3B)|
||||||

## 🚀 快速开始

```bash
# 克隆项目
git clone https://github.com/HumanAIGC-Engineering/OpenAvatarChat.git
cd OpenAvatarChat
git submodule update --init --recursive --depth 1

# 安装依赖（以 LiteAvatar + 百炼 API 为例）
uv run install.py --config config/chat_with_openai_compatible_bailian_cosyvoice.yaml

# 下载模型
uv run scripts/download_models.py --handler liteavatar

# 启动
uv run src/demo.py --config config/chat_with_openai_compatible_bailian_cosyvoice.yaml
```

> 📖 详细步骤请参阅[快速开始文档](https://humanaigc-engineering.github.io/OpenAvatarChat/getting-started/)

## 预置模式

| CONFIG名称 | ASR | LLM | TTS | AVATAR |
|----------------------------------------------------|-----|:---------:|:---------:|------------|
| chat_with_lam.yaml | SenseVoice | API | API | LAM |
| chat_with_qwen_omni.yaml | Qwen-Omni | Qwen-Omni | Qwen-Omni | lite-avatar |
| chat_with_openai_compatible_bailian_cosyvoice.yaml | SenseVoice | API | API | lite-avatar |
| chat_with_openai_compatible_bailian_cosyvoice_flashhead.yaml | SenseVoice | API | API | FlashHead |
| chat_with_openai_compatible_bailian_cosyvoice_flashhead_duplex.yaml | SenseVoice | API | API | FlashHead (双工) |
| chat_with_openai_compatible_bailian_cosyvoice_flashhead_duplex_agent.yaml | SenseVoice | **Agent** | API | FlashHead (双工+Agent) Beta |

> 📖 [查看全部预置模式](https://humanaigc-engineering.github.io/OpenAvatarChat/reference/preset-modes)

## 🧪 Beta 功能

### Chat Agent 模式（OpenClaw 集成）

> [!WARNING]
> 此功能目前处于 **Beta** 阶段，API 和配置格式可能随时变化。

Chat Agent 模式使用多轮工具调用 Agent 替代传统 LLM Handler，为数字人提供：

- **工具调用**：多轮调用工具（获取时间、系统信息等）
- **人格与长期记忆**：通过 OpenClaw 的 Agent Profile 赋予数字人持久人格
- **对话上下文压缩**：自动压缩过长的对话历史
- **后台任务协作**：通过 OpenClaw 在后台执行复杂任务
- **视觉感知**：结合 PerceptionAgent 处理摄像头输入

> 📖 [查看完整 Chat Agent 文档](https://humanaigc-engineering.github.io/OpenAvatarChat/beta/chat-agent)

## 社区

* 微信群

<img alt="community_wechat.png" height="200" src="https://github.com/HumanAIGC-Engineering/OpenAvatarChat/blob/main/assets/images/community_wechat.png" width="200"/>

* 官方视频教程：[Bilibili](https://www.bilibili.com/video/BV1sv8QzLEC2)
* 🚨 [常见问题](https://humanaigc-engineering.github.io/OpenAvatarChat/community/faq)

## 社区贡献-感谢

- 感谢社区热心同学"十字鱼"在B站上发布的一键安装包视频 [一键包](https://www.bilibili.com/video/BV1V1oLYmEu3/?vd_source=29463f5b63a3510553325ba70f325293)
- 感谢社区热心同学"W&H"提供的夸克一键包[windows版本:提取码a79V](https://pan.quark.cn/s/237177126010) 和 [linux 版本:提取码：E8Kq](https://pan.quark.cn/s/b7fcdc157586)
- 感谢社区热心同学"W&H"提供的源码zip[夸克网盘:提取码 9iNy](https://pan.quark.cn/s/9e6156cafacd) 和 [百度云盘:提取码：xrxr](https://pan.baidu.com/s/16-0OBtSD5cBz2gJDJORW7w)

## Star历史

![](https://api.star-history.com/svg?repos=HumanAIGC-Engineering/OpenAvatarChat&type=Date)

## 引用

如果您在您的研究/项目中感到 OpenAvatarChat 为您提供了帮助，期待您能给一个 Star⭐和引用✏️

```
@software{avatarchat2025,
  author = {Gang Cheng, Tao Chen, Feng Wang, Binchao Huang, Hui Xu, Guanqiao He, Yi Lu, Shengyin Tan},
  title = {OpenAvatarChat},
  year = {2025},
  publisher = {GitHub},
  url = {https://github.com/HumanAIGC-Engineering/OpenAvatarChat}
}
```