Back to Projects
productioncommunity
Avatars
Emotion-Aware AI Companion
Local, privacy-first emotion-aware chatbot with synchronized 3D avatar. Detects emotions from voice (Whisper) and facial expressions (MediaPipe), adapts LLM responses, avatar lip-syncs TTS output. Four distinct AI personas.
Architecture
- Multimodal emotion detection from voice (Whisper) and facial expressions (MediaPipe)
- Adaptive LLM responses based on detected emotional state
- 3D avatar with real-time lip-sync to TTS output
- Four personas with distinct conversation styles
- Cross-platform with ONNX Runtime for mobile (Android/iOS)
- Privacy-first — all processing runs locally
Technologies
Evidence & Impact
- 01Multimodal emotion detection
- 02Four AI personas
- 03Cross-platform deployment
Related Projects
Interested in This Project?
Want to collaborate, contribute, or sponsor this community project? Let's connect and explore possibilities.