⚡ AI Avatar Factory is an interface for creating and managing AI avatars. ⚡
- Youtube tutorial: https://www.youtube.com/watch?v=MGmBf7OsFJk
Install the required packages by running the following commands:
pip install poetrypoetry install- Use Video Helper Suite v1.5.0 (can be selected in ComfyManager)
If you use VSCode, you can run the application by clicking on the Run and Debug button and selecting Python: Run and Debug and then Run Gradio UI.
If you don't use VSCode, you can run the application by running the following command:
python aafactory/src/aafactory/create_gradio_ui.pyYou will also need:
- ElevenLabs API key
- OpenAI API key
- ComfyUI server URL
For ComfyUI, the worflow is defined in the workflows folder. You need to make sure the nodes are installed. A more detailed guide will be available soon.
-
Gradio – Frontend
-
ComfyUI – Backend
-
OpenAI API – LLM
-
ElevenLabs – TTS
-
Flux – Text-to-Image (Avatar Generation)
-
Sonic – Audio-Driven Video Generation
See our website for more examples: AAFactory.xyz
- Add support for Hugging Face models (Text to Speech and Text to Text)
- Create documentation for ComfyUI cloud hosting
- Improve ComfyUI cloud hosting setup
- Enable users to manage several avatars
- Enable users to easily share avatar's setup with others
- Add feature to let an avatar react to a Youtube video
- Add microphone button for direct chat with Avatar
