Skip to content

celdiniz/aafactory

 
 

Repository files navigation

AI Avatar Factory

⚡ AI Avatar Factory is an interface for creating and managing AI avatars. ⚡

Website Discord

AAFactory Screenshot

Tutorial:

Installation

Install the required packages by running the following commands:

pip install poetry
poetry install

ComfyUI

  • Use Video Helper Suite v1.5.0 (can be selected in ComfyManager)

Run the application

If you use VSCode, you can run the application by clicking on the Run and Debug button and selecting Python: Run and Debug and then Run Gradio UI.

If you don't use VSCode, you can run the application by running the following command:

python aafactory/src/aafactory/create_gradio_ui.py

You will also need:

  • ElevenLabs API key
  • OpenAI API key
  • ComfyUI server URL

For ComfyUI, the worflow is defined in the workflows folder. You need to make sure the nodes are installed. A more detailed guide will be available soon.

Current Tech Stack:

  • Gradio – Frontend

  • ComfyUI – Backend

  • OpenAI API – LLM

  • ElevenLabs – TTS

  • Flux – Text-to-Image (Avatar Generation)

  • Sonic – Audio-Driven Video Generation

More Examples

See our website for more examples: AAFactory.xyz

Incoming Features

  • Add support for Hugging Face models (Text to Speech and Text to Text)
  • Create documentation for ComfyUI cloud hosting
  • Improve ComfyUI cloud hosting setup
  • Enable users to manage several avatars
  • Enable users to easily share avatar's setup with others
  • Add feature to let an avatar react to a Youtube video
  • Add microphone button for direct chat with Avatar

About

⚡ AI Avatar Factory is an interface for creating and managing AI avatars. ⚡

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Python 94.1%
  • Shell 5.9%