Download
Implementation of NWT, audio-to-video generation, in Pytorch. The paper proposes a new discrete latent representation named Memcodes, which can be succinctly described as a type of multi-head hard-attention to learned memory (codebook) key/values. They claim the need for less codes and smaller codebook dimensions in order to achieve better reconstructions.
Features
- Implementation of NWT
- Audio-to-video generation
- For Pytorch
- Multi-head hard-attention to learned memory (codebook) key / values
- Smaller codebook dimension
- Achieve better reconstructions
Project Samples
License
MIT LicenseFollow NWT - Pytorch (wip)
Other Useful Business Software
Gen AI apps are built with MongoDB Atlas
MongoDB Atlas is the developer-friendly database used to build, scale, and run gen AI and LLM-powered apps—without needing a separate vector database. Atlas offers built-in vector search, global availability across 115+ regions, and flexible document modeling. Start building AI apps faster, all in one place.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of NWT - Pytorch (wip)!