AudioBench: A Universal Benchmark for Audio Large Language Models

An Open Source Python alternative to NotebookLM's podcast feature: Transforming Multimodal Content into Captivating Multilingual Audio Conversations with GenAI

ALT research group publications

The open source code for LLM-Codec

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

Official repository of the xLSTM.

This repo contains the code for "Voice Disorder Analysis: A Transformer-based Approach"

Code for "AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling"

Scripts for computing the Intelligibility and CLVP scores for evaluating TTS models

The official repository of Dynamic-SUPERB.

This is the code for the SpeechTokenizer presented in the SpeechTokenizer: Unified Speech Tokenizer for Speech Language Models. Samples are presented on

A spoken version of the textual story cloze benchmark

NeMo: a toolkit for conversational AI

Welcome to the Real-Time Voice Activity Detection (VAD) program, powered by Silero-VAD model! 🚀 This program allows you to perform live voice activity detection, detecting when there is speech pres…

An experimental open-source attempt to make GPT-4 fully autonomous.

API for interacting with ChatGPT and GPT4 using Python and from Shell.

🐙 Guides, papers, lecture, notebooks and resources for prompt engineering

This repo is meant to serve as a guide for Machine Learning/AI technical interviews.

tmux source code

Dataset for training machine learning model for automatically generating psychiatric case notes from doctor-patient conversations.

IWSLT 2022 Dialectal Speech Translation Shared Task

Dataset of 57 mock medical primary care consultations: audio, consultation notes, human utterance-level transcripts.