Tuning scripts using Hugging Face `SFTTrainer`

AllenAI's post-training codebase

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.

An Open Source Machine Learning Framework for Everyone

Tensors and Dynamic neural networks in Python with strong GPU acceleration

Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

Prompt Declaration Language (PDL) is a declarative prompt programming language.

Estimate resources needed to train LLMs

Scan resources consumed during LLM training

standalone deepspeed backend

InstructLab Command-Line Interface. Use this to chat with a model and execute the InstructLab workflow to train a model using custom taxonomy data.

Train transformer language models with reinforcement learning.

Taxonomy tree that will allow you to create models tuned with your data

InstructLab GitHub organization community files.

A guidance language for controlling large language models.

Repository for hosting binary images for move2kube website (source in gh-pages branch in move2kube repo)

cloud-object-storage

OpenShift Cluster Console UI

Repository for storing Move2Kube custom transformers

Move2Kube is a command-line tool that accelerates the process of re-platforming to Kubernetes/Openshift.

OpenShift 3 and 4 product and community documentation

A cli to access konveyor tools

Brew formula for Move2Kube

Tutorials and demos related to move2kube