Reproducible, flexible LLM evaluations

A framework for few-shot evaluation of language models.

Taxonomy tree that will allow you to create models tuned with your data

Read only repo for hosting knowledge contribution related documents in user's own account.

A package dedicated for running benchmark agreement testing

LlamaIndex (formerly GPT Index) is a data framework for your LLM applications

HELM for hidden dataset eval

Holistic Evaluation of Language Models (HELM), a framework to increase the transparency of language models (https://arxiv.org/abs/2211.09110).

Website for NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1 GPU + 1 Day

NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day

NOTES FROM READING

Experiments with Deep Learning