Skip to content

Commit 665c489

Browse files
authored
[Docs] Add GPTBigCode to supported models (vllm-project#213)
1 parent 298695b commit 665c489

File tree

2 files changed

+5
-1
lines changed

2 files changed

+5
-1
lines changed

README.md

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -42,7 +42,8 @@ vLLM is flexible and easy to use with:
4242
vLLM seamlessly supports many Huggingface models, including the following architectures:
4343

4444
- GPT-2 (`gpt2`, `gpt2-xl`, etc.)
45-
- GPTNeoX (`EleutherAI/gpt-neox-20b`, `databricks/dolly-v2-12b`, `stabilityai/stablelm-tuned-alpha-7b`, etc.)
45+
- GPT BigCode (`bigcode/starcoder`, `bigcode/gpt_bigcode-santacoder`, etc.)
46+
- GPT-NeoX (`EleutherAI/gpt-neox-20b`, `databricks/dolly-v2-12b`, `stabilityai/stablelm-tuned-alpha-7b`, etc.)
4647
- LLaMA (`lmsys/vicuna-13b-v1.3`, `young-geng/koala`, `openlm-research/open_llama_13b`, etc.)
4748
- OPT (`facebook/opt-66b`, `facebook/opt-iml-max-30b`, etc.)
4849

docs/source/models/supported_models.rst

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -17,6 +17,9 @@ Alongside each architecture, we include some popular models that use it.
1717
* - :code:`GPT2LMHeadModel`
1818
- GPT-2
1919
- :code:`gpt2`, :code:`gpt2-xl`, etc.
20+
* - :code:`GPTBigCodeForCausalLM`
21+
- StarCoder, SantaCoder, WizardCoder
22+
- :code:`bigcode/starcoder`, :code:`bigcode/gpt_bigcode-santacoder`, :code:`WizardLM/WizardCoder-15B-V1.0`, etc.
2023
* - :code:`GPTNeoXForCausalLM`
2124
- GPT-NeoX, Pythia, OpenAssistant, Dolly V2, StableLM
2225
- :code:`EleutherAI/gpt-neox-20b`, :code:`EleutherAI/pythia-12b`, :code:`OpenAssistant/oasst-sft-4-pythia-12b-epoch-3.5`, :code:`databricks/dolly-v2-12b`, :code:`stabilityai/stablelm-tuned-alpha-7b`, etc.

0 commit comments

Comments
 (0)