Skip to content

Validated Models for Virtual Machine Version

GPT-in-a-Box has been validated on a curated set of HuggingFace models. Information pertaining to these models is stored in the llm/model_config.json file.

The Validated Models are :

Model Name HuggingFace Repository ID
mpt_7b mosaicml/mpt_7b
falcon_7b tiiuae/falcon-7b
llama2_7b meta-llama/Llama-2-7b-hf
codellama_7b_python codellama/CodeLlama-7b-Python-hf
llama2_7b_chat meta-llama/Llama-2-7b-chat-hf


To start the inference server with any HuggingFace model, refer to HuggingFace Model Support documentation.