Validated Models for Kubernetes Version

GPT-in-a-Box 1.0 has been validated on a curated set of HuggingFace models Information pertaining to these models is stored in the llm/model_config.json file.

The Validated Models are :

Model Name	HuggingFace Repository ID
mpt_7b	mosaicml/mpt_7b
falcon_7b	tiiuae/falcon-7b
llama2_7b	meta-llama/Llama-2-7b-hf
codellama_7b_python	codellama/CodeLlama-7b-Python-hf
llama2_7b_chat	meta-llama/Llama-2-7b-chat-hf

Note

To start the inference server with any HuggingFace model, refer to HuggingFace Model Support documentation.