Build software better, together

Custom properties

Custom properties allow you to decorate your repository with information such as compliance frameworks, data sensitivity, or project details.

collections

vLLM

any new collections. should be added manually as an option

env_variables

{'HF_TOKEN': 'YOUR_HUGGING_FACE_ACCESS_TOKEN'}

env variables

machine_type

A100

available gpu's are T4, A100, A10

model_owner

mistralai

name

mistral-7b

name of the template

runtime_file_name

inferless-runtime-config.yaml

the runtime file name

source_framework_type

PYTORCH

source framework type options PYTORCH, ONNX, TENSORFLOW