Build software better, together

Custom properties

Custom properties allow you to decorate your repository with information such as compliance frameworks, data sensitivity, or project details.

collections

GPTQ

vLLM

any new collections. should be added manually as an option

machine_type

A100

available gpu's are T4, A100, A10

name

mixtral-8x7b-v0-1

name of the template

runtime_file_name

inferless-runtime-config.yaml

the runtime file name

source_framework_type

PYTORCH

source framework type options PYTORCH, ONNX, TENSORFLOW