Skip to main content

SeededModel

This is Precursor to a Model. bytes: here is the size of the model in a file local on your computer. ram: is the amount of ram usage when the model is loaded into memory.

Properties

NameTypeDescriptionNotes
var_schemaEmbeddedModelSchema[optional]
versionstrthis is a version of the model.
createdGroupedTimestamp
namestrThis is an Optional Name of the Model.
descriptionstrAn Optional Description of the model itself.[optional]
cloudboolThis will inform the user if this was a model that is hosted in the cloud
typeModelTypeEnum
usageModelUsageEnum
bytesByteDescriptor[optional]
ramByteDescriptor[optional]
quantizationstrquantization is a string like: q8f16_0, q4f16_1, etc...[optional]
foundationModelFoundationEnum[optional]
downloadedboolThis is an optional bool to let us know if this model has been downloaded locally.[optional]
uniquestrThis is the unique model name used to load the model.[optional]
parametersfloatThis is the number of parameters in terms of billions.[optional]
providerExternalMLProviderEnum[optional]
cpuboolThis is an optional bool that is optimized for CPU usage.[optional]
max_tokensModelMaxTokens[optional]
customboolThis is reserved to custommly registed models.[optional]