LLMModelCreate

Payload used to create LLM Model. Required fields are name, type, provider, model.

하나 이상(anyOf)

• Option 1
• Option 2

collection_idstring필수

nameName (string)필수

Possible values: >= 2 characters and <= 128 characters, Value must match regular expression ^[a-z][a-z0-9_.]{1,127}(?![\s\S])

alias object

하나 이상(anyOf)

• string
• null

string

typeType (string)필수

Model placement: internal hosts the model in D.Hub; external registers an existing endpoint.

Possible values: [internal, external]

providerProvider (string)필수

Provider identifier returned by the provider-list operation.

label object

하나 이상(anyOf)

• string
• null

string

hint_i18n_key object

하나 이상(anyOf)

• string
• null

string

modelModel (string)필수

Possible values: non-empty

context_window object

Maximum model context size in tokens.

하나 이상(anyOf)

• integer
• null

integer

Possible values: >= 1

tokenizer object

Tokenizer identifier used for token counting, given as a Hugging Face repository id. Omit this field to use the built-in estimator.

하나 이상(anyOf)

• string
• null

string

Possible values: non-empty and <= 256 characters, Value must match regular expression ^[A-Za-z0-9][A-Za-z0-9._-]*(/[A-Za-z0-9][A-Za-z0-9._-]*)*$

deployment object

하나 이상(anyOf)

• LLMModelDeployment
• null

imageImage (string)필수

Fully qualified container image reference for the model server.

command object

Optional container entrypoint override.

하나 이상(anyOf)

• string[]
• null

Array [

string

]

options object

Runtime options converted to command-line flags when the model starts.

property name* object

하나 이상(anyOf)

• string
• integer
• number
• boolean
• null

string

args object

Additional command-line arguments appended after rendered runtime options.

하나 이상(anyOf)

• string[]
• null

Array [

string

]

portPort (integer)

기본값: 8080

cpu object

Requested CPU amount, such as 500m.

하나 이상(anyOf)

• string
• null

string

memory object

Requested memory amount, such as 2Gi.

하나 이상(anyOf)

• string
• null

string

gpu object

GPU count request

하나 이상(anyOf)

• integer
• null

integer

replicasReplicas (integer)

기본값: 1

health_pathHealth Path (string)

기본값: /healthz

env object

Non-secret environment variables passed to the model container.

property name*string

node_selector object

property name*string

base_url object

하나 이상(anyOf)

• string
• null

string

api_key object

하나 이상(anyOf)

• string
• null

string

default_headers object

Custom default header rows sent with every request to this model. Each row is stored either as a write-only secret or as a plain-text constant. Edit the rows after creation through the model header operations.

하나 이상(anyOf)

• object[]
• null

Array [

nameName (string)필수

wire header name

valueValue (string)필수

header value

secretSecret (boolean)

Whether to store the header value as a write-only secret. When it is false, the value is stored as a plain-text constant and is returned by read operations. The default is false.

기본값: false

]

temperature object

하나 이상(anyOf)

• number
• null

number

Possible values: >= 0 and <= 2

max_tokens object

하나 이상(anyOf)

• integer
• null

integer

Possible values: >= 1

max_retries object

하나 이상(anyOf)

• integer
• null

integer

Possible values: >= 0

request_timeout object

하나 이상(anyOf)

• number
• null

number

Possible values: > 0

streaming object

하나 이상(anyOf)

• boolean
• null

boolean

model_kwargs object

하나 이상(anyOf)

• object
• null

object

options object

Endpoint behavior options interpreted by D.Hub. They are never sent to the model endpoint.

하나 이상(anyOf)

• object
• null

object

reasoning object

하나 이상(anyOf)

• LLMReasoningCapability
• null

supportedSupported (boolean)

기본값: false

levelsstring[]

Possible values: [none, minimal, low, medium, high, xhigh, max]

default object

하나 이상(anyOf)

• string
• null

string

Possible values: [none, minimal, low, medium, high, xhigh, max]

supports_vision object

하나 이상(anyOf)

• boolean
• null

boolean

collection_id object

Identifier of the containing collection.

하나 이상(anyOf)

• string
• null

string

Possible values: non-empty

folder_id object

하나 이상(anyOf)

• string
• null

string

tags object

하나 이상(anyOf)

• string[]
• null

Array [

string

]

description object

하나 이상(anyOf)

• string
• null

string

LLMModelCreate

{
  "name": "string",
  "alias": "string",
  "type": "internal",
  "provider": "string",
  "label": "string",
  "hint_i18n_key": "string",
  "model": "string",
  "context_window": 0,
  "tokenizer": "string",
  "deployment": {
    "image": "string",
    "command": [
      "string"
    ],
    "options": {},
    "args": [
      "string"
    ],
    "port": 8080,
    "cpu": "string",
    "memory": "string",
    "gpu": 0,
    "replicas": 1,
    "health_path": "/healthz",
    "env": {},
    "node_selector": {}
  },
  "base_url": "string",
  "api_key": "string",
  "default_headers": [
    {
      "name": "string",
      "value": "string",
      "secret": false
    }
  ],
  "temperature": 0,
  "max_tokens": 0,
  "max_retries": 0,
  "request_timeout": 0,
  "streaming": true,
  "model_kwargs": {},
  "options": {},
  "reasoning": {
    "supported": false,
    "levels": [
      "none"
    ],
    "default": "none"
  },
  "supports_vision": true,
  "collection_id": "string",
  "folder_id": "string",
  "tags": [
    "string"
  ],
  "description": "string"
}