> ## Documentation Index
> Fetch the complete documentation index at: https://fireworks.ai/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# firectl dpo-job create

> Creates a dpo job.

```
firectl dpo-job create [flags]
```

### Examples

```
firectl dpo-job create \
	--base-model llama-v3-8b-instruct \
	--dataset sample-dataset \
	--output-model name-of-the-trained-model

# Create from source job:
firectl dpo-job create \
	--source-job my-previous-job \
	--output-model new-model

```

### Flags

```
      --base-model string                         The base model for the dpo job. Only one of base-model or warm-start-from should be specified.
      --dataset string                            The dataset for the dpo job. (Required)
      --output-model string                       The output model for the dpo job.
      --job-id string                             The ID of the dpo job. If not set, it will be autogenerated.
      --warm-start-from string                    The model to warm start from. If set, base-model must not be set.
      --source-job string                         The source dpo job to copy configuration from. If other flags are set, they will override the source job's configuration.
      --epochs int32                              The number of epochs for the dpo job.
      --learning-rate float32                     The learning rate for the dpo job.
      --max-context-length int32                  Maximum token length per sequence. When unset, defaults to the validated training shape's max supported context length. Capped (not pinned) by the shape: smaller user values are honored.
      --batch-size-samples int32                  Number of preference pairs per optimizer step. This is the supported Training V2 batch knob.
      --learning-rate-warmup-steps int32          The number of learning rate warmup steps for the dpo job.
      --learning-rate-scheduler string            Learning rate scheduler to use: constant, linear, or cosine. When unset, the trainer uses its legacy constant schedule.
      --learning-rate-min-lr-ratio float32        Minimum learning rate as a ratio of --learning-rate for linear/cosine schedules. Must be between 0 and 1.
      --learning-rate-decay-ratio float32         Fraction of total training steps over which to decay for linear/cosine schedules. 0 uses the full run.
      --lora-rank int32                           The rank of the LoRA layers for the dpo job. Use --full-parameter for full parameter tuning. (default 8)
      --optimizer-weight-decay float32            Weight decay (L2 regularization) for the optimizer. Default in trainer is 0.01.
      --full-parameter                            Enable full parameter fine-tuning instead of LoRA. Equivalent to --lora-rank=0. Requires bf16 precision.
                                                  
      --wandb-api-key string                      [WANDB_API_KEY] WandB API Key. (Required if any WandB flag is set)
      --wandb-project string                      [WANDB_PROJECT] WandB Project. (Required if any WandB flag is set)
      --wandb-entity string                       [WANDB_ENTITY] WandB Entity. (Required if any WandB flag is set)
      --wandb                                     Enable WandB
                                                  
                                                  
      --aws-credentials-secret string             [AWS_CREDENTIALS_SECRET] AWS credentials secret (mutually exclusive with --aws-iam-role)
      --aws-iam-role string                       [AWS_IAM_ROLE_ARN] AWS IAM role ARN (mutually exclusive with --aws-credentials-secret)
                                                  
                                                  
      --azure-credentials-secret string           [AZURE_CREDENTIALS_SECRET] Azure credentials secret
      --azure-managed-identity-client-id string   [AZURE_MANAGED_IDENTITY_CLIENT_ID] Azure managed identity client ID for Workload Identity Federation
      --azure-tenant-id string                    [AZURE_TENANT_ID] Azure tenant ID (required with --azure-managed-identity-client-id)
                                                  
      --display-name string                       The display name of the dpo job.
      --quiet                                     If set, only errors will be printed.
      --loss-method string                        Loss method for the job (DPO, GRPO, or ORPO). Defaults to DPO for new jobs; when using --source-job, inherits the source job's method unless overridden.
      --dpo-beta float32                          Typed DPO beta override. Must be > 0 and < 0.5. Applies to loss_config.dpo.beta.
      --orpo-lambda float32                       Typed ORPO lambda override. Applies to loss_config.orpo.lambda.
      --dry-run                                   Print the request proto without running it.
  -o, --output Output                             Set the output format to "text", "json", or "flag". (default text)
  -h, --help                                      help for create
```

### Global flags

```
  -a, --account-id string   The Fireworks account ID. If not specified, reads account_id from ~/.fireworks/auth.ini.
      --api-key string      An API key used to authenticate with Fireworks.
  -p, --profile string      fireworks auth and settings profile to use.
```