Skip to main content

5 - Batch training and batch inference

Compute cluster plus a batch endpoint and deployment with a scheduled scoring job.

Idbatch-scoring
Networkpublic
Servingbatch
AddsBatch endpoint and deployment, nightly scoring workflow
IaC and CI/CDTerraform or Bicep; GitHub or Azure DevOps

Scoring runs as a scheduled batch job (a nightly workflow) instead of a real-time endpoint.

Use it

New-MLOpsInputFile -Scenario batch-scoring -Path inputs.yaml -Iac terraform -Cicd github

See the cost estimates and the prerequisites.

Microsoft documentation