Jobs allow you to run many AI tasks in parallel using batch processing. image.png

​
Concepts

  • Job: A code definition that specifies a batch processing task. Jobs can run multiple times within a single execution and accept optional input parameters.
  • Execution: A specific instance of running a batch job at a given timestamp. Each execution consists of multiple tasks running in parallel.
  • Task: A single instance of a job definition running as part of an execution.
image.png

​
Quickstart

It is required to have npm (TypeScript) or uv (Python) installed to use the following command.
You can quickly initialize a new job from scratch by using CLI command bl create-job. 
bl create-job myjob
This will create a pre-scaffolded local directory where your entire code can be added. In the generated folder, you’ll find a boilerplate job with multiple steps in the entrypoint file index.ts. 
import { blStartJob, withSpan } from '@blaxel/core'; // You can load any Blaxel SDK function
import '@blaxel/telemetry'; // This import is required to connect all the metrics and tracing with blaxel platform
import step1 from './steps/step1';
import step2 from './steps/step2';
import step3 from './steps/step3';

type JobArguments = {
  name: string;
}

async function myJob({name}: JobArguments) {
  console.log(`Hello, world ${name}!`);

  // You can call standard Javascript functions
  await step1();
  await step2();
  ...
}

// You need to use a Blaxel SDK function to wrap your job, this is the only requirement to make it work with Blaxel 
blStartJob(myJob);
Start the job locally: 
# Run the job with a sample batch file
bl run job jobs-ts --local --file batches/sample-batch.json

# Or directly with --data argument
bl run job jobs-ts --local --data '{"tasks": [{"name": "John"}]}'

# Or without blaxel CLI
pnpm start --name John

​
Deploy a job with Blaxel CLI

This section assumes you have developed a job locally. The Blaxel SDK allows you to connect to and orchestrate other resources (such as model APIs, tool servers, multi-agents) during development, and ensures telemetry, secure connections to third-party systems or private networks, smart global placement of workflows, and much more when jobs are deployed.

​
Serve locally

You can serve the job locally in order to make the entrypoint function (by default: index.py / index.ts) available on a local endpoint. Run the following command to serve the job: 
bl serve
Calling the provided endpoint will execute the job locally. Add the flag --hotreload to get live changes. 
bl serve --hotreload

​
Deploy on production

You can deploy the job in order to make the entrypoint function (by default: index.ts / server.py) callable on a global endpoint. When deploying to Blaxel, you get a dedicated endpoint that enforces your deployment policies. Run the following command to build and deploy a local job on Blaxel: 
bl deploy

​
Run a job

You can run a job via API or using Blaxel CLI. API Start a batch job execution by calling the inference API for your batch job.
Execute a job

curl -X POST "https://run.blaxel.ai/{your-workspace}/jobs/{your-job-name}/executions" \
-H "X-Blaxel-Authorization: Bearer <YOUR_API_KEY>" \
'{"tasks":[{"my_arg":"my_value"}]}’
CLI Start a batch job execution by running: 
# Run a job using Blaxel CLI with --data argument
bl run job jobs-ts --data '{"tasks": [{"name": "John"}, {"name": "Jane"}]}'
You can cancel a job execution from the Blaxel Console or via API.

​
Retries

You can set a maximum number of retries per task in the job definition. Check out the reference for blaxel.toml configuration file down below.

​
Deploy with a Dockerfile

While Blaxel uses predefined, optimized container images to build and deploy your code, you can also deploy your agent using your own Dockerfile.

Deploy using Dockerfile

Deploy resources using a custom Dockerfile.

​
Template directory reference

​
Overview

package.json            # Mandatory. This file is the standard package.json file, it defines the entrypoint of the project and dependencies.
blaxel.toml             # This file lists configurations dedicated to Blaxel to customize the deployment.
tsconfig.json           # This file is the standard tsconfig.json file, only needed if you use TypeScript.
src/
└── index.ts            # This file is the standard entrypoint of the project. It is where the core logic of the job is implemented.
└── steps               # This is an example of organization for your sub steps, feel free to change it.

​
package.json

Here the most notable imports are the scripts. They are used for the bl serve and bl deploy commands. 

{
  "name": "job-ts",
  "version": "1.0.0",
  "description": "Job using Blaxel Platform",
  "main": "src/index.ts",
  "keywords": [],
  "license": "MIT",
  "author": "Blaxel",
  "scripts": {
    "start": "tsx src/index.ts",
    "prod": "node dist/index.js",
    "build": "tsc"
  },
  "dependencies": {
    "@blaxel/core": "0.2.5",
    "@blaxel/telemetry": "0.2.5"
  },
  "devDependencies": {
    "@types/express": "^5.0.1",
    "@types/node": "^22.13.11",
    "tsx": "^4.19.3",
    "typescript": "^5.8.2"
  }
}
Depending of what you do, all of the scripts are not required. With TypeScript, all 4 of them are used.
  • start : start the job locally through the TypeScript command, to avoid having to build the project when developing.
  • prod : start the job remotely from the dist folder, the project needs to be have been built before.
  • build : build the project. It is done automatically when deploying.
The remaining fields in package.json follow standard JavaScript/TypeScript project conventions. Feel free to add any dependencies you need, but keep in mind that devDependencies are only used during the build process and are removed afterwards.

​
blaxel.toml

This file is used to configure the deployment of the job on Blaxel. The only mandatory parameter is the type so Blaxel knows which kind of entity to deploy. Others are not mandatory but allow you to customize the deployment. 

type = "job"
name = "my-job"
workspace = "my-workspace"

policies = ["na"]

[env]
DEFAULT_CITY = "San Francisco"

[runtime]
memory = 1024
maxConcurrentTasks = 10
timeout = 900
maxRetries=0
  • name, workspace, and type fields are optional and serve as default values. Any bl command run in the folder will use these defaults rather than prompting you for input.
  • policies fields is also optional. It allow you to specify a Blaxel policy to customize the deployment. For example, deploy it only in a specific region of the world.
  • [env] section defines environment variables that the job can access via the SDK. Note that these are NOT secrets.
  • [runtime] section allows to override job execution parameters: maximum number of concurrent tasks, maximum number of retries for each task, timeout (in s), or memory (in MB) to allocate.