Overview

ComputeBroker is an AI compute routing layer that sits between your application and 8+ GPU cloud providers. Instead of hardcoding a single provider, send your workload requirements and ComputeBroker returns the optimal provider match based on cost, latency, region, and availability.

Supported Providers: Lambda Cloud · RunPod · CoreWeave · Vast.ai · FluidStack · Paperspace · Salad Cloud · Crusoe Energy

Smart Routing — Real-time cost/latency optimization across providers
Simulation Mode — Test routing logic without creating a billable job
Job Replay — Re-route a previous job to compare provider results
Custom Policies — Define rules like "cheapest", "fastest", region locks, or provider include/exclude lists
Usage & Billing Tracking — Monitor API consumption and cost estimates
Webhook Support — Get notified on job completion events

Authentication

All endpoints except GET /health require authentication via your RapidAPI subscription key:

X-RapidAPI-Key: YOUR_RAPIDAPI_KEY
X-RapidAPI-Host: compute-broker-api.p.rapidapi.com

Your subscription tier (BASIC, PRO, ULTRA, MEGA) determines rate limits and feature access. See the Tier Comparison below.

Endpoints

Method	Path	Description	Auth	Tier
GET	`/health`	Health check	No	ALL
POST	`/v1/route`	Route a workload to the best provider	Yes	PRO+
POST	`/v1/simulate`	Simulate routing without creating a job	Yes	ALL
GET	`/v1/job/:id`	Get job details by ID	Yes	ALL
POST	`/v1/job/:id/replay`	Replay a job with new routing	Yes	PRO+
GET	`/v1/providers`	List all available compute providers	Yes	ALL
GET	`/v1/usage`	Get usage statistics	Yes	ALL
GET	`/v1/billing/estimate`	Get billing estimates and projections	Yes	ALL
GET	`/v1/policies`	List your routing policies	Yes	ALL
POST	`/v1/policies`	Create a new routing policy	Yes	ALL
PATCH	`/v1/policies/:id`	Update a routing policy	Yes	ALL
DELETE	`/v1/policies/:id`	Delete a routing policy	Yes	ALL
POST	`/v1/webhooks/test`	Send a test webhook event	Yes	ALL

Endpoint Examples

GET /health

curl "https://compute-broker-api.p.rapidapi.com/health"

{
  "success": true,
  "data": {
    "status": "healthy",
    "version": "1.0.0",
    "timestamp": "2025-06-01T12:00:00Z"
  }
}

POST /v1/route PRO+

Route a workload to the optimal provider. Creates a billable job.

curl -X POST "https://compute-broker-api.p.rapidapi.com/v1/route" \
  -H "Content-Type: application/json" \
  -H "X-RapidAPI-Key: YOUR_RAPIDAPI_KEY" \
  -H "X-RapidAPI-Host: compute-broker-api.p.rapidapi.com" \
  -d '{
    "workload_type": "inference",
    "model": "llama-3-70b",
    "max_cost": 2.0,
    "max_latency": 60,
    "region": "us-east-1",
    "preferred_providers": ["Lambda Cloud"],
    "excluded_providers": []
  }'

{
  "success": true,
  "data": {
    "job_id": "f47ac10b-58cc-4372-a567-0e02b2c3d479",
    "provider": "Lambda Cloud",
    "region": "us-east-1",
    "cost_estimate": 1.45,
    "latency_estimate": 32,
    "status": "routed",
    "model": "llama-3-70b",
    "workload_type": "inference"
  }
}

POST /v1/simulate

Simulate routing without creating a job — useful for testing and comparison.

curl -X POST "https://compute-broker-api.p.rapidapi.com/v1/simulate" \
  -H "Content-Type: application/json" \
  -H "X-RapidAPI-Key: YOUR_RAPIDAPI_KEY" \
  -H "X-RapidAPI-Host: compute-broker-api.p.rapidapi.com" \
  -d '{
    "workload_type": "training",
    "model": "mistral-7b",
    "max_cost": 1.5,
    "max_latency": 120,
    "region": "eu-west-1"
  }'

{
  "success": true,
  "data": {
    "provider": "FluidStack",
    "region": "eu-west-1",
    "cost_estimate": 0.92,
    "latency_estimate": 45,
    "score": 87.3,
    "model": "mistral-7b",
    "workload_type": "training",
    "alternatives": [
      { "provider": "Vast.ai", "cost_estimate": 0.78, "latency_estimate": 68, "score": 72.1 },
      { "provider": "RunPod", "cost_estimate": 1.10, "latency_estimate": 38, "score": 69.5 }
    ]
  }
}

GET /v1/job/:id

Retrieve details of a previously routed job.

curl "https://compute-broker-api.p.rapidapi.com/v1/job/f47ac10b-58cc-4372-a567-0e02b2c3d479" \
  -H "X-RapidAPI-Key: YOUR_RAPIDAPI_KEY" \
  -H "X-RapidAPI-Host: compute-broker-api.p.rapidapi.com"

{
  "success": true,
  "data": {
    "id": "f47ac10b-58cc-4372-a567-0e02b2c3d479",
    "provider": "Lambda Cloud",
    "region": "us-east-1",
    "cost_estimate": 1.45,
    "latency_estimate": 32,
    "status": "routed",
    "model": "llama-3-70b",
    "workload_type": "inference",
    "created_at": "2025-06-01T12:05:00Z"
  }
}

POST /v1/job/:id/replay PRO+

Re-route a previous job with new constraints to compare results.

curl -X POST "https://compute-broker-api.p.rapidapi.com/v1/job/f47ac10b-58cc-4372-a567-0e02b2c3d479/replay" \
  -H "Content-Type: application/json" \
  -H "X-RapidAPI-Key: YOUR_RAPIDAPI_KEY" \
  -H "X-RapidAPI-Host: compute-broker-api.p.rapidapi.com" \
  -d '{
    "max_cost": 1.0,
    "region": "us-west-2"
  }'

{
  "success": true,
  "data": {
    "original_job_id": "f47ac10b-58cc-4372-a567-0e02b2c3d479",
    "replay_id": "b23dc41a-9f12-4a8e-bc67-1234abcd5678",
    "provider": "RunPod",
    "region": "us-west-2",
    "cost_estimate": 0.89,
    "latency_estimate": 41,
    "status": "replayed"
  }
}

GET /v1/providers

List all available compute providers and their current status.

curl "https://compute-broker-api.p.rapidapi.com/v1/providers" \
  -H "X-RapidAPI-Key: YOUR_RAPIDAPI_KEY" \
  -H "X-RapidAPI-Host: compute-broker-api.p.rapidapi.com"

{
  "success": true,
  "data": [
    {
      "name": "Lambda Cloud",
      "region": "us-east-1",
      "status": "available",
      "cost_per_hour": 1.10,
      "latency_ms": 32,
      "workload_types": ["inference", "training", "batch"]
    },
    {
      "name": "RunPod",
      "region": "us-east-1",
      "status": "available",
      "cost_per_hour": 0.85,
      "latency_ms": 45,
      "workload_types": ["inference", "training"]
    }
  ]
}

GET /v1/usage

Get your usage statistics for the current billing period.

curl "https://compute-broker-api.p.rapidapi.com/v1/usage" \
  -H "X-RapidAPI-Key: YOUR_RAPIDAPI_KEY" \
  -H "X-RapidAPI-Host: compute-broker-api.p.rapidapi.com"

{
  "success": true,
  "data": {
    "current_period": {
      "requests_used": 158,
      "requests_limit": 5000,
      "period_start": "2025-06-01T00:00:00Z",
      "period_end": "2025-07-01T00:00:00Z"
    },
    "breakdown": {
      "route": 42,
      "simulate": 89,
      "providers": 15,
      "other": 12
    }
  }
}

GET /v1/billing/estimate

Get billing projections based on current usage patterns.

curl "https://compute-broker-api.p.rapidapi.com/v1/billing/estimate" \
  -H "X-RapidAPI-Key: YOUR_RAPIDAPI_KEY" \
  -H "X-RapidAPI-Host: compute-broker-api.p.rapidapi.com"

{
  "success": true,
  "data": {
    "current_plan": "PRO",
    "monthly_cost": 29.00,
    "projected_usage": 3200,
    "projected_overage": 0,
    "recommendation": "Current plan covers projected usage."
  }
}

GET /v1/policies

List all routing policies configured for your account.

curl "https://compute-broker-api.p.rapidapi.com/v1/policies" \
  -H "X-RapidAPI-Key: YOUR_RAPIDAPI_KEY" \
  -H "X-RapidAPI-Host: compute-broker-api.p.rapidapi.com"

{
  "success": true,
  "data": [
    {
      "id": "pol_abc123",
      "name": "cheapest-us-east",
      "strategy": "cheapest",
      "region": "us-east-1",
      "excluded_providers": ["Vast.ai"],
      "created_at": "2025-05-15T10:00:00Z"
    }
  ]
}

POST /v1/policies

Create a new routing policy.

curl -X POST "https://compute-broker-api.p.rapidapi.com/v1/policies" \
  -H "Content-Type: application/json" \
  -H "X-RapidAPI-Key: YOUR_RAPIDAPI_KEY" \
  -H "X-RapidAPI-Host: compute-broker-api.p.rapidapi.com" \
  -d '{
    "name": "fastest-eu",
    "strategy": "fastest",
    "region": "eu-west-1",
    "preferred_providers": ["Lambda Cloud", "CoreWeave"],
    "excluded_providers": []
  }'

{
  "success": true,
  "data": {
    "id": "pol_def456",
    "name": "fastest-eu",
    "strategy": "fastest",
    "region": "eu-west-1",
    "preferred_providers": ["Lambda Cloud", "CoreWeave"],
    "excluded_providers": [],
    "created_at": "2025-06-01T14:30:00Z"
  }
}

PATCH /v1/policies/:id

Update an existing routing policy.

curl -X PATCH "https://compute-broker-api.p.rapidapi.com/v1/policies/pol_def456" \
  -H "Content-Type: application/json" \
  -H "X-RapidAPI-Key: YOUR_RAPIDAPI_KEY" \
  -H "X-RapidAPI-Host: compute-broker-api.p.rapidapi.com" \
  -d '{
    "strategy": "cheapest",
    "excluded_providers": ["Paperspace"]
  }'

{
  "success": true,
  "data": {
    "id": "pol_def456",
    "name": "fastest-eu",
    "strategy": "cheapest",
    "region": "eu-west-1",
    "preferred_providers": ["Lambda Cloud", "CoreWeave"],
    "excluded_providers": ["Paperspace"],
    "updated_at": "2025-06-01T15:00:00Z"
  }
}

DELETE /v1/policies/:id

Delete a routing policy.

curl -X DELETE "https://compute-broker-api.p.rapidapi.com/v1/policies/pol_def456" \
  -H "X-RapidAPI-Key: YOUR_RAPIDAPI_KEY" \
  -H "X-RapidAPI-Host: compute-broker-api.p.rapidapi.com"

{
  "success": true,
  "data": {
    "deleted": true,
    "id": "pol_def456"
  }
}

POST /v1/webhooks/test

Send a test webhook event to verify your webhook endpoint.

curl -X POST "https://compute-broker-api.p.rapidapi.com/v1/webhooks/test" \
  -H "Content-Type: application/json" \
  -H "X-RapidAPI-Key: YOUR_RAPIDAPI_KEY" \
  -H "X-RapidAPI-Host: compute-broker-api.p.rapidapi.com" \
  -d '{
    "url": "https://your-app.com/webhooks/computebroker"
  }'

{
  "success": true,
  "data": {
    "webhook_sent": true,
    "target_url": "https://your-app.com/webhooks/computebroker",
    "test_event": "job.completed",
    "timestamp": "2025-06-01T16:00:00Z"
  }
}

Rate Limit Headers

Every authenticated response includes these headers:

Header	Description	Example
`X-RateLimit-Limit`	Maximum requests allowed per billing period	`5000`
`X-RateLimit-Remaining`	Requests remaining in current period	`4842`
`X-RateLimit-Reset`	Seconds until the rate limit window resets	`1483200`
`X-Request-Id`	Unique UUID for this request (use in support tickets)	`a1b2c3d4-...`

Pricing

Plan	Price	Requests / month
BASIC	Free	100
PRO	$29/mo	5,000
ULTRA	$99/mo	25,000
MEGA	$299/mo	100,000

Tier Comparison

Feature	BASIC	PRO	ULTRA	MEGA
Requests / month	100	5,000	25,000	100,000
Max providers	1	3	10	All
Simulate	✔	✔	✔	✔
Route (live jobs)	✘	✔	✔	✔
Job Replay	✘	✔	✔	✔
Custom Policies	2 max	10 max	Unlimited	Unlimited
Webhooks	✘	✔	✔	✔
Priority routing	✘	✘	✔	✔
Failover	✘	✘	✘	✔

Error Responses

All errors follow a consistent shape:

{
  "success": false,
  "error": {
    "code": "RATE_LIMITED",
    "message": "Rate limit exceeded. Upgrade your plan or wait for reset.",
    "request_id": "a1b2c3d4-e5f6-7890-abcd-ef1234567890"
  }
}

Common Error Codes

Code	HTTP Status	Description
`UNAUTHORIZED`	401	Missing or invalid API key
`FORBIDDEN`	403	Endpoint not available on your tier
`NOT_FOUND`	404	Resource (job, policy) not found
`VALIDATION_ERROR`	400	Invalid request body or parameters
`RATE_LIMITED`	429	Rate limit exceeded for current billing period
`NO_PROVIDERS`	404	No providers match workload constraints
`INTERNAL_ERROR`	500	Unexpected server error — include `request_id` in support tickets

Contact

Questions, issues, or partnership inquiries: computebroker@fastmail.com