Running a model
VEEDImage to videoVEED Fabric 1.0
Talking-video generation from image and audio inputs
One of Auray's catalogue models: the same key, the same credits, the same job lifecycle as every other address.
Its request shape is published below. Whether it runs right now is GET /v1/catalogue's word, with no key needed: its addresses say connected for an address that runs, and a submit to any other is refused before anything is charged — described answers 501 model_not_connected, paused 503 model_disabled.
Category image-to-video · Scope video:write (or external:write on an older key) · Price Credits per call: 47.1667 for acceleration=high, resolution=480p; 372.145 for acceleration=low, resolution=480p; acceleration=low, resolution=720p; acceleration=medium, resolution=480p; acceleration=medium, resolution=720p; 744.29 for acceleration=high, resolution=720p. Plus 566 credits when the request sends inputs.audio at resolution=480p (counted as any:inputs.audio). Plus 1061.25 credits when the request sends inputs.audio at resolution=720p (counted as any:inputs.audio). Quoted when you submit, at the most the request can cost; the charge settles to what the job cost and never above the quote. The submit's answer carries the quote as credits_quoted, and credits_charged says what has been taken.
#What it can do
talking-photo— Talking photo: 1 source file; 1 track- Resolutions: 480p, 720p
- Sound: makes no sound of its own
- Priced by:
call(the whole rule is under Price)
Find the addresses that do any of these with GET /v1/models?operation=<id>; the openapi.json carries them as data under x-auray-capability.
#Input
| Field | Type | Required | Default | Description |
|---|---|---|---|---|
inputs | object | yes | — | |
inputs.image | string | yes | — | Image input (an http(s) URL). When the request also sends inputs.audio, this model makes the person in a picture here speak or move: a picture you upload, or a link from anywhere else, is taken once your account has accepted, one time, that you have the right to the faces and voices you use — send acceptance: {"real_people": "2026-11-03"} with the request, or accept in the Auray app — and is refused 403 acceptance_required until then, before anything is charged. A picture made here — a job's result — asks nothing. While uploads are paused here, a picture you upload, or a link from anywhere else, is refused 403 likeness_not_made_here instead, before anything is charged. The files the examples here send are ours, and are taken. A URL. |
inputs.audio | string | yes | — | Audio input (an http(s) URL; upload a local file first and send its read URL). A URL. |
resolution | string | no | "720p" | Resolution preset for the output. When used with input media, automatically matches the aspect ratio from the input. One of "480p", "720p". |
seed | integer | no | — | Random seed for reproducible generation. When not provided, a random seed is generated in the unsigned 32-bit range. Documented range: 0 to 9,223,372,036,854,776,000. |
acceleration | string | no | "medium" | Optimization level. When left out, medium is sent. One of "low", "medium", "high". |
acceleratorOptions | object | no | — | |
acceleratorOptions.cacheEndStep | integer | no | — | Absolute step number to end caching. Must be greater than cacheStartStep and less than or equal to steps. Documented range: 1 or more. |
acceleratorOptions.cacheEndStepPercentage | integer | no | — | Percentage of steps to end caching. Alternative to cacheEndStep. Must be greater than cacheStartStepPercentage. Documented range: 1 to 100. |
acceleratorOptions.cacheMaxConsecutiveSteps | integer | no | 3 | Limits the maximum number of consecutive steps that can use cached computations before forcing a fresh computation. Documented range: 1 to 5. |
acceleratorOptions.cacheStartStep | integer | no | — | Absolute step number to start caching. Must be less than cacheEndStep. Documented range: 0 or more. |
acceleratorOptions.cacheStartStepPercentage | integer | no | — | Percentage of steps to start caching. Alternative to cacheStartStep. Must be less than cacheEndStepPercentage. Documented range: 0 to 99. |
acceleratorOptions.fbCache | boolean | no | — | First Block Cache (FBCache) acceleration. Reuses feature block computations across steps. |
acceleratorOptions.fbCacheThreshold | number | no | 0.25 | Controls the sensitivity threshold for determining when to reuse cached computations. Lower values reuse more aggressively. Documented range: 0 to 1. |
settings | object | no | — | |
settings.audioCFGScale | number | no | 3.05 | Classifier-free guidance scale for audio synchronization. Higher values produce stronger audio-video alignment. Documented range: 0 to 20. |
settings.colorCorrection | boolean | no | — | Apply color correction to the generated video. Helps maintain consistent colors across video segments. |
outputType | string | no | "URL" | Video output type. One of "URL". |
outputFormat | string | no | "MP4" | Specifies the file format of the generated output. The available values depend on the task type and the specific model's capabilities. - `JPG`: Best for photorealistic images with smaller file sizes (no transparency). - `PNG`: Lossless compression, supports high quality and transparency (alpha channel). - `WEBP`: Modern format providing superior compression and transparency support. - `MP4`: Widely supported video container (H.264), recommended for general use. - `WEBM`: Optimized for web delivery. - `MOV`: QuickTime format, common in professional workflows (Apple ecosystem). - `GIF`: Animated image format (no audio), suitable for short loops or previews. - `MP3`: Compressed audio, smaller file size. - `WAV`: Uncompressed, high-quality audio. - `FLAC`: Lossless compression. - `OGG`: Open-source compressed audio format (Vorbis codec). - `SVG`: Scalable Vector Graphics. - `TIFF`: High-quality output supporting layers. - `GLB`: Binary glTF format for 3D models, including geometry, textures, and PBR materials. > [!NOTE] > **Transparency**: If you are using features like background removal or LayerDiffuse that require transparency, you must select a format that supports an alpha channel (e.g., `PNG`, `WEBP`, `TIFF`). `JPG` does not support transparency. One of "MP4", "WEBM", "MOV". |
outputQuality | integer | no | 95 | Compression quality of the output. Higher values preserve quality but increase file size. Documented range: 20 to 99. |
safety | object | no | — | |
safety.checkContent | boolean | no | — | Enable or disable content safety checking. Increases total generation time. Always on: a false is sent as true. |
safety.mode | string | no | "fast" | Safety checking mode for video generation. Only fast or full is sent here: any other value is sent as fast. One of "fast", "full". |
idempotency_key | string | no | — | Your own name for this request. Send the same one twice and the second call is answered with the first request rather than charged again. Idempotency-Key: as a header is accepted as an alias — that is the spelling a retrying proxy replays, and the one to use when running a model on auray.run, where a request that outlives its connection is answered 504 and recovered by replay. Omit it and the platform mints one. 1 to 64 characters. |
acceptance | object | no | — | Your account's one acceptance, sent with the request that first needs it: a file of a real person's face or voice you upload, in a field this model makes speak or move, copies the voice of or puts into a clip, is taken once your account has accepted, one time, that you have the right to the faces and voices you use. Kept for your account before anything is charged, so no later request asks again — in any app or through the API — and asked of no file made here. You can accept in the Auray app (Account → Privacy) instead; an assistant cannot accept for you, so through MCP it is accepted in the app. |
acceptance.real_people | string | no | — | The version of the words you accept: that you have the right to every face and voice you upload, and to any voice or style you pick that sounds like a real person — it is yours, or you have permission — and that you are responsible for what you make with them. One of "2026-11-03". |
#Rules
Across fields, as the model's documentation states them. Each is judged before anything is charged — warned with a Deprecation header until enforcement starts — and listed as JSON Schema under x-auray-rules in the openapi.json.
- Do not send
acceleratorOptions.cacheStartStepandacceleratorOptions.cacheStartStepPercentagetogether. Do not sendacceleratorOptions.cacheEndStepandacceleratorOptions.cacheEndStepPercentagetogether.
#Example
curl -X POST https://queue.auray.run/auray-serverless/veed/fabric-1-0-hosted \
-H "Authorization: Bearer $AURAY_API_KEY" \
-H "content-type: application/json" \
-d '{
"inputs": {
"image": "https://v3b.auray.media/examples/samples/still-life.jpg",
"audio": "https://v3b.auray.media/examples/samples/electronic-loop.mp3"
}
}'import { createClient } from "@auray/client";
const auray = createClient(); // reads AURAY_API_KEY
const result = await auray.subscribe("auray-serverless/veed/fabric-1-0-hosted", {
input: {
"inputs": {
"image": "https://v3b.auray.media/examples/samples/still-life.jpg",
"audio": "https://v3b.auray.media/examples/samples/electronic-loop.mp3"
}
},
onQueueUpdate: (update) => console.log(update.status),
});
console.dir(result, { depth: null });from auray_client import Client
auray = Client() # reads AURAY_API_KEY
result = auray.subscribe(
"auray-serverless/veed/fabric-1-0-hosted",
input={
"inputs": {
"image": "https://v3b.auray.media/examples/samples/still-life.jpg",
"audio": "https://v3b.auray.media/examples/samples/electronic-loop.mp3"
}
},
on_queue_update=lambda update: print(update["status"]),
)
print(result){
"jsonrpc": "2.0",
"id": 1,
"method": "tools/call",
"params": {
"name": "run_model",
"arguments": {
"address": "auray-serverless/veed/fabric-1-0-hosted",
"input": {
"inputs": {
"image": "https://v3b.auray.media/examples/samples/still-life.jpg",
"audio": "https://v3b.auray.media/examples/samples/electronic-loop.mp3"
}
}
}
}
}const res = await fetch("https://queue.auray.run/auray-serverless/veed/fabric-1-0-hosted", {
method: "POST",
headers: {
Authorization: `Bearer ${process.env.AURAY_API_KEY}`,
"content-type": "application/json",
},
body: JSON.stringify({
"inputs": {
"image": "https://v3b.auray.media/examples/samples/still-life.jpg",
"audio": "https://v3b.auray.media/examples/samples/electronic-loop.mp3"
}
}),
});
console.log(await res.json());import os, requests
r = requests.post(
"https://queue.auray.run/auray-serverless/veed/fabric-1-0-hosted",
headers={"Authorization": f"Bearer {os.environ['AURAY_API_KEY']}"},
json={
"inputs": {
"image": "https://v3b.auray.media/examples/samples/still-life.jpg",
"audio": "https://v3b.auray.media/examples/samples/electronic-loop.mp3"
}
},
)
r.raise_for_status()
print(r.json())package main
import (
"bytes"
"fmt"
"io"
"net/http"
"os"
)
func main() {
body := []byte(`{
"inputs": {
"image": "https://v3b.auray.media/examples/samples/still-life.jpg",
"audio": "https://v3b.auray.media/examples/samples/electronic-loop.mp3"
}
}`)
req, err := http.NewRequest("POST", "https://queue.auray.run/auray-serverless/veed/fabric-1-0-hosted", bytes.NewReader(body))
if err != nil {
panic(err)
}
req.Header.Set("Authorization", "Bearer "+os.Getenv("AURAY_API_KEY"))
req.Header.Set("Content-Type", "application/json")
res, err := http.DefaultClient.Do(req)
if err != nil {
panic(err)
}
defer res.Body.Close()
out, _ := io.ReadAll(res.Body)
fmt.Println(res.Status, string(out))
}<?php
$ch = curl_init("https://queue.auray.run/auray-serverless/veed/fabric-1-0-hosted");
curl_setopt_array($ch, [
CURLOPT_CUSTOMREQUEST => "POST",
CURLOPT_RETURNTRANSFER => true,
CURLOPT_HTTPHEADER => [
"Authorization: Bearer " . getenv("AURAY_API_KEY"),
"Content-Type: application/json",
],
CURLOPT_POSTFIELDS => json_encode([
"inputs" => [
"image" => "https://v3b.auray.media/examples/samples/still-life.jpg",
"audio" => "https://v3b.auray.media/examples/samples/electronic-loop.mp3",
],
], JSON_UNESCAPED_SLASHES | JSON_UNESCAPED_UNICODE),
]);
$response = curl_exec($ch);
echo curl_getinfo($ch, CURLINFO_HTTP_CODE), " ", $response, PHP_EOL;require "net/http"
require "json"
uri = URI("https://queue.auray.run/auray-serverless/veed/fabric-1-0-hosted")
req = Net::HTTP::Post.new(uri)
req["Authorization"] = "Bearer #{ENV.fetch("AURAY_API_KEY")}"
req["Content-Type"] = "application/json"
req.body = {
"inputs" => {
"image" => "https://v3b.auray.media/examples/samples/still-life.jpg",
"audio" => "https://v3b.auray.media/examples/samples/electronic-loop.mp3"
}
}.to_json
res = Net::HTTP.start(uri.hostname, uri.port, use_ssl: true) { |http| http.request(req) }
puts res.code, res.bodyimport java.net.URI;
import java.net.http.HttpClient;
import java.net.http.HttpRequest;
import java.net.http.HttpResponse;
public class Main {
public static void main(String[] args) throws Exception {
String body = """
{
"inputs": {
"image": "https://v3b.auray.media/examples/samples/still-life.jpg",
"audio": "https://v3b.auray.media/examples/samples/electronic-loop.mp3"
}
}""";
HttpRequest request = HttpRequest.newBuilder()
.uri(URI.create("https://queue.auray.run/auray-serverless/veed/fabric-1-0-hosted"))
.header("Authorization", "Bearer " + System.getenv("AURAY_API_KEY"))
.header("Content-Type", "application/json")
.method("POST", HttpRequest.BodyPublishers.ofString(body))
.build();
HttpResponse<String> response = HttpClient.newHttpClient()
.send(request, HttpResponse.BodyHandlers.ofString());
System.out.println(response.statusCode() + " " + response.body());
}
}using System.Net.Http.Headers;
using System.Text;
using var client = new HttpClient();
client.DefaultRequestHeaders.Authorization =
new AuthenticationHeaderValue("Bearer", Environment.GetEnvironmentVariable("AURAY_API_KEY"));
using var request = new HttpRequestMessage(HttpMethod.Post, "https://queue.auray.run/auray-serverless/veed/fabric-1-0-hosted");
var body = """
{
"inputs": {
"image": "https://v3b.auray.media/examples/samples/still-life.jpg",
"audio": "https://v3b.auray.media/examples/samples/electronic-loop.mp3"
}
}
""";
request.Content = new StringContent(body, Encoding.UTF8, "application/json");
using var response = await client.SendAsync(request);
Console.WriteLine($"{(int)response.StatusCode} {await response.Content.ReadAsStringAsync()}");The same body on https://auray.run runs synchronously and answers the result — unless it usually takes longer than a run may hold its connection, which is refused 400 model_not_synchronous before anything is charged. Options — ?webhook=, ?wait=, priority and timeout headers — are on Submit a request.
#Machine contracts
- openapi.json — this page as an OpenAPI 3.1 document, public.
- llms.txt — the same, written for an agent.
