Integration / Developer Tools & DevOps

Fireworks AI integration

Fireworks AI provides APIs for serverless model inference, fine-tuning, deployments, datasets, evaluations, and account management.

About Fireworks AI

Fireworks AI is a serverless AI platform for model inference, fine-tuning, deployments, datasets, and evaluations. Use it to run fast open-model workflows without managing GPU infrastructure.

Example prompts

“List active Fireworks AI deployments”

“Run Llama inference on customer text”

“Create dataset for fine tuning”

Available actions

Create Chat Completion
Generate one non-streaming OpenAI-compatible chat completion from role-based messages using a caller-supplied Fireworks model or deployment ID.
Create Embeddings
Create embedding vectors for one or more caller-provided inputs using a caller-supplied Fireworks embedding model.
Generate Model Response
Generate one non-streaming Responses API result, optionally continuing a stored response or using function, MCP, or SSE tools; storage is off by default.
Get Deployment
Return configuration and serving status for one Fireworks deployment without scaling or modifying it.
Get Model
Return metadata and status for one model resource in a Fireworks account; this does not test whether the model can serve inference.
List Accounts
Return one page of Fireworks accounts accessible to the API key so an agent can obtain account IDs for model and deployment discovery.
List Deployments
Return one page of deployment resources in a Fireworks account for deployment ID discovery and serving-capacity and status inspection.
List Models
Return one page of model resources in a Fireworks account for model-ID discovery and status inspection; availability for inference is not guaranteed.
Rerank Documents
Rank a provided document list by relevance to a query using an optional caller-supplied Fireworks reranker model.

Connect it once and every workspace, agent and workflow can use it — securely, with your team in the loop.