Skip to main content
POST
llama-3.1-8b-instruct-fast: Responses
Meta’s Llama 3.1 Instruct, tuned for fast, low-cost summarization at scale on the ZeroGPU edge network. Its 128K-token context window takes in entire documents, long transcripts, and full email or chat threads in a single pass. No chunking, no stitching partial summaries back together. Built for the high-volume summarization that runs around your core product: condensing long reports and transcripts, summarizing email and chat threads, and processing articles in bulk. When context length matters and you’re summarizing on every request, this is the model that keeps it fast and affordable.
References: Model docsTermsPrivacy

Authorizations

x-api-key
string
header
required

Headers

x-project-id
string

Optional project identifier. Scopes the request to a specific project when provided.

Body

application/json
model
string
default:llama-3.1-8b-instruct-fast
required

Model identifier (fixed for this playground). Use request examples to change use cases.

Allowed value: "llama-3.1-8b-instruct-fast"
Example:

"llama-3.1-8b-instruct-fast"

input
string<textarea>
required

Multi-line text or document content to send to the model.

Required string length: 1 - 131072

Response

Success

The response is of type object.