Groq Integration

Groq provides fast LLM inference.

Guidelines

• The Groq integration uses the GROQ_API_KEY environment variable.
• The Groq integration should ONLY be used if specifically requested by the user.
• Otherwise, use the Vercel AI Gateway and AI SDK so the user does not need to configure anything.

Environment Variables

• GROQ_API_KEY - Groq API key

Example Usage

import { generateText } from 'ai'
import { createGroq } from '@ai-sdk/groq'

const groq = createGroq({
  apiKey: process.env.GROQ_API_KEY,
})

const { text } = await generateText({
  model: groq('llama-3.3-70b-versatile'),
  prompt: 'What is the meaning of life?',
})