> For the complete documentation index, see [llms.txt](https://docs.cherryai.com.cn/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.cherryai.com.cn/docs/en-us/pre-basic/providers/groq.md).

# Groq

Groq (note: not xAI's Grok) is a **LPU hardware acceleration, ultra-low latency** specialized inference service that mainly hosts open-source models such as Llama / Mixtral / Whisper, and its output speed is usually several times that of ordinary cloud inference.

## Get an API Key

* Go to [GroqCloud](https://console.groq.com/) Register account
* `API Keys` → `Create API Key`, copy `gsk_...` Key

## Configure in Cherry Studio

* Open `Settings → Model Services`, find **Groq** Provider to enter the details page
* **API key** Fill in `gsk_...`
* **API address** Default `https://api.groq.com/openai/v1`, no need to modify
* Click **Get model list**

## Recommended usage

| Model                     | Suitable scenarios                       |
| ------------------------- | ---------------------------------------- |
| `llama-3.3-70b-versatile` | General chat, extremely fast             |
| `llama-3.1-8b-instant`    | Simple tasks, millisecond-level response |
| `mixtral-8x7b-32768`      | Long context                             |
| `whisper-large-v3`        | Speech to text                           |

## Applicable scenarios

* **Real-time chatbot**: Groq's "near-instant response" is very suitable for IM integration (paired with [channel](/docs/en-us/advanced-basic/agent-channels.md))
* **high concurrency**: tokens per second are significantly higher than ordinary cloud inference
* **Don't care about having the latest model**: Groq mainly hosts open-source models such as Llama, and does not have closed-source models like GPT-5 / Claude-4

## Distinguishing Grok vs Groq

|         | [Grok](/docs/en-us/pre-basic/providers/grok.md) | Groq                                       |
| ------- | ----------------------------------------------- | ------------------------------------------ |
| Company | xAI (Musk)                                      | Groq Inc.                                  |
| Focus   | Self-developed large models + web access        | LPU hardware + open-source model inference |
| Model   | `grok-4` and other in-house                     | `llama-3.x` and other open-source          |

{% hint style="warning" %}
Grok (xAI) and Groq are often confused. In the Cherry Studio Provider list, they are two separate entries, so please pay attention to the distinction.
{% endhint %}

***

### 💡 Get help and submit feedback

If you encounter any questions, bugs, or have suggestions for feature improvements during configuration or use, please refer to [Feedback and Suggestions](/docs/en-us/question-contact/suggestions.md) the official channels provided there.


---

# Agent Instructions
This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com.

## Querying This Documentation
If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter, and the optional `goal` query parameter:

```
GET https://docs.cherryai.com.cn/docs/en-us/pre-basic/providers/groq.md?ask=<question>&goal=<endgoal>
```

`ask` is the immediate question: it should be specific, self-contained, and written in natural language.
`goal` is optional and describes the broader end goal you are ultimately trying to accomplish on behalf of the user. GitBook uses it to tailor the answer towards what is most useful for that goal.

The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.