Groq
Before you begin
In order to use the features in this section you need to have an active Spojit account. If you don't have an account you can checkout out the pricing and register here. If you already have an account you can login here.
Groq is an AI computing company that specializes in developing high-performance hardware and software solutions for large language models, enabling faster and more efficient processing of complex AI workloads. The company's technology is designed to accelerate the training and deployment of large language models, such as those used in natural language processing, conversational AI, and other applications, allowing for faster innovation and better decision-making.
Authorization¶
The following authorization configuration needs to filled out in order to use Groq models:
| Option | Description | Default | Required |
|---|---|---|---|
| API Key | The API Key that you want to use for the model. | - | TRUE |
| Model | The model you want to use (view models below). | - | TRUE |
| Temperature | The sampling temperature to use between 0 and 2. High values will produce a more random response. | 0.1 | TRUE |
| Max Tokens | Limit the number of tokens in the model's response. | - | FALSE |
Models¶
The following Groq models can be used:
| Model | Description | Vision | Tools |
|---|---|---|---|
| llama-3.3-70b-versatile | Optimized for a wide range of natural language processing tasks | FALSE | TRUE |
Don't see a model you want to use?
We are adding new models all the time. Contact us now and we'll look at adding the model you want.