Groq 的工作原理
Groq Cloud 提供快速的 LLM 推理和兼容 OpenAI 的 API。专为速度和简洁性而构建,Groq 为流行模型(如 Llama、Deepseek 等)提供超快速推理。该平台设计简单易集成且易于扩展,非常适合生产应用。推荐模型
我们推荐具有高上下文窗口和快速推理的优秀编码模型。如需最新信息,请访问 Groq 的模型页面。
| 模型 | 上下文窗口 | 速度 |
|---|---|---|
Llama 3.3 70B Versatile 推荐 | ~128k 令牌 | 超快速 |
| Deepseek R1 Distill Llama 70B | ~128k 令牌 | 超快速 |
| Llama 3.1 70B Versatile | ~128k 令牌 | 超快速 |
创建 API 密钥
直接访问 Groq 的 API 密钥页面创建新的 API 密钥。 或者,按照以下步骤操作:- 访问 Groq 控制台
- 登录或创建您的账户
- 在顶部导航中导航到”API Keys”
- 点击”Create API Key”按钮
- 为其命名,例如’Kodus’或任何描述性名称
- 复制 API 密钥并将其保存在安全的地方
在 Groq 中,只有团队所有者或具有开发者角色的用户可以创建或管理 API 密钥。
如何使用
System Requirements
Recommended Hardware
Recommended Hardware
- CPU: 2+ cores - RAM: 8GB+ - Storage: 60GB+ free space
Required Software
Required Software
- Docker (latest stable version)
- Node.js (latest LTS version)
- Yarn or NPM (latest stable version)
- Domain name or fixed IP (for external deployments)
Required Ports
Required Ports
- 3000: Kodus Web App
- 3001: API
- 3332: Webhooks
- 5672, 15672, 15692: RabbitMQ (AMQP, management, metrics)
- 3101: MCP Manager (API, metrics)
- 5432: PostgreSQL - 27017: MongoDB
Internet access is only required if you plan to connect with cloud-based Git
services like GitHub, GitLab, or Bitbucket. For self-hosted Git tools within
your network, external internet access is optional.
Domain Name Setup (Optional)
If you're planning to integrate Kodus with cloud-based Git providers (GitHub, GitLab, or Bitbucket), you'll need public-facing URLs for both the Kodus Web App and its API. This allows your server to receive webhooks for proper Code Review functionality and ensures correct application behavior. We recommend setting up two subdomains:- One for the Web Application, e.g.,
kodus-web.yourdomain.com. - One for the API, e.g.,
kodus-api.yourdomain.com.
Note: If you're only connecting to self-hosted Git tools on your network and do not require public access or webhooks, you might be able to use a simpler setup, but this guide focuses on public-facing deployments.
Setup
1
Clone the installer repository
2
Copy the example environment file
3
Generate secure keys for the required environment variables
4
Edit the environment file
Edit See Environment Variables Configuration for detailed instructions.
.env with your values using your preferred text editor.5
Run the installer
6
Success 🎉
When complete, Kodus Services should be running on your machine.
You can verify your installation using the following script:
7
Access the web interface
Once you access the web interface for the first time, you'll need to:
- Create your admin account - This will be the first user with full system access
- Configure your Git provider - Connect GitHub, GitLab, or Bitbucket following the on-screen instructions
- Select repositories for analysis - Choose which code repositories Kody will review
For detailed steps on the initial configuration process, refer to our Getting
Started Guide.
在环境文件中配置 Groq
编辑您的.env 文件并配置核心设置。对于 LLM 集成,在固定模式下使用 Groq:
固定模式非常适合 Groq,因为它提供兼容 OpenAI 的 API 和超快速推理。这为您提供了最佳性能和简单配置。
Run the Installation Script
Set the proper permissions for the installation script:What the Installer Does
Our installer automates several important steps:- Verifies Docker installation
- Creates networks for Kodus services
- Clones repositories and configures environment files
- Runs docker-compose to start all services
- Executes database migrations
- Seeds initial data
http://localhost:3000 - you should see the Kodus Web Application interface.
设置反向代理(用于生产环境)
对于 Webhook 和外部访问,配置 Nginx:验证 Groq 集成
除了基本的安装验证外,确认 Groq 正常工作:故障排除
API 密钥问题
API 密钥问题
- 在 Groq 控制台中验证您的 API 密钥是否正确且处于活动状态
- 检查您的 Groq 账户中是否有足够的信用额度或配额
- 确保您的
.env文件中没有多余的空格
模型未找到
模型未找到
- 检查配置中的模型名称拼写是否正确
- 验证该模型在 Groq 当前的模型列表中是否可用
- 尝试使用我们推荐列表中的其他模型
连接错误
连接错误
- 验证您的服务器是否有互联网访问权限以访问
api.groq.com - 检查是否有任何防火墙限制
- 查看 API/worker 日志以获取详细的错误消息
速率限制
速率限制
- Groq 根据您的计划有速率限制
- 查看 Groq 速率限制文档
- 考虑升级您的计划以获得更高的限制