How Novita works
Novita is a serverless infrastructure platform for AI, designed to scale open-source models with low latency and reduced cost. It supports hundreds of production-ready models — including Llama, Mistral, Claude, and Stable Diffusion — and provides optimized APIs, on-demand GPUs, and custom model deployments without any DevOps overhead.Recommended Models
We recommend good coding models with +100k context window.To more updated information, please visit Novita’s website.
| Model | Pricing | Context Window |
|---|---|---|
Deepseek v3 0324 recommended | $0.33/1.3 | ~128k tokens |
| Deepseek R1 0528 | $0.7/2.5 | ~128k tokens |
| Llama 4 Maverick Instruct | $0.17/0.85 | ~100k tokens |
Creating API Key
Go directly to Novita’s API Keys page to create a new API Key. Or, follow these steps:- Go to your Novita console
- Click on the “Manage API Keys” button or go to your profile picture and click API Keys
- Click on “Add New Key” and fill with ‘Kodus’ or any name you want
- Click on “Confirm”
- Copy the API Key and save it somewhere safe
System Requirements
Recommended Hardware
Recommended Hardware
- CPU: 2+ cores - RAM: 8GB+ - Storage: 60GB+ free space
Required Software
Required Software
- Docker (latest stable version)
- Node.js (latest LTS version)
- Yarn or NPM (latest stable version)
- Domain name or fixed IP (for external deployments)
Required Ports
Required Ports
- 3000: Kodus Web App
- 3001: API
- 3332: Webhooks
- 5672, 15672, 15692: RabbitMQ (AMQP, management, metrics)
- 3101: MCP Manager (API, metrics)
- 5432: PostgreSQL - 27017: MongoDB
Internet access is only required if you plan to connect with cloud-based Git
services like GitHub, GitLab, or Bitbucket. For self-hosted Git tools within
your network, external internet access is optional.
Domain Name Setup (Optional)
If you're planning to integrate Kodus with cloud-based Git providers (GitHub, GitLab, or Bitbucket), you'll need public-facing URLs for both the Kodus Web App and its API. This allows your server to receive webhooks for proper Code Review functionality and ensures correct application behavior. We recommend setting up two subdomains:- One for the Web Application, e.g.,
kodus-web.yourdomain.com. - One for the API, e.g.,
kodus-api.yourdomain.com.
Note: If you're only connecting to self-hosted Git tools on your network and do not require public access or webhooks, you might be able to use a simpler setup, but this guide focuses on public-facing deployments.
Setup
1
Clone the installer repository
2
Copy the example environment file
3
Generate secure keys for the required environment variables
4
Edit the environment file
Edit See Environment Variables Configuration for detailed instructions.
.env with your values using your preferred text editor.5
Run the installer
6
Success 🎉
When complete, Kodus Services should be running on your machine.
You can verify your installation using the following script:
7
Access the web interface
Once you access the web interface for the first time, you'll need to:
- Create your admin account - This will be the first user with full system access
- Configure your Git provider - Connect GitHub, GitLab, or Bitbucket following the on-screen instructions
- Select repositories for analysis - Choose which code repositories Kody will review
For detailed steps on the initial configuration process, refer to our Getting
Started Guide.
Configure Novita in Environment File
Edit your.env file and configure the core settings. For LLM Integration, use Novita in Fixed Mode:
Fixed Mode is ideal for Novita because it provides OpenAI-compatible APIs and requires only one API key. This simplifies your setup significantly.
Run the Installation Script
Set the proper permissions for the installation script:What the Installer Does
Our installer automates several important steps:- Verifies Docker installation
- Creates networks for Kodus services
- Clones repositories and configures environment files
- Runs docker-compose to start all services
- Executes database migrations
- Seeds initial data
http://localhost:3000 - you should see the Kodus Web Application interface.
6. Set Up Reverse Proxy (For Production)
For webhooks and external access, configure Nginx:Verify Novita Integration
In addition to the basic installation verification, confirm that Novita is working:Troubleshooting
API Key Issues
API Key Issues
- Verify your API key is correct and active in Novita’s console
- Check if you have sufficient credits in your Novita account
- Ensure there are no extra spaces in your
.envfile
Model Not Found
Model Not Found
- Check if the model name is correctly spelled in your configuration
- Verify the model is available in your Novita plan
- Try with a different model from our recommended list
Connection Errors
Connection Errors
- Verify your server has internet access to reach
api.novita.ai - Check if there are any firewall restrictions
- Review the API/worker logs for detailed error messages