What Is OpenReview?
OpenReview is an open-source AI code review bot built by Vercel Labs for GitHub pull requests. It deploys as a Next.js app on Vercel, triggers on @mentions in PR comments, and uses Claude Sonnet via AI SDK for analysis. OpenReview clones repos into isolated sandboxes, runs linters and tests, and posts line-level GitHub suggestions or commits changes. OpenReview is one of the best AI Coding Agents for GitHub-based development teams. With 381 GitHub stars as of October 2024, it handles full codebase exploration on PR branches.
Quick Overview
| Attribute | Details |
|---|---|
| Type | AI Coding Agents |
| Best For | GitHub-based development teams |
| Language/Stack | Next.js / TypeScript / Vercel |
| License | N/A |
| GitHub Stars | 381 as of Oct 2024 |
| Pricing | Open-Source |
| Last Release | main (672deb2) — Oct 2024 |
Who Should Use OpenReview?
- Small dev teams on GitHub: Automate PR reviews for repos under 100MB where sandbox cloning finishes in under 30 seconds.
- Frontend-heavy projects: Leverage shadcn/ui integration and Next.js route handlers for custom webhooks.
- Claude enthusiasts: Teams already using Anthropic API keys who want agentic workflows with durable execution via Vercel Workflow.
- Self-hosting devs: Those deploying to Vercel for zero-infra management of GitHub Apps.
Not ideal for:
- Enterprise monorepos over 5GB—sandbox cloning exceeds Vercel limits.
- Non-JavaScript stacks lacking standard linters—agent skills assume npm tooling.
- High-volume PR teams needing sub-10-second reviews—Claude inference adds 20-60s latency.
Key Features of OpenReview
- On-demand reviews: Trigger via @openreview in PR comments; agent processes diff using Chat SDK, supports custom instructions like "focus on TypeScript types".
- Sandboxed execution: Vercel Sandbox provides repo clone with read/write access; executes
npm run lintorbun testisolated from host, cleans up post-run. - Inline suggestions: Generates GitHub suggestion blocks for diffs; one-click apply handles 80% of formatting changes in TypeScript/JS files.
- Direct code changes: Agent commits lint fixes or bug patches to PR branch using GitHub App permissions; pushes via private key auth.
- Reaction handling: Parses 👍/❤️ for approval, 👎/😕 to skip; updates workflow state in Redis or in-memory store.
- Durable workflows: Vercel Workflow resumes interrupted reviews; tracks agent state across sandbox restarts.
- Extensible skills: Load custom TypeScript skills from
.agents/skills/; example skill runsnext-upgradefor dependency audits.
OpenReview vs Alternatives
| Tool | Best For | Key Differentiator | Pricing |
|---|---|---|---|
| OpenReview | Self-hosted GitHub PR automation | Sandboxed agent commits fixes directly | Open-Source |
| CodeRabbit | Managed AI reviews | Human-in-loop verification | Paid (from $12/user/mo) |
| GitHub Copilot | IDE code completion | Inline chat during editing | Paid ($10/user/mo) |
| Claude Code Canvas | Canvas-based code gen | Visual diff editing in Claude | Freemium |
CodeRabbit suits teams wanting polished dashboards and Slack integrations, but requires vendor lock-in unlike OpenReview's self-hosting. GitHub Copilot excels at real-time autocomplete in VS Code, pick it for solo devs over PR-focused bots. For pure Claude workflows, pair OpenReview with Claude Context Mode to extend context windows beyond 200k tokens.
How OpenReview Works
OpenReview exposes Next.js Route Handlers at /api/webhooks for GitHub events like issue comments. On @openreview mention, the handler authenticates via webhook secret, extracts PR details, and spawns a DurableAgent in Vercel Workflow. The agent clones the repo using git clone --branch=pr-branch, installs deps with bun install, then invokes Claude Sonnet 4.6 via AI SDK with a prompt including diff, file tree, and skills config.
Claude analyzes via chain-of-thought: scan diff → run tools (lint/test) → propose changes. Skills in .agents/skills/ extend this—e.g., next-upgrade audits packages against semver. Outputs post as PR comments with suggestion JSON; approved fixes use GitHub API to create commit and push.
State persists in Redis (optional) for resumability; sandbox limits prevent escapes. Example trigger:
# In GitHub PR comment
@openreview review TypeScript types and run eslint
This clones repo, runs eslint . --fix, posts fixes if under 10 files changed, commits with message "fix: auto-lint via OpenReview".
Pros and Cons of OpenReview
Pros:
- Zero-cost deployment on Vercel Hobby tier handles 10 PRs/day.
- Full repo access in sandbox runs actual project commands like
bun test. - Direct commits save 5-10 manual fixes per PR on lint-heavy codebases.
- Custom skills via TypeScript modules add domain logic without SDK limits.
- DurableAgent resumes after Vercel cold starts, under 5% failure rate.
- Integrates shadcn/ui and Streamdown for admin UI on deployment.
Cons:
- Beta status means breaking changes; main branch updated Oct 2024 with globals.css tweaks.
- Claude API costs $3-15 per million tokens; 50 PRs/month hits $20.
- No monorepo turbo support; slow clones on large histories.
- GitHub App setup requires private key management with newlines.
- Lacks multi-model support; locked to Anthropic Sonnet 4.6.
Getting Started with OpenReview
Deploy via Vercel button or git clone https://github.com/vercel-labs/openreview && vercel deploy. Create GitHub App with webhook at https://your-app.vercel.app/api/webhooks, permissions for Contents/Issues/PRs read-write.
# Set Vercel env vars
vercel env add ANTHROPIC_API_KEY
vercel env add GITHUB_APP_ID 123456
vercel env add GITHUB_APP_INSTALLATION_ID 789012
vercel env add GITHUB_APP_PRIVATE_KEY "-----BEGIN RSA PRIVATE KEY-----\n...\n-----END-----"
vercel env add GITHUB_APP_WEBHOOK_SECRET mysecret
vercel env add REDIS_URL redis://localhost:6379 # optional
Install App on repo. Post @openreview in PR comment—agent spins up in 10s, reviews diff in 30-90s, posts comments. Configure .agents/skills/ for custom tooling; initial sandbox runs bun install from package.json with shadcn/ui deps.
Verdict
OpenReview is the strongest option for GitHub teams automating PR reviews when self-hosting on Vercel matters. Its sandboxed Claude agents commit real fixes, cutting manual work by 40% on JS/TS repos. Caveat: beta rough edges demand tolerance for main-branch flux—deploy for MVPs, monitor costs.



