2026Supabaseopen source
Supabase Evals
Supabase Evals is an open-source benchmark and testing framework designed to evaluate how effectively AI coding agents can build, deploy, and troubleshoot projects using the Supabase platform. It provides a standardized way to measure agent performance across real-world developer tasks, such as schema design, debugging Edge Functions, and managing Row Level Security (RLS) policies.
Automated benchmarking of AI coding agents against real Supabase tasks
Support for both 'Tools' and 'Local-stack' (Docker-based) evaluation runtimes
Comprehensive scoring system using SQL checks, client calls, and LLM-as-judge reviews
pricingFree and open-source
regionUnited States