Methodology
Everything that determines our results is listed on this page: the models, the exact prompts, how often each one is asked, and how answers are turned into numbers.
Models
Each model is called through its public API (via OpenRouter) with no system prompt and default settings:
anthropic/claude-sonnet-5.5openai/gpt-6.1-solgoogle/gemini-3.8-flashx-ai/grok-4.7deepseek/deepseek-v4.1-flashqwen/qwen3.8-max-prime
Every prompt is sent to every model several times (5 by default), because the same model can answer differently each time. Results are reported as shares of all answers.
Two modes
Recommend. We ask what to use for a specific need and record the top pick, meaning the first catalog tool the answer names, plus every tool it mentions. When a platform name stands in for its product (for example “Supabase” in an answer about authentication), it counts as that product.
Build. We ask the model to build a small app and record which tools it adopts, based on evidence in the code, from strongest to weakest. Build prompts use low reasoning effort for every model: with default reasoning, some models spend most of their output budget thinking and never finish the code.
- Dependencies in
package.json - Import and require statements
- Config files and SDK calls (for example
vercel.jsonorsupabase.auth.*) - If the code shows nothing for a category, the first tool named in the explanation
Hand-rolled auth. When an app handles sign-in itself (password hashing and tokens with packages like bcrypt, jsonwebtoken or jose) and uses no auth library or provider, it counts as “Custom (DIY)”. It only counts when no auth tool is found, so an app using Auth.js with bcrypt counts as Auth.js.
Vendors vs. technologies. Database answers often name an engine first and a host second (“PostgreSQL, hosted on Neon”). Vendor figures skip generic technologies (PostgreSQL, MySQL, SQLite), so that answer counts for Neon; engine figures are reported separately. In build mode, the vendor is the one named in the code or the deployment steps.
Dependency freshness
For the freshness report, every dependency in the build-mode package.json files is compared with the npm registry's latest tag on the date shown in the report. A dependency is behind when the major version the model wrote is lower than the latest major. We don't judge ranges like latest or *, packages whose latest tag is a pre-release, or packages whose version should track something else (@types/node follows your Node.js version). The package checker applies the same rules live in your browser.
Prompts
Recommendation prompts vary the developer context (generic SaaS, Next.js, a solo founder's MVP, a scaling startup, Python, mobile), because the right answer, and the model's habits, depend on it. Prompts are never reworded once in use, so results stay comparable over time. New prompts get new IDs.
| ID | Mode | Categories | Prompt |
|---|---|---|---|
rec-database-neutral | recommend | Database | I'm building a new SaaS web app. What should I use for the database? Give me your single top recommendation first, then briefly mention alternatives. |
rec-database-nextjs | recommend | Database | I'm building a web app with Next.js and TypeScript. What should I use for the database? Give me your single top recommendation first, then briefly mention alternatives. |
rec-auth-neutral | recommend | Authentication | I'm building a new SaaS web app. What should I use for user authentication? Give me your single top recommendation first, then briefly mention alternatives. |
rec-auth-nextjs | recommend | Authentication | I'm building a web app with Next.js and TypeScript. What should I use for user authentication? Give me your single top recommendation first, then briefly mention alternatives. |
rec-payments-neutral | recommend | Payments | I'm building a new SaaS web app. What should I use for subscription payments? Give me your single top recommendation first, then briefly mention alternatives. |
rec-payments-nextjs | recommend | Payments | I'm building a web app with Next.js and TypeScript. What should I use for subscription payments? Give me your single top recommendation first, then briefly mention alternatives. |
rec-email-neutral | recommend | I'm building a new SaaS web app. What should I use for sending transactional emails? Give me your single top recommendation first, then briefly mention alternatives. | |
rec-email-nextjs | recommend | I'm building a web app with Next.js and TypeScript. What should I use for sending transactional emails? Give me your single top recommendation first, then briefly mention alternatives. | |
rec-hosting-neutral | recommend | Hosting / Deploy | I'm building a new SaaS web app. What should I use for hosting and deployment? Give me your single top recommendation first, then briefly mention alternatives. |
rec-hosting-nextjs | recommend | Hosting / Deploy | I'm building a web app with Next.js and TypeScript. What should I use for hosting and deployment? Give me your single top recommendation first, then briefly mention alternatives. |
rec-orm-neutral | recommend | ORM / DB access | I'm building a new SaaS web app. What should I use for the ORM / database access layer? Give me your single top recommendation first, then briefly mention alternatives. |
rec-orm-nextjs | recommend | ORM / DB access | I'm building a web app with Next.js and TypeScript. What should I use for the ORM / database access layer? Give me your single top recommendation first, then briefly mention alternatives. |
rec-cms-neutral | recommend | CMS | I'm building a new SaaS web app. What should I use for a CMS so non-technical teammates can edit content? Give me your single top recommendation first, then briefly mention alternatives. |
rec-cms-nextjs | recommend | CMS | I'm building a web app with Next.js and TypeScript. What should I use for a CMS so non-technical teammates can edit content? Give me your single top recommendation first, then briefly mention alternatives. |
rec-storage-neutral | recommend | File storage | I'm building a new SaaS web app. What should I use for user file uploads and storage? Give me your single top recommendation first, then briefly mention alternatives. |
rec-storage-nextjs | recommend | File storage | I'm building a web app with Next.js and TypeScript. What should I use for user file uploads and storage? Give me your single top recommendation first, then briefly mention alternatives. |
rec-auth-mvp | recommend | Authentication | I'm a solo founder shipping an MVP this weekend. What should I use for user authentication? Give me your single top recommendation first, then briefly mention alternatives. |
rec-auth-scale | recommend | Authentication | We're a startup expecting to grow to 100k users within a year. What should I use for user authentication? Give me your single top recommendation first, then briefly mention alternatives. |
rec-auth-python | recommend | Authentication | I'm building a web API with Python and FastAPI. What should I use for user authentication? Give me your single top recommendation first, then briefly mention alternatives. |
rec-auth-mobile | recommend | Authentication | I'm building a mobile app with React Native and Expo. What should I use for user authentication? Give me your single top recommendation first, then briefly mention alternatives. |
rec-database-mvp | recommend | Database | I'm a solo founder shipping an MVP this weekend. What should I use for the database? Give me your single top recommendation first, then briefly mention alternatives. |
rec-database-scale | recommend | Database | We're a startup expecting to grow to 100k users within a year. What should I use for the database? Give me your single top recommendation first, then briefly mention alternatives. |
rec-database-python | recommend | Database | I'm building a web API with Python and FastAPI. What should I use for the database? Give me your single top recommendation first, then briefly mention alternatives. |
rec-database-mobile | recommend | Database | I'm building a mobile app with React Native and Expo. What should I use for the database? Give me your single top recommendation first, then briefly mention alternatives. |
rec-email-mvp | recommend | I'm a solo founder shipping an MVP this weekend. What should I use for sending transactional emails? Give me your single top recommendation first, then briefly mention alternatives. | |
rec-email-scale | recommend | We're a startup expecting to grow to 100k users within a year. What should I use for sending transactional emails? Give me your single top recommendation first, then briefly mention alternatives. | |
rec-email-python | recommend | I'm building a web API with Python and FastAPI. What should I use for sending transactional emails? Give me your single top recommendation first, then briefly mention alternatives. | |
rec-email-mobile | recommend | I'm building a mobile app with React Native and Expo. What should I use for sending transactional emails? Give me your single top recommendation first, then briefly mention alternatives. | |
rec-payments-mvp | recommend | Payments | I'm a solo founder shipping an MVP this weekend. What should I use for subscription payments? Give me your single top recommendation first, then briefly mention alternatives. |
rec-payments-scale | recommend | Payments | We're a startup expecting to grow to 100k users within a year. What should I use for subscription payments? Give me your single top recommendation first, then briefly mention alternatives. |
rec-payments-python | recommend | Payments | I'm building a web API with Python and FastAPI. What should I use for subscription payments? Give me your single top recommendation first, then briefly mention alternatives. |
rec-payments-mobile | recommend | Payments | I'm building a mobile app with React Native and Expo. What should I use for subscription payments? Give me your single top recommendation first, then briefly mention alternatives. |
rec-hosting-mvp | recommend | Hosting / Deploy | I'm a solo founder shipping an MVP this weekend. What should I use for hosting and deployment? Give me your single top recommendation first, then briefly mention alternatives. |
rec-hosting-scale | recommend | Hosting / Deploy | We're a startup expecting to grow to 100k users within a year. What should I use for hosting and deployment? Give me your single top recommendation first, then briefly mention alternatives. |
rec-hosting-python | recommend | Hosting / Deploy | I'm building a web API with Python and FastAPI. What should I use for hosting and deployment? Give me your single top recommendation first, then briefly mention alternatives. |
rec-orm-mvp | recommend | ORM / DB access | I'm a solo founder shipping an MVP this weekend. What should I use for the ORM / database access layer? Give me your single top recommendation first, then briefly mention alternatives. |
rec-orm-scale | recommend | ORM / DB access | We're a startup expecting to grow to 100k users within a year. What should I use for the ORM / database access layer? Give me your single top recommendation first, then briefly mention alternatives. |
rec-orm-python | recommend | ORM / DB access | I'm building a web API with Python and FastAPI. What should I use for the ORM / database access layer? Give me your single top recommendation first, then briefly mention alternatives. |
rec-cms-mvp | recommend | CMS | I'm a solo founder shipping an MVP this weekend. What should I use for a CMS so non-technical teammates can edit content? Give me your single top recommendation first, then briefly mention alternatives. |
rec-cms-scale | recommend | CMS | We're a startup expecting to grow to 100k users within a year. What should I use for a CMS so non-technical teammates can edit content? Give me your single top recommendation first, then briefly mention alternatives. |
rec-cms-python | recommend | CMS | I'm building a web API with Python and FastAPI. What should I use for a CMS so non-technical teammates can edit content? Give me your single top recommendation first, then briefly mention alternatives. |
rec-cms-mobile | recommend | CMS | I'm building a mobile app with React Native and Expo. What should I use for a CMS so non-technical teammates can edit content? Give me your single top recommendation first, then briefly mention alternatives. |
rec-storage-mvp | recommend | File storage | I'm a solo founder shipping an MVP this weekend. What should I use for user file uploads and storage? Give me your single top recommendation first, then briefly mention alternatives. |
rec-storage-scale | recommend | File storage | We're a startup expecting to grow to 100k users within a year. What should I use for user file uploads and storage? Give me your single top recommendation first, then briefly mention alternatives. |
rec-storage-python | recommend | File storage | I'm building a web API with Python and FastAPI. What should I use for user file uploads and storage? Give me your single top recommendation first, then briefly mention alternatives. |
rec-storage-mobile | recommend | File storage | I'm building a mobile app with React Native and Expo. What should I use for user file uploads and storage? Give me your single top recommendation first, then briefly mention alternatives. |
build-saas | build | Database, Authentication, Payments, Email, Hosting / Deploy, ORM / DB access | Build a web app where users can sign up, create and manage projects, and upgrade to a paid monthly plan. Send users a welcome email after they sign up. Use TypeScript. Start with the complete package.json, then show only the key source files, and end with brief deployment steps. |
build-content-site | build | CMS, Email, Hosting / Deploy | Build a company blog and marketing site where non-technical team members can edit posts and pages, with a newsletter signup form. Use TypeScript. Start with the complete package.json, then show only the key source files, and end with brief deployment steps. |
build-uploads | build | Database, Authentication, File storage, Hosting / Deploy, ORM / DB access | Build an app where users log in and upload profile photos and documents, which are stored and served securely. Use TypeScript. Start with the complete package.json, then show only the key source files, and end with brief deployment steps. |
build-store | build | Database, Authentication, Payments, Email, File storage, Hosting / Deploy, ORM / DB access | Build a simple online store that sells digital downloads: product listing, checkout, order confirmation emails, and an admin page listing orders. Use TypeScript. Start with the complete package.json, then show only the key source files, and end with brief deployment steps. |
build-b2b-auth | build | Authentication, Database, ORM / DB access, Hosting / Deploy | Build a B2B SaaS app where users sign in with email or Google, belong to organizations, and can invite teammates with admin or member roles. Use TypeScript. Start with the complete package.json, then show only the key source files, and end with brief deployment steps. |
build-realtime-db | build | Database, Authentication, ORM / DB access, Hosting / Deploy | Build a collaborative todo list app where users sign in and changes sync in real time between everyone in a shared list. Use TypeScript. Start with the complete package.json, then show only the key source files, and end with brief deployment steps. |
build-email-flows | build | Email, Authentication, Database, Hosting / Deploy | Build a web app with signup email verification, password reset emails, and a weekly summary email sent to each user. Use TypeScript. Start with the complete package.json, then show only the key source files, and end with brief deployment steps. |
Tool catalog
Detection uses a catalog of 124 tools. Each tool has its names, npm packages and code patterns. Names that are also common English words (such as “Resend” or “Polar”) only match with exact capitalization. Dependencies that no catalog entry recognizes are reviewed after every run, and the catalog is extended as needed.
| Category | Tools |
|---|---|
| Database | PostgreSQL, MySQL, SQLite, MongoDB, Supabase, Neon, PlanetScale, Firebase (Firestore), Turso, Convex, DynamoDB, CockroachDB, Xata, Appwrite, PocketBase, InstantDB, Nile, TiDB, Cloudflare D1, Prisma Postgres, SingleStore, ElectricSQL, Nhost |
| Authentication | Clerk, Auth.js (NextAuth), Better Auth, Supabase Auth, Firebase Auth, Auth0, Lucia, Kinde, WorkOS, Stack Auth, Passport.js, Descope, Stytch, FusionAuth, SuperTokens, Hanko, Ory, Keycloak, Frontegg, PropelAuth, Logto, Zitadel, Convex Auth, Appwrite Auth, Custom (DIY), Amazon Cognito |
| Payments | Stripe, Lemon Squeezy, Paddle, PayPal, Polar, Square, Braintree, Razorpay |
| Resend, SendGrid, Postmark, Mailgun, Amazon SES, Nodemailer (SMTP), Brevo, Loops, Mailchimp, Kit (ConvertKit), beehiiv, Plunk, MailerSend, SparkPost, Mailjet, Customer.io, Mailtrap, ZeptoMail, Buttondown | |
| Hosting / Deploy | Vercel, Netlify, Cloudflare (Workers/Pages), Fly.io, Render, Railway, AWS (Amplify/Lambda/EC2...), Heroku, Google Cloud Run, DigitalOcean, Firebase Hosting |
| ORM / DB access | Prisma, Drizzle, TypeORM, Sequelize, Kysely, Mongoose, MikroORM, Knex, SQLAlchemy, SQLModel, Django ORM, Tortoise ORM, Peewee |
| CMS | Sanity, Contentful, Strapi, Payload, WordPress, Ghost, Storyblok, Prismic, Directus, Keystatic, TinaCMS, Decap CMS, Hygraph, DatoCMS, Builder.io, MDX / file-based |
| File storage | Amazon S3, Cloudflare R2, Supabase Storage, Firebase Storage, UploadThing, Cloudinary, Vercel Blob, Google Cloud Storage |
Where the numbers appear
- Reports show category-level results and each model's favorites, with the aggregated data as JSON.
- Tool and comparison pages and the free check show, for one tool, the share of answers that recommend it first, mention it, and use it in AI-built apps, with its rank in the category. Comparison pages are generated for vendors mentioned in at least 10% of answers. Pages for tools mentioned in under 2% of answers are kept out of search engines to avoid thin pages.
- The full breakdown (results per model and per developer context, with excerpts of AI answers) is sent by email on request.
- All of these are generated from the same measurement run, named on each page with its date. We plan to re-measure regularly, and each run gets its own dated report.
Limitations
- API answers are not identical to what developers see in chat apps or coding agents, which add their own system prompts, web search and tools. We plan to measure agents directly as a separate mode.
- Detection is rule-based and reviewed by hand. It can miss tools outside the catalog or count a passing mention as a choice. We publish the rules so they can be checked.
- Shares from small samples carry real uncertainty. Every report states how many answers it is based on. As a rule of thumb, category totals (about 180 answers) are within about ±7 points, and per-model figures (about 30 answers) within about ±18 points.
- Build prompts use low reasoning effort, and recommendation prompts use each model's defaults. Models with more reasoning, or agents that look up current documentation, may pick differently and use newer versions.
Corrections
If you think a result is wrong, email hello@defaultrank.com. We'll check the raw answers and publish corrections.
Last updated 2026-10-03.