Skip to content

Add 50, 100, 500 concurrent step benchmarks #845

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
pranaygp wants to merge 1 commit into
base: main
Choose a base branch
from
Draft

Add 50, 100, 500 concurrent step benchmarks #845

pranaygp wants to merge 1 commit into from

Conversation

@pranaygp
Copy link
Collaborator

@pranaygp pranaygp commented Jan 24, 2026

Summary

  • Enable Promise.all and Promise.race benchmarks for 50, 100, and 500 concurrent steps
  • Previously only 10 and 25 were enabled; 100+ were skipped
  • All new tests run with 1 sample each

Test plan

  • CI benchmarks run successfully with the new concurrent step counts

🤖 Generated with Claude Code

@pranaygp @claude
Add 50, 100, 500 concurrent step benchmarks
20ac495 
Enable Promise.all and Promise.race benchmarks for 50, 100, and 500
concurrent steps (previously 100+ were skipped).

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Copilot AI review requested due to automatic review settings January 24, 2026 00:08
@vercel
Copy link
Contributor

vercel bot commented Jan 24, 2026 •
edited
Loading

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
example-nextjs-workflow-turbopack Ready Ready Preview, Comment Jan 24, 2026 0:10am
example-nextjs-workflow-webpack Ready Ready Preview, Comment Jan 24, 2026 0:10am
example-workflow Ready Ready Preview, Comment Jan 24, 2026 0:10am
workbench-astro-workflow Ready Ready Preview, Comment Jan 24, 2026 0:10am
workbench-express-workflow Ready Ready Preview, Comment Jan 24, 2026 0:10am
workbench-fastify-workflow Ready Ready Preview, Comment Jan 24, 2026 0:10am
workbench-hono-workflow Ready Ready Preview, Comment Jan 24, 2026 0:10am
workbench-nitro-workflow Ready Ready Preview, Comment Jan 24, 2026 0:10am
workbench-nuxt-workflow Ready Ready Preview, Comment Jan 24, 2026 0:10am
workbench-sveltekit-workflow Ready Ready Preview, Comment Jan 24, 2026 0:10am
workbench-vite-workflow Ready Ready Preview, Comment Jan 24, 2026 0:10am
workflow-docs Ready Ready Preview, Comment Jan 24, 2026 0:10am

@changeset-bot
Copy link

changeset-bot bot commented Jan 24, 2026

⚠️ No Changeset found

Latest commit: 20ac495

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@github-actions
Copy link
Contributor

github-actions bot commented Jan 24, 2026 •
edited
Loading

🧪 E2E Test Results

❌ Some tests failed

Summary

Passed Failed Skipped Total
✅ ▲ Vercel Production 457 0 38 495
❌ 💻 Local Development 377 41 32 450
✅ 📦 Local Production 418 0 32 450
✅ 🐘 Local Postgres 418 0 32 450
✅ 🪟 Windows 45 0 0 45
❌ 🌍 Community Worlds 31 161 0 192
Total 1746 202 134 2082

❌ Failed Tests

💻 Local Development (41 failed)

fastify-stable (41 failed):

  • addTenWorkflow
  • addTenWorkflow
  • promiseAllWorkflow
  • promiseRaceWorkflow
  • promiseAnyWorkflow
  • readableStreamWorkflow
  • hookWorkflow
  • webhookWorkflow
  • webhook route with invalid token
  • sleepingWorkflow
  • nullByteWorkflow
  • workflowAndStepMetadataWorkflow
  • outputStreamWorkflow
  • outputStreamInsideStepWorkflow - getWritable() called inside step functions
  • fetchWorkflow
  • promiseRaceStressTestWorkflow
  • error handling error propagation workflow errors nested function calls preserve message and stack trace
  • error handling error propagation workflow errors cross-file imports preserve message and stack trace
  • error handling error propagation step errors basic step error preserves message and stack trace
  • error handling error propagation step errors cross-file step error preserves message and function names in stack
  • error handling retry behavior regular Error retries until success
  • error handling retry behavior FatalError fails immediately without retries
  • error handling retry behavior RetryableError respects custom retryAfter delay
  • error handling retry behavior maxRetries=0 disables retries
  • error handling catchability FatalError can be caught and detected with FatalError.is()
  • stepDirectCallWorkflow - calling step functions directly outside workflow context
  • hookCleanupTestWorkflow - hook token reuse after workflow completion
  • concurrent hook token conflict - two workflows cannot use the same hook token simultaneously
  • stepFunctionPassingWorkflow - step function references can be passed as arguments (without closure vars)
  • stepFunctionWithClosureWorkflow - step function with closure variables passed as argument
  • closureVariableWorkflow - nested step functions with closure variables
  • spawnWorkflowFromStepWorkflow - spawning a child workflow using start() inside a step
  • health check endpoint (HTTP) - workflow and step endpoints respond to __health query parameter
  • health check (queue-based) - workflow and step endpoints respond to health check messages
  • health check (CLI) - workflow health command reports healthy endpoints
  • pathsAliasWorkflow - TypeScript path aliases resolve correctly
  • Calculator.calculate - static workflow method using static step methods from another class
  • AllInOneService.processNumber - static workflow method using sibling static step methods
  • ChainableService.processWithThis - static step methods using this to reference the class
  • thisSerializationWorkflow - step function invoked with .call() and .apply()
  • customSerializationWorkflow - custom class serialization with WORKFLOW_SERIALIZE/WORKFLOW_DESERIALIZE
🌍 Community Worlds (161 failed)

mongodb (40 failed):

  • addTenWorkflow
  • addTenWorkflow
  • should work with react rendering in step
  • promiseAllWorkflow
  • promiseRaceWorkflow
  • promiseAnyWorkflow
  • readableStreamWorkflow
  • hookWorkflow
  • webhookWorkflow
  • sleepingWorkflow
  • nullByteWorkflow
  • workflowAndStepMetadataWorkflow
  • outputStreamWorkflow
  • outputStreamInsideStepWorkflow - getWritable() called inside step functions
  • fetchWorkflow
  • promiseRaceStressTestWorkflow
  • error handling error propagation workflow errors nested function calls preserve message and stack trace
  • error handling error propagation workflow errors cross-file imports preserve message and stack trace
  • error handling error propagation step errors basic step error preserves message and stack trace
  • error handling error propagation step errors cross-file step error preserves message and function names in stack
  • error handling retry behavior regular Error retries until success
  • error handling retry behavior FatalError fails immediately without retries
  • error handling retry behavior RetryableError respects custom retryAfter delay
  • error handling retry behavior maxRetries=0 disables retries
  • error handling catchability FatalError can be caught and detected with FatalError.is()
  • hookCleanupTestWorkflow - hook token reuse after workflow completion
  • concurrent hook token conflict - two workflows cannot use the same hook token simultaneously
  • stepFunctionPassingWorkflow - step function references can be passed as arguments (without closure vars)
  • stepFunctionWithClosureWorkflow - step function with closure variables passed as argument
  • closureVariableWorkflow - nested step functions with closure variables
  • spawnWorkflowFromStepWorkflow - spawning a child workflow using start() inside a step
  • pathsAliasWorkflow - TypeScript path aliases resolve correctly
  • Calculator.calculate - static workflow method using static step methods from another class
  • AllInOneService.processNumber - static workflow method using sibling static step methods
  • ChainableService.processWithThis - static step methods using this to reference the class
  • thisSerializationWorkflow - step function invoked with .call() and .apply()
  • customSerializationWorkflow - custom class serialization with WORKFLOW_SERIALIZE/WORKFLOW_DESERIALIZE
  • pages router addTenWorkflow via pages router
  • pages router promiseAllWorkflow via pages router
  • pages router sleepingWorkflow via pages router

redis (40 failed):

  • addTenWorkflow
  • addTenWorkflow
  • should work with react rendering in step
  • promiseAllWorkflow
  • promiseRaceWorkflow
  • promiseAnyWorkflow
  • readableStreamWorkflow
  • hookWorkflow
  • webhookWorkflow
  • sleepingWorkflow
  • nullByteWorkflow
  • workflowAndStepMetadataWorkflow
  • outputStreamWorkflow
  • outputStreamInsideStepWorkflow - getWritable() called inside step functions
  • fetchWorkflow
  • promiseRaceStressTestWorkflow
  • error handling error propagation workflow errors nested function calls preserve message and stack trace
  • error handling error propagation workflow errors cross-file imports preserve message and stack trace
  • error handling error propagation step errors basic step error preserves message and stack trace
  • error handling error propagation step errors cross-file step error preserves message and function names in stack
  • error handling retry behavior regular Error retries until success
  • error handling retry behavior FatalError fails immediately without retries
  • error handling retry behavior RetryableError respects custom retryAfter delay
  • error handling retry behavior maxRetries=0 disables retries
  • error handling catchability FatalError can be caught and detected with FatalError.is()
  • hookCleanupTestWorkflow - hook token reuse after workflow completion
  • concurrent hook token conflict - two workflows cannot use the same hook token simultaneously
  • stepFunctionPassingWorkflow - step function references can be passed as arguments (without closure vars)
  • stepFunctionWithClosureWorkflow - step function with closure variables passed as argument
  • closureVariableWorkflow - nested step functions with closure variables
  • spawnWorkflowFromStepWorkflow - spawning a child workflow using start() inside a step
  • pathsAliasWorkflow - TypeScript path aliases resolve correctly
  • Calculator.calculate - static workflow method using static step methods from another class
  • AllInOneService.processNumber - static workflow method using sibling static step methods
  • ChainableService.processWithThis - static step methods using this to reference the class
  • thisSerializationWorkflow - step function invoked with .call() and .apply()
  • customSerializationWorkflow - custom class serialization with WORKFLOW_SERIALIZE/WORKFLOW_DESERIALIZE
  • pages router addTenWorkflow via pages router
  • pages router promiseAllWorkflow via pages router
  • pages router sleepingWorkflow via pages router

starter (41 failed):

  • addTenWorkflow
  • addTenWorkflow
  • should work with react rendering in step
  • promiseAllWorkflow
  • promiseRaceWorkflow
  • promiseAnyWorkflow
  • readableStreamWorkflow
  • hookWorkflow
  • webhookWorkflow
  • sleepingWorkflow
  • nullByteWorkflow
  • workflowAndStepMetadataWorkflow
  • outputStreamWorkflow
  • outputStreamInsideStepWorkflow - getWritable() called inside step functions
  • fetchWorkflow
  • promiseRaceStressTestWorkflow
  • error handling error propagation workflow errors nested function calls preserve message and stack trace
  • error handling error propagation workflow errors cross-file imports preserve message and stack trace
  • error handling error propagation step errors basic step error preserves message and stack trace
  • error handling error propagation step errors cross-file step error preserves message and function names in stack
  • error handling retry behavior regular Error retries until success
  • error handling retry behavior FatalError fails immediately without retries
  • error handling retry behavior RetryableError respects custom retryAfter delay
  • error handling retry behavior maxRetries=0 disables retries
  • error handling catchability FatalError can be caught and detected with FatalError.is()
  • hookCleanupTestWorkflow - hook token reuse after workflow completion
  • concurrent hook token conflict - two workflows cannot use the same hook token simultaneously
  • stepFunctionPassingWorkflow - step function references can be passed as arguments (without closure vars)
  • stepFunctionWithClosureWorkflow - step function with closure variables passed as argument
  • closureVariableWorkflow - nested step functions with closure variables
  • spawnWorkflowFromStepWorkflow - spawning a child workflow using start() inside a step
  • health check (CLI) - workflow health command reports healthy endpoints
  • pathsAliasWorkflow - TypeScript path aliases resolve correctly
  • Calculator.calculate - static workflow method using static step methods from another class
  • AllInOneService.processNumber - static workflow method using sibling static step methods
  • ChainableService.processWithThis - static step methods using this to reference the class
  • thisSerializationWorkflow - step function invoked with .call() and .apply()
  • customSerializationWorkflow - custom class serialization with WORKFLOW_SERIALIZE/WORKFLOW_DESERIALIZE
  • pages router addTenWorkflow via pages router
  • pages router promiseAllWorkflow via pages router
  • pages router sleepingWorkflow via pages router

turso (40 failed):

  • addTenWorkflow
  • addTenWorkflow
  • should work with react rendering in step
  • promiseAllWorkflow
  • promiseRaceWorkflow
  • promiseAnyWorkflow
  • readableStreamWorkflow
  • hookWorkflow
  • webhookWorkflow
  • sleepingWorkflow
  • nullByteWorkflow
  • workflowAndStepMetadataWorkflow
  • outputStreamWorkflow
  • outputStreamInsideStepWorkflow - getWritable() called inside step functions
  • fetchWorkflow
  • promiseRaceStressTestWorkflow
  • error handling error propagation workflow errors nested function calls preserve message and stack trace
  • error handling error propagation workflow errors cross-file imports preserve message and stack trace
  • error handling error propagation step errors basic step error preserves message and stack trace
  • error handling error propagation step errors cross-file step error preserves message and function names in stack
  • error handling retry behavior regular Error retries until success
  • error handling retry behavior FatalError fails immediately without retries
  • error handling retry behavior RetryableError respects custom retryAfter delay
  • error handling retry behavior maxRetries=0 disables retries
  • error handling catchability FatalError can be caught and detected with FatalError.is()
  • hookCleanupTestWorkflow - hook token reuse after workflow completion
  • concurrent hook token conflict - two workflows cannot use the same hook token simultaneously
  • stepFunctionPassingWorkflow - step function references can be passed as arguments (without closure vars)
  • stepFunctionWithClosureWorkflow - step function with closure variables passed as argument
  • closureVariableWorkflow - nested step functions with closure variables
  • spawnWorkflowFromStepWorkflow - spawning a child workflow using start() inside a step
  • pathsAliasWorkflow - TypeScript path aliases resolve correctly
  • Calculator.calculate - static workflow method using static step methods from another class
  • AllInOneService.processNumber - static workflow method using sibling static step methods
  • ChainableService.processWithThis - static step methods using this to reference the class
  • thisSerializationWorkflow - step function invoked with .call() and .apply()
  • customSerializationWorkflow - custom class serialization with WORKFLOW_SERIALIZE/WORKFLOW_DESERIALIZE
  • pages router addTenWorkflow via pages router
  • pages router promiseAllWorkflow via pages router
  • pages router sleepingWorkflow via pages router

Details by Category

✅ ▲ Vercel Production
App Passed Failed Skipped
✅ astro 41 0 4
✅ example 41 0 4
✅ express 41 0 4
✅ fastify 41 0 4
✅ hono 41 0 4
✅ nextjs-turbopack 44 0 1
✅ nextjs-webpack 44 0 1
✅ nitro 41 0 4
✅ nuxt 41 0 4
✅ sveltekit 41 0 4
✅ vite 41 0 4
❌ 💻 Local Development
App Passed Failed Skipped
✅ astro-stable 41 0 4
✅ express-stable 41 0 4
❌ fastify-stable 0 41 4
✅ hono-stable 41 0 4
✅ nextjs-turbopack-stable 45 0 0
✅ nextjs-webpack-stable 45 0 0
✅ nitro-stable 41 0 4
✅ nuxt-stable 41 0 4
✅ sveltekit-stable 41 0 4
✅ vite-stable 41 0 4
✅ 📦 Local Production
App Passed Failed Skipped
✅ astro-stable 41 0 4
✅ express-stable 41 0 4
✅ fastify-stable 41 0 4
✅ hono-stable 41 0 4
✅ nextjs-turbopack-stable 45 0 0
✅ nextjs-webpack-stable 45 0 0
✅ nitro-stable 41 0 4
✅ nuxt-stable 41 0 4
✅ sveltekit-stable 41 0 4
✅ vite-stable 41 0 4
✅ 🐘 Local Postgres
App Passed Failed Skipped
✅ astro-stable 41 0 4
✅ express-stable 41 0 4
✅ fastify-stable 41 0 4
✅ hono-stable 41 0 4
✅ nextjs-turbopack-stable 45 0 0
✅ nextjs-webpack-stable 45 0 0
✅ nitro-stable 41 0 4
✅ nuxt-stable 41 0 4
✅ sveltekit-stable 41 0 4
✅ vite-stable 41 0 4
✅ 🪟 Windows
App Passed Failed Skipped
✅ nextjs-turbopack 45 0 0
❌ 🌍 Community Worlds
App Passed Failed Skipped
✅ mongodb-dev 3 0 0
❌ mongodb 5 40 0
✅ redis-dev 3 0 0
❌ redis 5 40 0
✅ starter-dev 3 0 0
❌ starter 4 41 0
✅ turso-dev 3 0 0
❌ turso 5 40 0

📋 View full workflow run

❌ Some E2E test jobs failed:

  • Vercel Prod: success
  • Local Dev: failure
  • Local Prod: success
  • Local Postgres: success
  • Windows: success

Check the workflow run for details.

@github-actions
Copy link
Contributor

github-actions bot commented Jan 24, 2026 •
edited
Loading

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Next.js (Turbopack) 0.040s (-8.4% 🟢) 1.018s (~) 0.978s 10 1.00x
💻 Local Nitro 0.042s (-2.5%) 1.007s (~) 0.964s 10 1.04x
💻 Local Express 0.044s (-2.4%) 1.008s (~) 0.964s 10 1.10x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 0.698s (-11.7% 🟢) 1.597s (-5.6% 🟢) 0.899s 10 1.00x
▲ Vercel Express 0.754s (-15.1% 🟢) 1.695s (-3.9%) 0.940s 10 1.08x
▲ Vercel Next.js (Turbopack) 0.785s (+4.0%) 1.628s (-17.1% 🟢) 0.843s 10 1.12x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 1 step

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Next.js (Turbopack) 1.099s (~) 2.013s (~) 0.914s 10 1.00x
💻 Local Nitro 1.111s (~) 2.006s (~) 0.895s 10 1.01x
💻 Local Express 1.117s (~) 2.008s (~) 0.890s 10 1.02x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 2.897s (~) 3.656s (-1.5%) 0.759s 10 1.00x
▲ Vercel Express 2.899s (-1.9%) 3.803s (+3.7%) 0.903s 10 1.00x
▲ Vercel Next.js (Turbopack) 3.045s (+7.0% 🔺) 3.911s (+7.3% 🔺) 0.866s 10 1.05x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Next.js (Turbopack) 10.702s (~) 11.019s (~) 0.317s 5 1.00x
💻 Local Nitro 10.799s (~) 11.013s (~) 0.214s 5 1.01x
💻 Local Express 10.857s (~) 11.018s (~) 0.161s 5 1.01x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 22.224s (-15.6% 🟢) 23.275s (-13.2% 🟢) 1.051s 5 1.00x
▲ Vercel Nitro 22.714s (-13.8% 🟢) 23.585s (-12.4% 🟢) 0.871s 5 1.02x
▲ Vercel Express 23.031s (-8.6% 🟢) 23.841s (-7.6% 🟢) 0.810s 5 1.04x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

Promise.all with 10 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Next.js (Turbopack) 1.370s (-1.5%) 2.011s (~) 0.641s 15 1.00x
💻 Local Nitro 1.384s (-0.7%) 2.005s (~) 0.621s 15 1.01x
💻 Local Express 1.413s (~) 2.008s (~) 0.594s 15 1.03x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 3.057s (-2.1%) 3.950s (+1.5%) 0.893s 8 1.00x
▲ Vercel Express 3.134s (+8.3% 🔺) 4.031s (+10.1% 🔺) 0.896s 8 1.03x
▲ Vercel Next.js (Turbopack) 3.559s (+18.9% 🔺) 4.519s (+24.3% 🔺) 0.960s 8 1.16x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Next.js (Turbopack) 2.351s (-2.6%) 3.288s (-2.7%) 0.937s 10 1.00x
💻 Local Nitro 2.450s (-3.6%) 3.056s (+1.3%) 0.606s 10 1.04x
💻 Local Express 2.554s (+3.1%) 3.020s (~) 0.466s 10 1.09x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 3.752s (+4.3%) 4.455s (+8.2% 🔺) 0.703s 7 1.00x
▲ Vercel Next.js (Turbopack) 3.874s (+20.6% 🔺) 4.553s (+22.6% 🔺) 0.679s 7 1.03x
▲ Vercel Express 4.025s (+12.8% 🔺) 4.807s (+15.2% 🔺) 0.782s 7 1.07x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

Promise.all with 50 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Next.js (Turbopack) 6.290s 6.904s 0.614s 5 1.00x
💻 Local Nitro 6.597s 7.526s 0.929s 5 1.05x
💻 Local Express 7.274s 8.289s 1.015s 4 1.16x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 5.149s 5.838s 0.689s 6 1.00x
▲ Vercel Nitro 5.261s 6.040s 0.779s 6 1.02x
▲ Vercel Express 6.758s 7.613s 0.856s 4 1.31x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

Promise.all with 100 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Next.js (Turbopack) 26.632s 26.902s 0.270s 3 1.00x
💻 Local Nitro 30.069s 30.871s 0.802s 2 1.13x
💻 Local Express 33.908s 34.828s 0.919s 2 1.27x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 6.581s 7.443s 0.863s 9 1.00x
▲ Vercel Next.js (Turbopack) 6.831s 7.699s 0.868s 8 1.04x
▲ Vercel Express 6.895s 7.660s 0.765s 9 1.05x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

Promise.race with 10 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Next.js (Turbopack) 1.548s (+10.5% 🔺) 2.157s (+7.2% 🔺) 0.609s 14 1.00x
💻 Local Express 1.991s (+39.3% 🔺) 2.548s (+26.9% 🔺) 0.557s 12 1.29x
💻 Local Nitro 2.250s (+60.0% 🔺) 2.841s (+41.6% 🔺) 0.591s 11 1.45x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 2.822s (-2.9%) 3.771s (+0.9%) 0.948s 8 1.00x
▲ Vercel Express 2.895s (~) 3.911s (+4.2%) 1.016s 8 1.03x
▲ Vercel Nitro 2.908s (-1.9%) 3.682s (-1.1%) 0.775s 9 1.03x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Promise.race with 25 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Next.js (Turbopack) 2.560s (+2.3%) 3.032s (~) 0.472s 10 1.00x
💻 Local Nitro 2.634s (-0.5%) 3.008s (~) 0.374s 10 1.03x
💻 Local Express 2.834s (+9.9% 🔺) 3.045s (+0.7%) 0.211s 10 1.11x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 3.196s (+2.6%) 3.961s (+9.5% 🔺) 0.764s 8 1.00x
▲ Vercel Nitro 3.338s (+5.7% 🔺) 3.835s (+1.5%) 0.498s 8 1.04x
▲ Vercel Next.js (Turbopack) 3.465s (~) 4.068s (-0.6%) 0.602s 8 1.08x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.race with 50 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Next.js (Turbopack) 7.066s 8.287s 1.222s 4 1.00x
💻 Local Nitro 7.564s 8.556s 0.992s 4 1.07x
💻 Local Express 8.192s 8.721s 0.529s 4 1.16x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 3.822s 4.536s 0.714s 7 1.00x
▲ Vercel Express 3.877s 4.992s 1.116s 7 1.01x
▲ Vercel Nitro 3.999s 4.876s 0.877s 7 1.05x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Promise.race with 100 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Next.js (Turbopack) 32.603s 33.435s 0.832s 2 1.00x
💻 Local Nitro 34.806s 35.328s 0.522s 2 1.07x
💻 Local Express 38.437s 39.230s 0.793s 2 1.18x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 5.460s 6.283s 0.823s 10 1.00x
▲ Vercel Nitro 6.113s 6.714s 0.600s 9 1.12x
▲ Vercel Next.js (Turbopack) 6.218s 6.826s 0.609s 9 1.14x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.all with 500 concurrent steps

💻 Local Development

No data available

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 32.709s 33.595s 0.885s 4 1.00x
▲ Vercel Next.js (Turbopack) 36.512s 34.454s -2.058s 4 1.12x
▲ Vercel Nitro 37.063s 38.170s 1.107s 4 1.13x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

Promise.race with 500 concurrent steps

💻 Local Development

No data available

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 32.902s 33.760s 0.858s 4 1.00x
▲ Vercel Next.js (Turbopack) 34.578s 33.727s -0.851s 4 1.05x
▲ Vercel Nitro 36.619s 41.286s 4.667s 3 1.11x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

Stream Benchmarks (includes TTFB metrics)
workflow with stream

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Next.js (Turbopack) 0.143s (+2.8%) 1.003s (~) 0.016s (+1.3%) 1.026s (~) 0.884s 10 1.00x
💻 Local Nitro 0.181s (-4.3%) 0.992s (~) 0.014s (-17.5% 🟢) 1.020s (~) 0.839s 10 1.27x
💻 Local Express 0.186s (+2.4%) 0.993s (~) 0.015s (+1.3%) 1.023s (~) 0.838s 10 1.30x

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 2.948s (+0.6%) 3.132s (-1.7%) 0.463s (+26.3% 🔺) 4.106s (+2.8%) 1.158s 10 1.00x
▲ Vercel Nitro 3.005s (+1.8%) 3.275s (~) 0.324s (+11.0% 🔺) 4.094s (-1.3%) 1.088s 10 1.02x
▲ Vercel Express 3.077s (+6.7% 🔺) 3.287s (-0.6%) 0.466s (-7.0% 🟢) 4.293s (+0.6%) 1.216s 10 1.04x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World 🥇 Fastest Framework Wins
💻 Local Next.js (Turbopack) 12/12
▲ Vercel Nitro 5/14
Fastest World by Framework

Winner determined by most benchmark wins

Framework 🥇 Fastest World Wins
Express 💻 Local 8/14
Next.js (Turbopack) 💻 Local 8/14
Nitro 💻 Local 8/14
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Starter: Community world (local development)
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)

📋 View full workflow run

@pranaygp pranaygp marked this pull request as draft January 24, 2026 00:11
Copilot AI reviewed Jan 24, 2026
View reviewed changes
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Enables running additional high-concurrency workflow benchmarks (Promise.all / Promise.race) at 50, 100, and 500 concurrent steps in the Vitest benchmark suite.

Changes:

  • Added a 50-concurrent-steps benchmark configuration.
  • Un-skipped the previously disabled 100 and 500 concurrent step benchmark configurations.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

Copilot code review Copilot Copilot left review comments

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@pranaygp