Skip to content

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Sep 9, 2025

This PR contains the following updates:

Package Change Age Confidence
lucide-react (source) ^0.542.0 -> ^0.543.0 age confidence

Release Notes

lucide-icons/lucide (lucide-react)

v0.543.0

Compare Source


Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Sep 9, 2025
Copy link

github-actions bot commented Sep 9, 2025

💻 Website Preview

The latest changes are available as preview in: https://2a2ba0da.federation-gateway-benchmark.pages.dev

Copy link

github-actions bot commented Sep 9, 2025

Overview for: constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1879 113253 total, 0 failed avg: 26ms, p95: 47ms
grafbase 1697 102421 total, 0 failed avg: 29ms, p95: 51ms
cosmo 654 39559 total, 0 failed avg: 76ms, p95: 110ms
apollo-router 371 22580 total, 0 failed avg: 133ms, p95: 173ms
hive-gateway 312 19112 total, 0 failed avg: 157ms, p95: 205ms
hive-gateway-bun 303 18499 total, 0 failed avg: 162ms, p95: 347ms
apollo-gateway 121 7395 total, 0 failed avg: 407ms, p95: 477ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 339459      ✗ 0     
     data_received..................: 9.9 GB  165 MB/s
     data_sent......................: 132 MB  2.2 MB/s
     http_req_blocked...............: avg=5.02µs   min=1.16µs  med=2.47µs  max=9.25ms   p(90)=3.57µs   p(95)=4.2µs    p(99.9)=73.28µs
     http_req_connecting............: avg=2.03µs   min=0s      med=0s      max=9.2ms    p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_duration..............: avg=26.29ms  min=1.86ms  med=23.85ms max=408.36ms p(90)=40.48ms  p(95)=47.05ms  p(99.9)=81.54ms
       { expected_response:true }...: avg=26.29ms  min=1.86ms  med=23.85ms max=408.36ms p(90)=40.48ms  p(95)=47.05ms  p(99.9)=81.54ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 113253
     http_req_receiving.............: avg=108.15µs min=23.21µs med=41.94µs max=49.45ms  p(90)=103.13µs p(95)=317.09µs p(99.9)=11.45ms
     http_req_sending...............: avg=77.56µs  min=5.19µs  med=9.97µs  max=275.83ms p(90)=29.31µs  p(95)=117.79µs p(99.9)=9.57ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=26.1ms   min=1.82ms  med=23.71ms max=407.31ms p(90)=40.13ms  p(95)=46.68ms  p(99.9)=79.56ms
     http_reqs......................: 113253  1879.528211/s
     iteration_duration.............: avg=26.5ms   min=4.54ms  med=24.04ms max=420.84ms p(90)=40.67ms  p(95)=47.25ms  p(99.9)=82.4ms 
     iterations.....................: 113153  1877.868627/s
     success_rate...................: 100.00% ✓ 113153      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 306963      ✗ 0     
     data_received..................: 9.0 GB  149 MB/s
     data_sent......................: 119 MB  2.0 MB/s
     http_req_blocked...............: avg=5.95µs  min=1.14µs  med=3.05µs  max=8.92ms   p(90)=4.18µs   p(95)=5.02µs   p(99.9)=116.13µs
     http_req_connecting............: avg=2.2µs   min=0s      med=0s      max=8.89ms   p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_duration..............: avg=29.07ms min=2.52ms  med=26.02ms max=451.48ms p(90)=44.4ms   p(95)=51.32ms  p(99.9)=90.3ms  
       { expected_response:true }...: avg=29.07ms min=2.52ms  med=26.02ms max=451.48ms p(90)=44.4ms   p(95)=51.32ms  p(99.9)=90.3ms  
     http_req_failed................: 0.00%   ✓ 0           ✗ 102421
     http_req_receiving.............: avg=140.3µs min=26.25µs med=47.17µs max=174.77ms p(90)=143.48µs p(95)=381.45µs p(99.9)=14.16ms 
     http_req_sending...............: avg=94.72µs min=5.45µs  med=11.57µs max=403.38ms p(90)=35.59µs  p(95)=131.56µs p(99.9)=13.17ms 
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=28.83ms min=2.47ms  med=25.85ms max=434.26ms p(90)=43.99ms  p(95)=50.82ms  p(99.9)=87.66ms 
     http_reqs......................: 102421  1697.770535/s
     iteration_duration.............: avg=29.31ms min=6.17ms  med=26.24ms max=465.95ms p(90)=44.63ms  p(95)=51.55ms  p(99.9)=90.55ms 
     iterations.....................: 102321  1696.112896/s
     success_rate...................: 100.00% ✓ 102321      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 118377     ✗ 0    
     data_received..................: 3.5 GB  57 MB/s
     data_sent......................: 46 MB   761 kB/s
     http_req_blocked...............: avg=15.58µs  min=1.36µs  med=2.93µs  max=15.61ms  p(90)=4.27µs   p(95)=5.03µs   p(99.9)=5.57ms  
     http_req_connecting............: avg=11.93µs  min=0s      med=0s      max=15.59ms  p(90)=0s       p(95)=0s       p(99.9)=5.55ms  
     http_req_duration..............: avg=75.62ms  min=2.89ms  med=74.69ms max=497.1ms  p(90)=101.67ms p(95)=109.89ms p(99.9)=285.75ms
       { expected_response:true }...: avg=75.62ms  min=2.89ms  med=74.69ms max=497.1ms  p(90)=101.67ms p(95)=109.89ms p(99.9)=285.75ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 39559
     http_req_receiving.............: avg=177.42µs min=28.97µs med=76.8µs  max=179.84ms p(90)=154.58µs p(95)=380.87µs p(99.9)=17.59ms 
     http_req_sending...............: avg=67.77µs  min=5.87µs  med=11.4µs  max=273.22ms p(90)=28.79µs  p(95)=121.79µs p(99.9)=6.07ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=75.38ms  min=2.8ms   med=74.47ms max=481.01ms p(90)=101.43ms p(95)=109.65ms p(99.9)=276.64ms
     http_reqs......................: 39559   654.403519/s
     iteration_duration.............: avg=76.06ms  min=5.98ms  med=74.97ms max=544.64ms p(90)=101.93ms p(95)=110.14ms p(99.9)=308.01ms
     iterations.....................: 39459   652.749272/s
     success_rate...................: 100.00% ✓ 39459      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 67440      ✗ 0    
     data_received..................: 2.0 GB  33 MB/s
     data_sent......................: 26 MB   432 kB/s
     http_req_blocked...............: avg=26.52µs  min=1.85µs  med=2.9µs    max=16.11ms  p(90)=4.46µs   p(95)=5.15µs   p(99.9)=11.16ms 
     http_req_connecting............: avg=22.88µs  min=0s      med=0s       max=15.95ms  p(90)=0s       p(95)=0s       p(99.9)=11.14ms 
     http_req_duration..............: avg=132.71ms min=5.93ms  med=132.03ms max=526.27ms p(90)=163.81ms p(95)=173.15ms p(99.9)=376.23ms
       { expected_response:true }...: avg=132.71ms min=5.93ms  med=132.03ms max=526.27ms p(90)=163.81ms p(95)=173.15ms p(99.9)=376.23ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 22580
     http_req_receiving.............: avg=80.99µs  min=35.7µs  med=55.42µs  max=17.39ms  p(90)=110.6µs  p(95)=140.43µs p(99.9)=1.56ms  
     http_req_sending...............: avg=68.9µs   min=7.32µs  med=11.83µs  max=201ms    p(90)=20.57µs  p(95)=36.3µs   p(99.9)=7.67ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=132.56ms min=5.88ms  med=131.92ms max=523.03ms p(90)=163.7ms  p(95)=173.01ms p(99.9)=367.84ms
     http_reqs......................: 22580   371.588678/s
     iteration_duration.............: avg=133.58ms min=37.24ms med=132.36ms max=604.85ms p(90)=164.09ms p(95)=173.52ms p(99.9)=414.88ms
     iterations.....................: 22480   369.943024/s
     success_rate...................: 100.00% ✓ 22480      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 57036      ✗ 0    
     data_received..................: 1.7 GB  28 MB/s
     data_sent......................: 22 MB   364 kB/s
     http_req_blocked...............: avg=17.41µs  min=1.19µs  med=2.69µs   max=10.48ms p(90)=4.42µs   p(95)=5.42µs   p(99.9)=6.33ms  
     http_req_connecting............: avg=13.84µs  min=0s      med=0s       max=10.43ms p(90)=0s       p(95)=0s       p(99.9)=6.3ms   
     http_req_duration..............: avg=156.8ms  min=6.85ms  med=147.96ms max=1.03s   p(90)=185.11ms p(95)=204.57ms p(99.9)=969.18ms
       { expected_response:true }...: avg=156.8ms  min=6.85ms  med=147.96ms max=1.03s   p(90)=185.11ms p(95)=204.57ms p(99.9)=969.18ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 19112
     http_req_receiving.............: avg=96.37µs  min=24.3µs  med=45.56µs  max=77.37ms p(90)=106.71µs p(95)=209.32µs p(99.9)=4.4ms   
     http_req_sending...............: avg=77.18µs  min=5.53µs  med=11.01µs  max=240.4ms p(90)=31.61µs  p(95)=118.45µs p(99.9)=4.67ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=156.62ms min=6.8ms   med=147.85ms max=1.03s   p(90)=184.8ms  p(95)=204.34ms p(99.9)=969.12ms
     http_reqs......................: 19112   312.584486/s
     iteration_duration.............: avg=157.91ms min=56.17ms med=148.49ms max=1.03s   p(90)=185.42ms p(95)=205.39ms p(99.9)=969.36ms
     iterations.....................: 19012   310.948946/s
     success_rate...................: 100.00% ✓ 19012      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 55197      ✗ 0    
     data_received..................: 1.6 GB  27 MB/s
     data_sent......................: 22 MB   353 kB/s
     http_req_blocked...............: avg=26.52µs  min=1.22µs  med=2.71µs   max=15.78ms  p(90)=4.51µs   p(95)=5.67µs   p(99.9)=9.8ms   
     http_req_connecting............: avg=22.01µs  min=0s      med=0s       max=15.75ms  p(90)=0s       p(95)=0s       p(99.9)=9.26ms  
     http_req_duration..............: avg=162.06ms min=7.29ms  med=149.4ms  max=674.66ms p(90)=180.8ms  p(95)=347.25ms p(99.9)=515.61ms
       { expected_response:true }...: avg=162.06ms min=7.29ms  med=149.4ms  max=674.66ms p(90)=180.8ms  p(95)=347.25ms p(99.9)=515.61ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 18499
     http_req_receiving.............: avg=92.65µs  min=26.25µs med=47.98µs  max=27.59ms  p(90)=110.6µs  p(95)=176.98µs p(99.9)=4.02ms  
     http_req_sending...............: avg=123.45µs min=5.73µs  med=11.15µs  max=416.93ms p(90)=32.3µs   p(95)=118.34µs p(99.9)=10.62ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=161.84ms min=7.24ms  med=149.27ms max=665.66ms p(90)=180.68ms p(95)=346.36ms p(99.9)=508.55ms
     http_reqs......................: 18499   303.277648/s
     iteration_duration.............: avg=163.26ms min=35.48ms med=149.75ms max=748.42ms p(90)=181.32ms p(95)=349.78ms p(99.9)=531.64ms
     iterations.....................: 18399   301.63822/s
     success_rate...................: 100.00% ✓ 18399      ✗ 0    
     vus............................: 17      min=17       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 21885      ✗ 0   
     data_received..................: 650 MB  11 MB/s
     data_sent......................: 8.6 MB  141 kB/s
     http_req_blocked...............: avg=37.31µs  min=1.38µs   med=2.96µs   max=9.75ms   p(90)=4.41µs   p(95)=5.08µs   p(99.9)=8.38ms  
     http_req_connecting............: avg=33.08µs  min=0s       med=0s       max=9.72ms   p(90)=0s       p(95)=0s       p(99.9)=8.36ms  
     http_req_duration..............: avg=406.63ms min=7.4ms    med=406.22ms max=694.99ms p(90)=459.74ms p(95)=477.02ms p(99.9)=633.24ms
       { expected_response:true }...: avg=406.63ms min=7.4ms    med=406.22ms max=694.99ms p(90)=459.74ms p(95)=477.02ms p(99.9)=633.24ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 7395
     http_req_receiving.............: avg=62.14µs  min=30.06µs  med=50.43µs  max=7.49ms   p(90)=93.13µs  p(95)=106.9µs  p(99.9)=306.3µs 
     http_req_sending...............: avg=69.85µs  min=6.18µs   med=12.11µs  max=127.54ms p(90)=19.04µs  p(95)=22.66µs  p(99.9)=4.75ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=406.5ms  min=7.34ms   med=406.14ms max=693.92ms p(90)=459.62ms p(95)=476.88ms p(99.9)=632.03ms
     http_reqs......................: 7395    121.002114/s
     iteration_duration.............: avg=412.41ms min=213.72ms med=406.86ms max=710.44ms p(90)=460.36ms p(95)=477.5ms  p(99.9)=657.48ms
     iterations.....................: 7295    119.365844/s
     success_rate...................: 100.00% ✓ 7295       ✗ 0   
     vus............................: 33      min=33       max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Sep 9, 2025

Overview for: constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 172 13994 total, 0 failed avg: 216ms, p95: 226ms
hive-router 172 13939 total, 0 failed avg: 217ms, p95: 227ms
cosmo 166 13491 total, 0 failed avg: 224ms, p95: 249ms
hive-gateway 164 12620 total, 0 failed avg: 239ms, p95: 269ms
hive-gateway-bun 162 12483 total, 0 failed avg: 242ms, p95: 270ms
apollo-router 138 11257 total, 0 failed avg: 269ms, p95: 310ms ❌ 2 unexpected GraphQL errors
apollo-gateway 123 10076 total, 0 failed avg: 300ms, p95: 333ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41682      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   201 kB/s
     http_req_blocked...............: avg=18.43µs  min=1.19µs   med=1.98µs   max=8.7ms    p(90)=3.62µs   p(95)=5.24µs   p(99.9)=6.37ms  
     http_req_connecting............: avg=15.66µs  min=0s       med=0s       max=8.67ms   p(90)=0s       p(95)=0s       p(99.9)=6.35ms  
     http_req_duration..............: avg=215.89ms min=158.45ms med=215.01ms max=620.16ms p(90)=223.83ms p(95)=226.35ms p(99.9)=523.99ms
       { expected_response:true }...: avg=215.89ms min=158.45ms med=215.01ms max=620.16ms p(90)=223.83ms p(95)=226.35ms p(99.9)=523.99ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13994
     http_req_receiving.............: avg=81.26µs  min=26.19µs  med=45.69µs  max=19.21ms  p(90)=99.56µs  p(95)=267.43µs p(99.9)=3.34ms  
     http_req_sending...............: avg=132.08µs min=5.69µs   med=8.54µs   max=392.71ms p(90)=30.31µs  p(95)=95.29µs  p(99.9)=7.93ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=215.68ms min=158.4ms  med=214.91ms max=619.19ms p(90)=223.67ms p(95)=226.19ms p(99.9)=505.97ms
     http_reqs......................: 13994   172.90444/s
     iteration_duration.............: avg=216.15ms min=158.62ms med=215.24ms max=632.93ms p(90)=223.99ms p(95)=226.54ms p(99.9)=534.35ms
     iterations.....................: 13894   171.668878/s
     success_rate...................: 100.00% ✓ 13894      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41517      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   200 kB/s
     http_req_blocked...............: avg=37.39µs  min=1.19µs   med=2.14µs   max=17.67ms  p(90)=3.4µs    p(95)=4.79µs   p(99.9)=11.8ms  
     http_req_connecting............: avg=34.34µs  min=0s       med=0s       max=17.46ms  p(90)=0s       p(95)=0s       p(99.9)=11.65ms 
     http_req_duration..............: avg=216.94ms min=158.74ms med=215.43ms max=590.23ms p(90)=223.79ms p(95)=226.97ms p(99.9)=503.89ms
       { expected_response:true }...: avg=216.94ms min=158.74ms med=215.43ms max=590.23ms p(90)=223.79ms p(95)=226.97ms p(99.9)=503.89ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13939
     http_req_receiving.............: avg=72.75µs  min=24.22µs  med=42.18µs  max=8.12ms   p(90)=90.53µs  p(95)=246.98µs p(99.9)=1.99ms  
     http_req_sending...............: avg=151.13µs min=5.38µs   med=9.06µs   max=370.5ms  p(90)=30.08µs  p(95)=93.74µs  p(99.9)=5.79ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=216.71ms min=158.68ms med=215.31ms max=589.43ms p(90)=223.64ms p(95)=226.83ms p(99.9)=486.03ms
     http_reqs......................: 13939   172.228392/s
     iteration_duration.............: avg=217.24ms min=158.92ms med=215.65ms max=612.09ms p(90)=223.98ms p(95)=227.16ms p(99.9)=530.72ms
     iterations.....................: 13839   170.992806/s
     success_rate...................: 100.00% ✓ 13839      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40173      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   193 kB/s
     http_req_blocked...............: avg=21.34µs  min=1.31µs   med=2.6µs    max=9.5ms    p(90)=3.76µs   p(95)=4.72µs   p(99.9)=7.21ms  
     http_req_connecting............: avg=18.05µs  min=0s       med=0s       max=9.47ms   p(90)=0s       p(95)=0s       p(99.9)=7.19ms  
     http_req_duration..............: avg=224.28ms min=160.78ms med=223.01ms max=632.41ms p(90)=243.27ms p(95)=248.85ms p(99.9)=518.77ms
       { expected_response:true }...: avg=224.28ms min=160.78ms med=223.01ms max=632.41ms p(90)=243.27ms p(95)=248.85ms p(99.9)=518.77ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13491
     http_req_receiving.............: avg=454.4µs  min=29.27µs  med=64.95µs  max=33.33ms  p(90)=359.61µs p(95)=734.25µs p(99.9)=24.83ms 
     http_req_sending...............: avg=76.95µs  min=5.64µs   med=10.93µs  max=306.17ms p(90)=32.07µs  p(95)=117.23µs p(99.9)=3.3ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=223.75ms min=160.69ms med=222.42ms max=631.55ms p(90)=242.81ms p(95)=248.27ms p(99.9)=517.69ms
     http_reqs......................: 13491   166.240758/s
     iteration_duration.............: avg=224.69ms min=160.96ms med=223.36ms max=652.23ms p(90)=243.61ms p(95)=249.07ms p(99.9)=549.02ms
     iterations.....................: 13391   165.008523/s
     success_rate...................: 100.00% ✓ 13391      ✗ 0    
     vus............................: 46      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37560      ✗ 0    
     data_received..................: 1.1 GB  15 MB/s
     data_sent......................: 15 MB   192 kB/s
     http_req_blocked...............: avg=25.81µs  min=1.11µs   med=2.64µs   max=11.3ms   p(90)=4.3µs    p(95)=5.66µs   p(99.9)=8.39ms  
     http_req_connecting............: avg=22.24µs  min=0s       med=0s       max=11.27ms  p(90)=0s       p(95)=0s       p(99.9)=8.34ms  
     http_req_duration..............: avg=239.07ms min=147.07ms med=230.35ms max=795.43ms p(90)=256.37ms p(95)=268.55ms p(99.9)=656.69ms
       { expected_response:true }...: avg=239.07ms min=147.07ms med=230.35ms max=795.43ms p(90)=256.37ms p(95)=268.55ms p(99.9)=656.69ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12620
     http_req_receiving.............: avg=93.58µs  min=25.29µs  med=46.31µs  max=13.9ms   p(90)=103.47µs p(95)=227.88µs p(99.9)=4.59ms  
     http_req_sending...............: avg=108.3µs  min=5.59µs   med=10.92µs  max=206.2ms  p(90)=33.11µs  p(95)=124.79µs p(99.9)=4.77ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=238.87ms min=143.41ms med=230.26ms max=794.63ms p(90)=256.19ms p(95)=268.26ms p(99.9)=655.99ms
     http_reqs......................: 12620   164.960181/s
     iteration_duration.............: avg=240.03ms min=147.38ms med=230.7ms  max=823.82ms p(90)=256.77ms p(95)=268.93ms p(99.9)=732.57ms
     iterations.....................: 12520   163.653048/s
     success_rate...................: 100.00% ✓ 12520      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37149      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   190 kB/s
     http_req_blocked...............: avg=23.19µs  min=1.15µs   med=2.79µs   max=9.87ms   p(90)=4.7µs    p(95)=6.2µs    p(99.9)=7.33ms  
     http_req_connecting............: avg=19.45µs  min=0s       med=0s       max=9.83ms   p(90)=0s       p(95)=0s       p(99.9)=7.32ms  
     http_req_duration..............: avg=241.8ms  min=144.79ms med=234.59ms max=725.54ms p(90)=255.8ms  p(95)=269.54ms p(99.9)=606.8ms 
       { expected_response:true }...: avg=241.8ms  min=144.79ms med=234.59ms max=725.54ms p(90)=255.8ms  p(95)=269.54ms p(99.9)=606.8ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 12483
     http_req_receiving.............: avg=94µs     min=27.19µs  med=50.13µs  max=18.77ms  p(90)=112.48µs p(95)=219.18µs p(99.9)=3.95ms  
     http_req_sending...............: avg=95.04µs  min=5.8µs    med=11.46µs  max=164.17ms p(90)=33.68µs  p(95)=118.78µs p(99.9)=5.81ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=241.61ms min=140.42ms med=234.47ms max=724.63ms p(90)=255.57ms p(95)=269.07ms p(99.9)=605.28ms
     http_reqs......................: 12483   162.992329/s
     iteration_duration.............: avg=242.77ms min=145.05ms med=234.96ms max=755.25ms p(90)=256.13ms p(95)=270.19ms p(99.9)=640.64ms
     iterations.....................: 12383   161.686615/s
     success_rate...................: 100.00% ✓ 12383      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 11155 / ✗ 2
     ✓ valid response structure

     checks.........................: 99.99% ✓ 33469      ✗ 2    
     data_received..................: 988 MB 12 MB/s
     data_sent......................: 13 MB  161 kB/s
     http_req_blocked...............: avg=25.18µs  min=1.58µs   med=2.72µs   max=9.08ms   p(90)=3.94µs   p(95)=4.87µs   p(99.9)=7.18ms  
     http_req_connecting............: avg=20.78µs  min=0s       med=0s       max=9.05ms   p(90)=0s       p(95)=0s       p(99.9)=7.16ms  
     http_req_duration..............: avg=268.68ms min=170.39ms med=269.1ms  max=673.37ms p(90)=301.49ms p(95)=310.38ms p(99.9)=568.44ms
       { expected_response:true }...: avg=268.68ms min=170.39ms med=269.1ms  max=673.37ms p(90)=301.49ms p(95)=310.38ms p(99.9)=568.44ms
     http_req_failed................: 0.00%  ✓ 0          ✗ 11257
     http_req_receiving.............: avg=138.59µs min=27.77µs  med=50.64µs  max=178.12ms p(90)=155.86µs p(95)=451.02µs p(99.9)=5.17ms  
     http_req_sending...............: avg=133.71µs min=6.74µs   med=11.14µs  max=188.4ms  p(90)=48.25µs  p(95)=138.06µs p(99.9)=4.35ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=268.41ms min=170.31ms med=268.95ms max=664.74ms p(90)=301.16ms p(95)=309.95ms p(99.9)=567.67ms
     http_reqs......................: 11257  138.39074/s
     iteration_duration.............: avg=269.56ms min=170.57ms med=269.69ms max=682.83ms p(90)=301.83ms p(95)=310.82ms p(99.9)=627.07ms
     iterations.....................: 11157  137.161365/s
     success_rate...................: 99.98% ✓ 11155      ✗ 2    
     vus............................: 50     min=0        max=50 
     vus_max........................: 50     min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29928      ✗ 0    
     data_received..................: 885 MB  11 MB/s
     data_sent......................: 12 MB   144 kB/s
     http_req_blocked...............: avg=33.43µs  min=1.37µs   med=3.35µs   max=11.25ms  p(90)=5.2µs    p(95)=6.11µs   p(99.9)=9.17ms  
     http_req_connecting............: avg=28.61µs  min=0s       med=0s       max=11.21ms  p(90)=0s       p(95)=0s       p(99.9)=9.14ms  
     http_req_duration..............: avg=299.94ms min=211.74ms med=297.61ms max=789.59ms p(90)=322.83ms p(95)=332.99ms p(99.9)=706.33ms
       { expected_response:true }...: avg=299.94ms min=211.74ms med=297.61ms max=789.59ms p(90)=322.83ms p(95)=332.99ms p(99.9)=706.33ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10076
     http_req_receiving.............: avg=82.36µs  min=30.31µs  med=63.55µs  max=5.06ms   p(90)=113.4µs  p(95)=140.04µs p(99.9)=2.56ms  
     http_req_sending...............: avg=97.84µs  min=6.4µs    med=13.36µs  max=315.08ms p(90)=23.69µs  p(95)=40.38µs  p(99.9)=2.74ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=299.76ms min=211.51ms med=297.5ms  max=788.56ms p(90)=322.72ms p(95)=332.88ms p(99.9)=705.31ms
     http_reqs......................: 10076   123.427401/s
     iteration_duration.............: avg=301.26ms min=221.6ms  med=298.1ms  max=805.84ms p(90)=323.4ms  p(95)=333.45ms p(99.9)=747.08ms
     iterations.....................: 9976    122.202436/s
     success_rate...................: 100.00% ✓ 9976       ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Sep 9, 2025

Overview for: ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1852 115795 total, 0 failed avg: 120ms, p95: 299ms
grafbase 1621 102831 total, 0 failed avg: 135ms, p95: 321ms
cosmo 707 45072 total, 0 failed avg: 312ms, p95: 683ms
apollo-router 402 26958 total, 0 failed avg: 523ms, p95: 1209ms ❌ 25 unexpected GraphQL errors, non-compatible response structure (1)
hive-gateway 272 18965 total, 0 failed avg: 740ms, p95: 1572ms
hive-gateway-bun 254 18002 total, 0 failed avg: 780ms, p95: 1619ms
apollo-gateway 157 10842 total, 0 failed avg: 1208ms, p95: 2699ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 344385      ✗ 0     
     data_received..................: 10 GB   163 MB/s
     data_sent......................: 135 MB  2.2 MB/s
     http_req_blocked...............: avg=388.7µs  min=1.12µs med=2.62µs   max=320.88ms p(90)=4.42µs   p(95)=5.61µs   p(99.9)=145.08ms
     http_req_connecting............: avg=381.9µs  min=0s     med=0s       max=320.84ms p(90)=0s       p(95)=0s       p(99.9)=143.8ms 
     http_req_duration..............: avg=120.35ms min=1.87ms med=106.52ms max=443.4ms  p(90)=248.52ms p(95)=298.72ms p(99.9)=387.03ms
       { expected_response:true }...: avg=120.35ms min=1.87ms med=106.52ms max=443.4ms  p(90)=248.52ms p(95)=298.72ms p(99.9)=387.03ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 115795
     http_req_receiving.............: avg=469.65µs min=24.1µs med=42.71µs  max=131.71ms p(90)=185.55µs p(95)=416.23µs p(99.9)=67.81ms 
     http_req_sending...............: avg=366.97µs min=5.21µs med=10.38µs  max=145.17ms p(90)=31.78µs  p(95)=133.45µs p(99.9)=67.65ms 
     http_req_tls_handshaking.......: avg=0s       min=0s     med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=119.51ms min=1.81ms med=105.8ms  max=412.64ms p(90)=246.62ms p(95)=297.09ms p(99.9)=384.55ms
     http_reqs......................: 115795  1852.733236/s
     iteration_duration.............: avg=122.05ms min=2ms    med=107.78ms max=743.2ms  p(90)=250.44ms p(95)=300.94ms p(99.9)=405ms   
     iterations.....................: 114795  1836.733122/s
     success_rate...................: 100.00% ✓ 114795      ✗ 0     
     vus............................: 84      min=0         max=493 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 305493      ✗ 0     
     data_received..................: 9.0 GB  143 MB/s
     data_sent......................: 120 MB  1.9 MB/s
     http_req_blocked...............: avg=540.44µs min=1.19µs  med=2.93µs   max=364.37ms p(90)=4.5µs    p(95)=5.92µs   p(99.9)=189.21ms
     http_req_connecting............: avg=535.92µs min=0s      med=0s       max=364.29ms p(90)=0s       p(95)=0s       p(99.9)=188.98ms
     http_req_duration..............: avg=135.4ms  min=2.64ms  med=123.65ms max=467.47ms p(90)=272.02ms p(95)=321.45ms p(99.9)=420.36ms
       { expected_response:true }...: avg=135.4ms  min=2.64ms  med=123.65ms max=467.47ms p(90)=272.02ms p(95)=321.45ms p(99.9)=420.36ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 102831
     http_req_receiving.............: avg=576.17µs min=25.21µs med=47.35µs  max=134.6ms  p(90)=158.4µs  p(95)=442.71µs p(99.9)=80.15ms 
     http_req_sending...............: avg=444.86µs min=5.36µs  med=11.86µs  max=131.55ms p(90)=33.09µs  p(95)=142.08µs p(99.9)=72.49ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=134.38ms min=2.57ms  med=122.51ms max=446.46ms p(90)=269.63ms p(95)=319.31ms p(99.9)=414.8ms 
     http_reqs......................: 102831  1621.394954/s
     iteration_duration.............: avg=137.62ms min=2.83ms  med=125.72ms max=901.1ms  p(90)=275.12ms p(95)=324.23ms p(99.9)=473.37ms
     iterations.....................: 101831  1605.627384/s
     success_rate...................: 100.00% ✓ 101831      ✗ 0     
     vus............................: 81      min=0         max=492 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 132216     ✗ 0    
     data_received..................: 4.0 GB  62 MB/s
     data_sent......................: 53 MB   823 kB/s
     http_req_blocked...............: avg=98.03µs  min=1.28µs med=2.97µs   max=156.99ms p(90)=4.3µs    p(95)=5.86µs   p(99.9)=31.64ms 
     http_req_connecting............: avg=93.53µs  min=0s     med=0s       max=156.95ms p(90)=0s       p(95)=0s       p(99.9)=31.59ms 
     http_req_duration..............: avg=311.62ms min=2.83ms med=297.19ms max=1.26s    p(90)=607.19ms p(95)=683.39ms p(99.9)=1s      
       { expected_response:true }...: avg=311.62ms min=2.83ms med=297.19ms max=1.26s    p(90)=607.19ms p(95)=683.39ms p(99.9)=1s      
     http_req_failed................: 0.00%   ✓ 0          ✗ 45072
     http_req_receiving.............: avg=813.05µs min=27.4µs med=61.36µs  max=164.53ms p(90)=234.1µs  p(95)=474.6µs  p(99.9)=112.27ms
     http_req_sending...............: avg=139.25µs min=5.76µs med=11.31µs  max=140.13ms p(90)=30.6µs   p(95)=128.59µs p(99.9)=29.6ms  
     http_req_tls_handshaking.......: avg=0s       min=0s     med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=310.67ms min=2.74ms med=296.7ms  max=1.26s    p(90)=604.46ms p(95)=681.12ms p(99.9)=1s      
     http_reqs......................: 45072   707.214579/s
     iteration_duration.............: avg=319.15ms min=3.11ms med=306.47ms max=1.26s    p(90)=610.51ms p(95)=685.8ms  p(99.9)=1.01s   
     iterations.....................: 44072   691.523805/s
     success_rate...................: 100.00% ✓ 44072      ✗ 0    
     vus............................: 96      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 25933 / ✗ 25
     ✗ valid response structure
      ↳  99% — ✓ 25957 / ✗ 1

     checks.........................: 99.96% ✓ 77848      ✗ 26   
     data_received..................: 2.4 GB 35 MB/s
     data_sent......................: 31 MB  469 kB/s
     http_req_blocked...............: avg=38.76µs  min=1.77µs  med=2.9µs    max=74.98ms p(90)=4.4µs   p(95)=5.79µs   p(99.9)=7.85ms
     http_req_connecting............: avg=33.8µs   min=0s      med=0s       max=74.94ms p(90)=0s      p(95)=0s       p(99.9)=7.78ms
     http_req_duration..............: avg=523ms    min=6.12ms  med=491.9ms  max=1.8s    p(90)=1.07s   p(95)=1.2s     p(99.9)=1.6s  
       { expected_response:true }...: avg=523ms    min=6.12ms  med=491.9ms  max=1.8s    p(90)=1.07s   p(95)=1.2s     p(99.9)=1.6s  
     http_req_failed................: 0.00%  ✓ 0          ✗ 26958
     http_req_receiving.............: avg=89.52µs  min=29.87µs med=50.11µs  max=73.53ms p(90)=94.19µs p(95)=145.68µs p(99.9)=4.01ms
     http_req_sending...............: avg=61.93µs  min=6.98µs  med=11.26µs  max=56.58ms p(90)=22.07µs p(95)=58.15µs  p(99.9)=9.28ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s      p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=522.85ms min=6.08ms  med=491.83ms max=1.8s    p(90)=1.07s   p(95)=1.2s     p(99.9)=1.6s  
     http_reqs......................: 26958  402.614308/s
     iteration_duration.............: avg=543.44ms min=6.26ms  med=515.81ms max=1.8s    p(90)=1.08s   p(95)=1.21s    p(99.9)=1.61s 
     iterations.....................: 25958  387.679435/s
     success_rate...................: 99.90% ✓ 25933      ✗ 25   
     vus............................: 60     min=0        max=498
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 53895      ✗ 0    
     data_received..................: 1.7 GB  24 MB/s
     data_sent......................: 22 MB   319 kB/s
     http_req_blocked...............: avg=93.69µs  min=1.24µs  med=2.75µs   max=181.16ms p(90)=4.6µs   p(95)=7.07µs   p(99.9)=21.24ms
     http_req_connecting............: avg=88.57µs  min=0s      med=0s       max=180.99ms p(90)=0s      p(95)=0s       p(99.9)=21.18ms
     http_req_duration..............: avg=740.47ms min=6.98ms  med=688.28ms max=4.6s     p(90)=1.43s   p(95)=1.57s    p(99.9)=3.78s  
       { expected_response:true }...: avg=740.47ms min=6.98ms  med=688.28ms max=4.6s     p(90)=1.43s   p(95)=1.57s    p(99.9)=3.78s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18965
     http_req_receiving.............: avg=145.58µs min=25.04µs med=43.12µs  max=104.3ms  p(90)=87.27µs p(95)=143.24µs p(99.9)=23.54ms
     http_req_sending...............: avg=148.57µs min=5.33µs  med=10.85µs  max=140.95ms p(90)=26.71µs p(95)=57.92µs  p(99.9)=26.02ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=740.18ms min=6.92ms  med=687.55ms max=4.6s     p(90)=1.43s   p(95)=1.57s    p(99.9)=3.78s  
     http_reqs......................: 18965   272.561848/s
     iteration_duration.............: avg=781.93ms min=7.11ms  med=753.28ms max=4.61s    p(90)=1.44s   p(95)=1.58s    p(99.9)=3.85s  
     iterations.....................: 17965   258.190013/s
     success_rate...................: 100.00% ✓ 17965      ✗ 0    
     vus............................: 92      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 51006      ✗ 0    
     data_received..................: 1.6 GB  22 MB/s
     data_sent......................: 21 MB   298 kB/s
     http_req_blocked...............: avg=109.12µs min=1.12µs  med=2.98µs   max=92ms     p(90)=5.47µs   p(95)=8.02µs   p(99.9)=30.08ms
     http_req_connecting............: avg=96.58µs  min=0s      med=0s       max=91.84ms  p(90)=0s       p(95)=0s       p(99.9)=25.64ms
     http_req_duration..............: avg=779.78ms min=7.42ms  med=733.71ms max=4.97s    p(90)=1.5s     p(95)=1.61s    p(99.9)=4.11s  
       { expected_response:true }...: avg=779.78ms min=7.42ms  med=733.71ms max=4.97s    p(90)=1.5s     p(95)=1.61s    p(99.9)=4.11s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18002
     http_req_receiving.............: avg=193µs    min=25.86µs med=47.12µs  max=129.46ms p(90)=102.13µs p(95)=166.47µs p(99.9)=26.05ms
     http_req_sending...............: avg=147.35µs min=5.71µs  med=11.37µs  max=89.59ms  p(90)=31.05µs  p(95)=84.38µs  p(99.9)=24.93ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=779.44ms min=7.36ms  med=733.44ms max=4.97s    p(90)=1.5s     p(95)=1.61s    p(99.9)=4.11s  
     http_reqs......................: 18002   254.46931/s
     iteration_duration.............: avg=825.84ms min=7.89ms  med=811.84ms max=4.99s    p(90)=1.52s    p(95)=1.63s    p(99.9)=4.13s  
     iterations.....................: 17002   240.333697/s
     success_rate...................: 100.00% ✓ 17002      ✗ 0    
     vus............................: 99      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29526      ✗ 0    
     data_received..................: 952 MB  14 MB/s
     data_sent......................: 13 MB   188 kB/s
     http_req_blocked...............: avg=35.03µs min=1.29µs  med=3.06µs  max=34.24ms p(90)=4.8µs   p(95)=9.8µs    p(99.9)=5.23ms
     http_req_connecting............: avg=29.56µs min=0s      med=0s      max=34.19ms p(90)=0s      p(95)=0s       p(99.9)=5.18ms
     http_req_duration..............: avg=1.2s    min=7.26ms  med=1.15s   max=15.57s  p(90)=2.3s    p(95)=2.69s    p(99.9)=13.81s
       { expected_response:true }...: avg=1.2s    min=7.26ms  med=1.15s   max=15.57s  p(90)=2.3s    p(95)=2.69s    p(99.9)=13.81s
     http_req_failed................: 0.00%   ✓ 0          ✗ 10842
     http_req_receiving.............: avg=70.51µs min=26.62µs med=49.65µs max=15.67ms p(90)=91.4µs  p(95)=115.77µs p(99.9)=1.96ms
     http_req_sending...............: avg=35.45µs min=5.88µs  med=12.13µs max=16.09ms p(90)=23.59µs p(95)=40.69µs  p(99.9)=5.5ms 
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s      p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=1.2s    min=7.18ms  med=1.15s   max=15.57s  p(90)=2.3s    p(95)=2.69s    p(99.9)=13.81s
     http_reqs......................: 10842   157.473406/s
     iteration_duration.............: avg=1.33s   min=7.45ms  med=1.27s   max=15.59s  p(90)=2.35s   p(95)=2.74s    p(99.9)=13.93s
     iterations.....................: 9842    142.949019/s
     success_rate...................: 100.00% ✓ 9842       ✗ 0    
     vus............................: 61      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Sep 9, 2025

Overview for: constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 172 13991 total, 0 failed avg: 216ms, p95: 227ms
hive-router 168 13589 total, 0 failed avg: 222ms, p95: 232ms
cosmo 160 12997 total, 0 failed avg: 232ms, p95: 254ms
hive-gateway-bun 151 11567 total, 0 failed avg: 261ms, p95: 386ms
hive-gateway 150 11496 total, 0 failed avg: 263ms, p95: 380ms
apollo-router 132 10813 total, 0 failed avg: 280ms, p95: 333ms
apollo-gateway 86 7102 total, 0 failed avg: 426ms, p95: 467ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41673      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   201 kB/s
     http_req_blocked...............: avg=18.73µs  min=1.27µs   med=1.99µs   max=8.98ms   p(90)=3.55µs   p(95)=5.12µs   p(99.9)=6.49ms  
     http_req_connecting............: avg=16.03µs  min=0s       med=0s       max=8.92ms   p(90)=0s       p(95)=0s       p(99.9)=6.48ms  
     http_req_duration..............: avg=216.11ms min=157.7ms  med=215.33ms max=600.96ms p(90)=224.51ms p(95)=227.22ms p(99.9)=503.22ms
       { expected_response:true }...: avg=216.11ms min=157.7ms  med=215.33ms max=600.96ms p(90)=224.51ms p(95)=227.22ms p(99.9)=503.22ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13991
     http_req_receiving.............: avg=80.46µs  min=27.91µs  med=46.16µs  max=13.61ms  p(90)=94.7µs   p(95)=255.88µs p(99.9)=3.71ms  
     http_req_sending...............: avg=96.68µs  min=5.94µs   med=8.52µs   max=374.98ms p(90)=31.66µs  p(95)=97.94µs  p(99.9)=6.21ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=215.93ms min=157.61ms med=215.23ms max=599.6ms  p(90)=224.36ms p(95)=227ms    p(99.9)=491.19ms
     http_reqs......................: 13991   172.788503/s
     iteration_duration.............: avg=216.4ms  min=157.86ms med=215.55ms max=622.93ms p(90)=224.71ms p(95)=227.39ms p(99.9)=517.7ms 
     iterations.....................: 13891   171.553505/s
     success_rate...................: 100.00% ✓ 13891      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40467      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   196 kB/s
     http_req_blocked...............: avg=18.71µs  min=1.15µs   med=2.11µs   max=8.68ms   p(90)=2.98µs   p(95)=4.03µs   p(99.9)=6.5ms   
     http_req_connecting............: avg=16.19µs  min=0s       med=0s       max=8.65ms   p(90)=0s       p(95)=0s       p(99.9)=6.47ms  
     http_req_duration..............: avg=222.07ms min=127.11ms med=221.44ms max=582.92ms p(90)=229.66ms p(95)=232.14ms p(99.9)=492.23ms
       { expected_response:true }...: avg=222.07ms min=127.11ms med=221.44ms max=582.92ms p(90)=229.66ms p(95)=232.14ms p(99.9)=492.23ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13589
     http_req_receiving.............: avg=71.44µs  min=24.23µs  med=41.45µs  max=12ms     p(90)=81.76µs  p(95)=235.06µs p(99.9)=1.65ms  
     http_req_sending...............: avg=115.01µs min=5.57µs   med=9.35µs   max=316.56ms p(90)=28.12µs  p(95)=93.37µs  p(99.9)=5.64ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=221.89ms min=126.54ms med=221.33ms max=582.02ms p(90)=229.53ms p(95)=231.96ms p(99.9)=481.66ms
     http_reqs......................: 13589   168.246321/s
     iteration_duration.............: avg=222.42ms min=127.24ms med=221.65ms max=600.8ms  p(90)=229.84ms p(95)=232.31ms p(99.9)=519ms   
     iterations.....................: 13489   167.008214/s
     success_rate...................: 100.00% ✓ 13489      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 38691      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   187 kB/s
     http_req_blocked...............: avg=42.25µs  min=1.41µs   med=2.66µs   max=17.34ms  p(90)=3.87µs   p(95)=4.79µs   p(99.9)=13.24ms 
     http_req_connecting............: avg=38.53µs  min=0s       med=0s       max=17.01ms  p(90)=0s       p(95)=0s       p(99.9)=13.08ms 
     http_req_duration..............: avg=232.45ms min=109.91ms med=231.67ms max=613.36ms p(90)=248.27ms p(95)=254.14ms p(99.9)=525.14ms
       { expected_response:true }...: avg=232.45ms min=109.91ms med=231.67ms max=613.36ms p(90)=248.27ms p(95)=254.14ms p(99.9)=525.14ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12997
     http_req_receiving.............: avg=254.84µs min=29.93µs  med=62.24µs  max=30.18ms  p(90)=174.36µs p(95)=454.01µs p(99.9)=22.26ms 
     http_req_sending...............: avg=127.99µs min=6.08µs   med=11µs     max=359.88ms p(90)=29.64µs  p(95)=121.64µs p(99.9)=4.15ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=232.07ms min=109.74ms med=231.42ms max=610.53ms p(90)=247.83ms p(95)=253.61ms p(99.9)=503.77ms
     http_reqs......................: 12997   160.418192/s
     iteration_duration.............: avg=232.92ms min=110.08ms med=232.01ms max=634.12ms p(90)=248.55ms p(95)=254.39ms p(99.9)=540.15ms
     iterations.....................: 12897   159.183921/s
     success_rate...................: 100.00% ✓ 12897      ✗ 0    
     vus............................: 10      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 34401      ✗ 0    
     data_received..................: 1.0 GB  13 MB/s
     data_sent......................: 14 MB   176 kB/s
     http_req_blocked...............: avg=28.69µs  min=1.11µs   med=2.66µs   max=11.2ms   p(90)=4.22µs   p(95)=5.72µs   p(99.9)=8.94ms  
     http_req_connecting............: avg=25.19µs  min=0s       med=0s       max=11.17ms  p(90)=0s       p(95)=0s       p(99.9)=8.91ms  
     http_req_duration..............: avg=260.93ms min=160.65ms med=252.15ms max=729.15ms p(90)=274.12ms p(95)=385.66ms p(99.9)=623.28ms
       { expected_response:true }...: avg=260.93ms min=160.65ms med=252.15ms max=729.15ms p(90)=274.12ms p(95)=385.66ms p(99.9)=623.28ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11567
     http_req_receiving.............: avg=100.39µs min=24.49µs  med=46.48µs  max=21.83ms  p(90)=117.36µs p(95)=386.58µs p(99.9)=3.87ms  
     http_req_sending...............: avg=92.06µs  min=5.41µs   med=11.05µs  max=230.09ms p(90)=36.79µs  p(95)=136µs    p(99.9)=7.81ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=260.74ms min=155.26ms med=252.04ms max=728.44ms p(90)=273.91ms p(95)=385.44ms p(99.9)=622.14ms
     http_reqs......................: 11567   151.09597/s
     iteration_duration.............: avg=262.24ms min=163.01ms med=252.47ms max=788.24ms p(90)=274.52ms p(95)=387.49ms p(99.9)=677.94ms
     iterations.....................: 11467   149.789703/s
     success_rate...................: 100.00% ✓ 11467      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 34188      ✗ 0    
     data_received..................: 1.0 GB  13 MB/s
     data_sent......................: 13 MB   175 kB/s
     http_req_blocked...............: avg=28.31µs  min=1.16µs   med=2.7µs    max=11.35ms  p(90)=4.18µs   p(95)=5.55µs   p(99.9)=9.01ms  
     http_req_connecting............: avg=24.85µs  min=0s       med=0s       max=11.31ms  p(90)=0s       p(95)=0s       p(99.9)=8.96ms  
     http_req_duration..............: avg=262.53ms min=160.36ms med=253.63ms max=773.12ms p(90)=272.26ms p(95)=379.85ms p(99.9)=652.4ms 
       { expected_response:true }...: avg=262.53ms min=160.36ms med=253.63ms max=773.12ms p(90)=272.26ms p(95)=379.85ms p(99.9)=652.4ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 11496
     http_req_receiving.............: avg=93.32µs  min=25.13µs  med=46.89µs  max=14.25ms  p(90)=112.19µs p(95)=383.95µs p(99.9)=2.84ms  
     http_req_sending...............: avg=174.31µs min=5.51µs   med=11.22µs  max=268.34ms p(90)=37.76µs  p(95)=146.36µs p(99.9)=10.7ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=262.26ms min=160.27ms med=253.5ms  max=772.38ms p(90)=271.99ms p(95)=377.81ms p(99.9)=651.3ms 
     http_reqs......................: 11496   150.368909/s
     iteration_duration.............: avg=263.72ms min=169.31ms med=253.93ms max=794.2ms  p(90)=272.65ms p(95)=381.74ms p(99.9)=670.61ms
     iterations.....................: 11396   149.060898/s
     success_rate...................: 100.00% ✓ 11396      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 32139      ✗ 0    
     data_received..................: 949 MB  12 MB/s
     data_sent......................: 13 MB   154 kB/s
     http_req_blocked...............: avg=24.26µs  min=1.65µs   med=2.67µs   max=9ms      p(90)=3.95µs   p(95)=4.87µs   p(99.9)=6.97ms  
     http_req_connecting............: avg=20.55µs  min=0s       med=0s       max=8.95ms   p(90)=0s       p(95)=0s       p(99.9)=6.95ms  
     http_req_duration..............: avg=280.2ms  min=169.05ms med=275.48ms max=712.62ms p(90)=321.89ms p(95)=332.8ms  p(99.9)=618.87ms
       { expected_response:true }...: avg=280.2ms  min=169.05ms med=275.48ms max=712.62ms p(90)=321.89ms p(95)=332.8ms  p(99.9)=618.87ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10813
     http_req_receiving.............: avg=83.37µs  min=34.7µs   med=50.16µs  max=6.14ms   p(90)=100.98µs p(95)=207.85µs p(99.9)=1.53ms  
     http_req_sending...............: avg=83.45µs  min=6.99µs   med=10.92µs  max=327.11ms p(90)=23.42µs  p(95)=128.78µs p(99.9)=3.27ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=280.03ms min=168.99ms med=275.37ms max=711.58ms p(90)=321.7ms  p(95)=332.55ms p(99.9)=617.43ms
     http_reqs......................: 10813   132.764414/s
     iteration_duration.............: avg=281.14ms min=169.23ms med=276.03ms max=735.62ms p(90)=322.25ms p(95)=333.09ms p(99.9)=636.04ms
     iterations.....................: 10713   131.536591/s
     success_rate...................: 100.00% ✓ 10713      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 21006     ✗ 0   
     data_received..................: 624 MB  7.6 MB/s
     data_sent......................: 8.3 MB  101 kB/s
     http_req_blocked...............: avg=45.01µs  min=1.43µs   med=3.07µs   max=11.54ms  p(90)=4.42µs   p(95)=5.14µs   p(99.9)=9.98ms  
     http_req_connecting............: avg=41.41µs  min=0s       med=0s       max=11.5ms   p(90)=0s       p(95)=0s       p(99.9)=9.96ms  
     http_req_duration..............: avg=426.2ms  min=210.64ms med=428.51ms max=909.32ms p(90)=456.22ms p(95)=467.46ms p(99.9)=865.3ms 
       { expected_response:true }...: avg=426.2ms  min=210.64ms med=428.51ms max=909.32ms p(90)=456.22ms p(95)=467.46ms p(99.9)=865.3ms 
     http_req_failed................: 0.00%   ✓ 0         ✗ 7102
     http_req_receiving.............: avg=61.53µs  min=28.58µs  med=51.79µs  max=1.63ms   p(90)=89.59µs  p(95)=105.8µs  p(99.9)=520.86µs
     http_req_sending...............: avg=89.55µs  min=6.46µs   med=12.23µs  max=158.53ms p(90)=17.91µs  p(95)=23.36µs  p(99.9)=2.55ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=426.05ms min=210.57ms med=428.44ms max=909.16ms p(90)=456.09ms p(95)=467.37ms p(99.9)=864.34ms
     http_reqs......................: 7102    86.952643/s
     iteration_duration.............: avg=429.79ms min=266.7ms  med=429ms    max=931.1ms  p(90)=456.57ms p(95)=467.87ms p(99.9)=898.82ms
     iterations.....................: 7002    85.728303/s
     success_rate...................: 100.00% ✓ 7002      ✗ 0   
     vus............................: 50      min=0       max=50
     vus_max........................: 50      min=50      max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dependencies Pull requests that update a dependency file
Projects
None yet
Development

Successfully merging this pull request may close these issues.

0 participants