Skip to content

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Sep 9, 2025

This PR contains the following updates:

Package Change Age Confidence
capture-website-cli 4.0.0 -> 5.0.0 age confidence

Release Notes

sindresorhus/capture-website-cli (capture-website-cli)

v5.0.0

Compare Source

Breaking
Improvements
  • Add --allow-cors and --wait-for-network-ide flags 7de8fc0


Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Sep 9, 2025
Copy link

github-actions bot commented Sep 9, 2025

💻 Website Preview

The latest changes are available as preview in: https://6d3fdf86.federation-gateway-benchmark.pages.dev

Copy link

github-actions bot commented Sep 9, 2025

Overview for: ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1915 119386 total, 0 failed avg: 117ms, p95: 284ms
grafbase 1671 105594 total, 0 failed avg: 132ms, p95: 310ms
cosmo 699 44683 total, 0 failed avg: 314ms, p95: 688ms
apollo-router 399 26791 total, 0 failed avg: 526ms, p95: 1201ms ❌ 24 unexpected GraphQL errors, non-compatible response structure (1)
hive-gateway 272 18742 total, 0 failed avg: 748ms, p95: 1616ms
hive-gateway-bun 251 17656 total, 0 failed avg: 793ms, p95: 1690ms
apollo-gateway 152 10532 total, 0 failed avg: 1236ms, p95: 2731ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 355158      ✗ 0     
     data_received..................: 11 GB   168 MB/s
     data_sent......................: 139 MB  2.2 MB/s
     http_req_blocked...............: avg=395µs    min=1.17µs med=2.6µs    max=324.94ms p(90)=4.16µs   p(95)=5.11µs   p(99.9)=144.92ms
     http_req_connecting............: avg=390.71µs min=0s     med=0s       max=324.81ms p(90)=0s       p(95)=0s       p(99.9)=144.43ms
     http_req_duration..............: avg=116.68ms min=1.66ms med=104.47ms max=446.31ms p(90)=238.19ms p(95)=284.12ms p(99.9)=391.7ms 
       { expected_response:true }...: avg=116.68ms min=1.66ms med=104.47ms max=446.31ms p(90)=238.19ms p(95)=284.12ms p(99.9)=391.7ms 
     http_req_failed................: 0.00%   ✓ 0           ✗ 119386
     http_req_receiving.............: avg=487.93µs min=24.1µs med=42.06µs  max=145.31ms p(90)=176.29µs p(95)=400.89µs p(99.9)=71.97ms 
     http_req_sending...............: avg=358.2µs  min=5.59µs med=10.38µs  max=130.91ms p(90)=30.4µs   p(95)=130.07µs p(99.9)=62.79ms 
     http_req_tls_handshaking.......: avg=0s       min=0s     med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=115.83ms min=1.6ms  med=103.74ms max=437.61ms p(90)=236.43ms p(95)=282.33ms p(99.9)=388.15ms
     http_reqs......................: 119386  1915.934799/s
     iteration_duration.............: avg=118.33ms min=1.89ms med=105.84ms max=669.19ms p(90)=240.21ms p(95)=286.37ms p(99.9)=407.62ms
     iterations.....................: 118386  1899.886562/s
     success_rate...................: 100.00% ✓ 118386      ✗ 0     
     vus............................: 74      min=0         max=494 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 313782      ✗ 0     
     data_received..................: 9.3 GB  147 MB/s
     data_sent......................: 123 MB  1.9 MB/s
     http_req_blocked...............: avg=522.81µs min=1.13µs  med=2.92µs   max=391.79ms p(90)=4.32µs   p(95)=5.29µs   p(99.9)=178.57ms
     http_req_connecting............: avg=518.48µs min=0s      med=0s       max=391.74ms p(90)=0s       p(95)=0s       p(99.9)=178.43ms
     http_req_duration..............: avg=131.86ms min=2.55ms  med=124.5ms  max=489.17ms p(90)=261.64ms p(95)=309.5ms  p(99.9)=406.98ms
       { expected_response:true }...: avg=131.86ms min=2.55ms  med=124.5ms  max=489.17ms p(90)=261.64ms p(95)=309.5ms  p(99.9)=406.98ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 105594
     http_req_receiving.............: avg=559.68µs min=23.84µs med=46.6µs   max=143.55ms p(90)=164.46µs p(95)=427.87µs p(99.9)=76.38ms 
     http_req_sending...............: avg=438.12µs min=5.37µs  med=11.63µs  max=131.82ms p(90)=32.67µs  p(95)=135.76µs p(99.9)=70.51ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=130.86ms min=2.5ms   med=123.62ms max=459.33ms p(90)=259.43ms p(95)=307.41ms p(99.9)=404.41ms
     http_reqs......................: 105594  1671.654313/s
     iteration_duration.............: avg=133.96ms min=2.72ms  med=126.29ms max=860.15ms p(90)=264.36ms p(95)=312.59ms p(99.9)=462ms   
     iterations.....................: 104594  1655.823354/s
     success_rate...................: 100.00% ✓ 104594      ✗ 0     
     vus............................: 67      min=0         max=496 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 131049     ✗ 0    
     data_received..................: 3.9 GB  61 MB/s
     data_sent......................: 52 MB   815 kB/s
     http_req_blocked...............: avg=100.71µs min=1.28µs  med=2.74µs   max=155.11ms p(90)=4.17µs   p(95)=6.14µs   p(99.9)=33.51ms 
     http_req_connecting............: avg=95.77µs  min=0s      med=0s       max=155.05ms p(90)=0s       p(95)=0s       p(99.9)=32.81ms 
     http_req_duration..............: avg=314.32ms min=2.84ms  med=296.69ms max=1.17s    p(90)=613.61ms p(95)=688.41ms p(99.9)=998.45ms
       { expected_response:true }...: avg=314.32ms min=2.84ms  med=296.69ms max=1.17s    p(90)=613.61ms p(95)=688.41ms p(99.9)=998.45ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 44683
     http_req_receiving.............: avg=737.96µs min=27.35µs med=60.54µs  max=192.56ms p(90)=225.65µs p(95)=494.59µs p(99.9)=92.42ms 
     http_req_sending...............: avg=149.84µs min=5.55µs  med=11.12µs  max=121.62ms p(90)=30.21µs  p(95)=129.13µs p(99.9)=27.19ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=313.43ms min=2.75ms  med=296.37ms max=1.17s    p(90)=611.26ms p(95)=684.95ms p(99.9)=993.05ms
     http_reqs......................: 44683   699.753112/s
     iteration_duration.............: avg=321.98ms min=2.96ms  med=305.27ms max=1.17s    p(90)=617.3ms  p(95)=691.53ms p(99.9)=999.69ms
     iterations.....................: 43683   684.092724/s
     success_rate...................: 100.00% ✓ 43683      ✗ 0    
     vus............................: 54      min=0        max=499
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 25767 / ✗ 24
     ✗ valid response structure
      ↳  99% — ✓ 25789 / ✗ 1

     checks.........................: 99.96% ✓ 77347      ✗ 25   
     data_received..................: 2.4 GB 35 MB/s
     data_sent......................: 31 MB  466 kB/s
     http_req_blocked...............: avg=78.75µs  min=1.43µs  med=2.98µs   max=92.24ms p(90)=4.77µs  p(95)=6.87µs   p(99.9)=22.05ms
     http_req_connecting............: avg=73.71µs  min=0s      med=0s       max=92.06ms p(90)=0s      p(95)=0s       p(99.9)=21.99ms
     http_req_duration..............: avg=526.15ms min=6.07ms  med=488.92ms max=2.1s    p(90)=1.06s   p(95)=1.2s     p(99.9)=1.71s  
       { expected_response:true }...: avg=526.15ms min=6.07ms  med=488.92ms max=2.1s    p(90)=1.06s   p(95)=1.2s     p(99.9)=1.71s  
     http_req_failed................: 0.00%  ✓ 0          ✗ 26791
     http_req_receiving.............: avg=118.66µs min=29.01µs med=53.54µs  max=70.53ms p(90)=107.1µs p(95)=203.96µs p(99.9)=9.8ms  
     http_req_sending...............: avg=93.24µs  min=6.07µs  med=11.74µs  max=66.6ms  p(90)=30.17µs p(95)=118.32µs p(99.9)=17.04ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=525.93ms min=6.03ms  med=488.65ms max=2.1s    p(90)=1.06s   p(95)=1.2s     p(99.9)=1.71s  
     http_reqs......................: 26791  399.644795/s
     iteration_duration.............: avg=546.89ms min=6.5ms   med=515.69ms max=2.1s    p(90)=1.07s   p(95)=1.2s     p(99.9)=1.72s  
     iterations.....................: 25790  384.71275/s
     success_rate...................: 99.90% ✓ 25766      ✗ 24   
     vus............................: 63     min=0        max=497
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 53226      ✗ 0    
     data_received..................: 1.6 GB  24 MB/s
     data_sent......................: 22 MB   319 kB/s
     http_req_blocked...............: avg=130.45µs min=1.32µs  med=2.8µs    max=119.85ms p(90)=4.85µs  p(95)=8µs      p(99.9)=35.86ms
     http_req_connecting............: avg=124.61µs min=0s      med=0s       max=119.71ms p(90)=0s      p(95)=0s       p(99.9)=35.06ms
     http_req_duration..............: avg=748.22ms min=6.4ms   med=687.71ms max=4.71s    p(90)=1.47s   p(95)=1.61s    p(99.9)=3.77s  
       { expected_response:true }...: avg=748.22ms min=6.4ms   med=687.71ms max=4.71s    p(90)=1.47s   p(95)=1.61s    p(99.9)=3.77s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18742
     http_req_receiving.............: avg=178.71µs min=27.18µs med=45.34µs  max=128.24ms p(90)=96.65µs p(95)=172.55µs p(99.9)=21.9ms 
     http_req_sending...............: avg=178.23µs min=5.67µs  med=11.08µs  max=139.02ms p(90)=30.47µs p(95)=113.75µs p(99.9)=29.17ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=747.87ms min=6.34ms  med=687.33ms max=4.71s    p(90)=1.47s   p(95)=1.61s    p(99.9)=3.77s  
     http_reqs......................: 18742   272.041053/s
     iteration_duration.............: avg=790.8ms  min=7.69ms  med=741.21ms max=4.72s    p(90)=1.49s   p(95)=1.62s    p(99.9)=3.83s  
     iterations.....................: 17742   257.526004/s
     success_rate...................: 100.00% ✓ 17742      ✗ 0    
     vus............................: 61      min=0        max=499
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 49966      ✗ 0    
     data_received..................: 1.6 GB  22 MB/s
     data_sent......................: 21 MB   295 kB/s
     http_req_blocked...............: avg=157.03µs min=1.3µs   med=2.93µs   max=165.35ms p(90)=5.38µs   p(95)=8.23µs   p(99.9)=43.83ms
     http_req_connecting............: avg=151.45µs min=0s      med=0s       max=165.28ms p(90)=0s       p(95)=0s       p(99.9)=43.75ms
     http_req_duration..............: avg=793.14ms min=7.13ms  med=740.31ms max=5.68s    p(90)=1.5s     p(95)=1.69s    p(99.9)=4.58s  
       { expected_response:true }...: avg=793.14ms min=7.13ms  med=740.31ms max=5.68s    p(90)=1.5s     p(95)=1.69s    p(99.9)=4.58s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 17656
     http_req_receiving.............: avg=199.82µs min=26.87µs med=46.85µs  max=124.47ms p(90)=109.83µs p(95)=332.35µs p(99.9)=30.33ms
     http_req_sending...............: avg=202.88µs min=5.88µs  med=11.42µs  max=106.04ms p(90)=34.69µs  p(95)=128.03µs p(99.9)=36.52ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=792.74ms min=7.08ms  med=740.05ms max=5.68s    p(90)=1.5s     p(95)=1.68s    p(99.9)=4.58s  
     http_reqs......................: 17656   251.216208/s
     iteration_duration.............: avg=840.55ms min=8.95ms  med=785.7ms  max=5.48s    p(90)=1.52s    p(95)=1.7s     p(99.9)=4.56s  
     iterations.....................: 16654   236.959375/s
     success_rate...................: 100.00% ✓ 16654      ✗ 0    
     vus............................: 80      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 28596      ✗ 0    
     data_received..................: 925 MB  13 MB/s
     data_sent......................: 13 MB   182 kB/s
     http_req_blocked...............: avg=33.9µs  min=1.35µs  med=3.26µs  max=30.15ms p(90)=5.23µs   p(95)=11.89µs  p(99.9)=5.98ms
     http_req_connecting............: avg=27.36µs min=0s      med=0s      max=30.04ms p(90)=0s       p(95)=0s       p(99.9)=5.35ms
     http_req_duration..............: avg=1.23s   min=7.53ms  med=1.19s   max=15.54s  p(90)=2.27s    p(95)=2.73s    p(99.9)=13.76s
       { expected_response:true }...: avg=1.23s   min=7.53ms  med=1.19s   max=15.54s  p(90)=2.27s    p(95)=2.73s    p(99.9)=13.76s
     http_req_failed................: 0.00%   ✓ 0          ✗ 10532
     http_req_receiving.............: avg=74.29µs min=28.68µs med=54.68µs max=7.81ms  p(90)=100.08µs p(95)=124.36µs p(99.9)=1.44ms
     http_req_sending...............: avg=38.1µs  min=6.25µs  med=12.85µs max=13.95ms p(90)=28.44µs  p(95)=47.11µs  p(99.9)=5.91ms
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s       p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=1.23s   min=7.49ms  med=1.19s   max=15.54s  p(90)=2.27s    p(95)=2.73s    p(99.9)=13.76s
     http_reqs......................: 10532   152.639206/s
     iteration_duration.............: avg=1.36s   min=7.9ms   med=1.31s   max=15.55s  p(90)=2.35s    p(95)=2.78s    p(99.9)=13.79s
     iterations.....................: 9532    138.146308/s
     success_rate...................: 100.00% ✓ 9532       ✗ 0    
     vus............................: 68      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Sep 9, 2025

Overview for: constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 173 14044 total, 0 failed avg: 215ms, p95: 226ms
hive-router 168 13642 total, 0 failed avg: 221ms, p95: 231ms
cosmo 167 13595 total, 0 failed avg: 222ms, p95: 244ms
hive-gateway-bun 159 12234 total, 0 failed avg: 247ms, p95: 285ms
hive-gateway 156 12028 total, 0 failed avg: 251ms, p95: 282ms
apollo-router 136 11100 total, 0 failed avg: 272ms, p95: 315ms
apollo-gateway 121 9899 total, 0 failed avg: 305ms, p95: 341ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41832      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   202 kB/s
     http_req_blocked...............: avg=18.87µs  min=1.16µs   med=1.9µs    max=9.19ms   p(90)=3.44µs   p(95)=5.15µs   p(99.9)=6.62ms  
     http_req_connecting............: avg=16.26µs  min=0s       med=0s       max=9.15ms   p(90)=0s       p(95)=0s       p(99.9)=6.6ms   
     http_req_duration..............: avg=215.48ms min=155.57ms med=214.72ms max=607.15ms p(90)=223.32ms p(95)=225.92ms p(99.9)=505.99ms
       { expected_response:true }...: avg=215.48ms min=155.57ms med=214.72ms max=607.15ms p(90)=223.32ms p(95)=225.92ms p(99.9)=505.99ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 14044
     http_req_receiving.............: avg=81.93µs  min=26.83µs  med=46.27µs  max=11.31ms  p(90)=93.47µs  p(95)=250.01µs p(99.9)=4.94ms  
     http_req_sending...............: avg=102.16µs min=5.54µs   med=8.47µs   max=378.66ms p(90)=27.01µs  p(95)=93.92µs  p(99.9)=7.67ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=215.3ms  min=155.47ms med=214.62ms max=606.5ms  p(90)=223.2ms  p(95)=225.74ms p(99.9)=494.84ms
     http_reqs......................: 14044   173.339867/s
     iteration_duration.............: avg=215.73ms min=155.78ms med=214.93ms max=615.18ms p(90)=223.51ms p(95)=226.1ms  p(99.9)=514.37ms
     iterations.....................: 13944   172.105604/s
     success_rate...................: 100.00% ✓ 13944      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40626      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   196 kB/s
     http_req_blocked...............: avg=18.9µs   min=1.17µs   med=2.08µs   max=8.97ms   p(90)=3.31µs   p(95)=4.76µs   p(99.9)=6.51ms  
     http_req_connecting............: avg=16.31µs  min=0s       med=0s       max=8.93ms   p(90)=0s       p(95)=0s       p(99.9)=6.5ms   
     http_req_duration..............: avg=221.21ms min=167.16ms med=220.23ms max=626.24ms p(90)=228.44ms p(95)=231.21ms p(99.9)=526.14ms
       { expected_response:true }...: avg=221.21ms min=167.16ms med=220.23ms max=626.24ms p(90)=228.44ms p(95)=231.21ms p(99.9)=526.14ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13642
     http_req_receiving.............: avg=83.39µs  min=23.77µs  med=44.1µs   max=22.6ms   p(90)=95.6µs   p(95)=270.65µs p(99.9)=4.4ms   
     http_req_sending...............: avg=105.97µs min=5.37µs   med=8.82µs   max=397.12ms p(90)=29.11µs  p(95)=101.71µs p(99.9)=5.86ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=221.02ms min=167.05ms med=220.13ms max=625.45ms p(90)=228.22ms p(95)=231.05ms p(99.9)=512.79ms
     http_reqs......................: 13642   168.728766/s
     iteration_duration.............: avg=221.53ms min=167.39ms med=220.45ms max=655.24ms p(90)=228.62ms p(95)=231.38ms p(99.9)=545.28ms
     iterations.....................: 13542   167.491933/s
     success_rate...................: 100.00% ✓ 13542      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40485      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   195 kB/s
     http_req_blocked...............: avg=21.78µs  min=1.52µs   med=2.64µs   max=9.44ms   p(90)=3.74µs   p(95)=4.6µs    p(99.9)=7.22ms  
     http_req_connecting............: avg=18.15µs  min=0s       med=0s       max=9.42ms   p(90)=0s       p(95)=0s       p(99.9)=7.2ms   
     http_req_duration..............: avg=222.22ms min=160.92ms med=220.86ms max=635.68ms p(90)=238.39ms p(95)=244.1ms  p(99.9)=524.49ms
       { expected_response:true }...: avg=222.22ms min=160.92ms med=220.86ms max=635.68ms p(90)=238.39ms p(95)=244.1ms  p(99.9)=524.49ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13595
     http_req_receiving.............: avg=457.86µs min=32.11µs  med=66.87µs  max=80.55ms  p(90)=377.26µs p(95)=941.48µs p(99.9)=24.3ms  
     http_req_sending...............: avg=65.31µs  min=6.79µs   med=10.89µs  max=241.42ms p(90)=30.8µs   p(95)=119.81µs p(99.9)=3.24ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=221.69ms min=160.84ms med=220.35ms max=634.14ms p(90)=237.87ms p(95)=243.66ms p(99.9)=510.19ms
     http_reqs......................: 13595   167.883232/s
     iteration_duration.............: avg=222.62ms min=161.13ms med=221.16ms max=653.21ms p(90)=238.69ms p(95)=244.39ms p(99.9)=551.84ms
     iterations.....................: 13495   166.648342/s
     success_rate...................: 100.00% ✓ 13495      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 36402      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 14 MB   185 kB/s
     http_req_blocked...............: avg=26.09µs  min=1.19µs   med=2.83µs   max=11.07ms  p(90)=4.86µs   p(95)=6.7µs    p(99.9)=8.65ms
     http_req_connecting............: avg=22.2µs   min=0s       med=0s       max=11.03ms  p(90)=0s       p(95)=0s       p(99.9)=8.63ms
     http_req_duration..............: avg=247.14ms min=160.89ms med=237.31ms max=1.05s    p(90)=263.08ms p(95)=285.4ms  p(99.9)=1.05s 
       { expected_response:true }...: avg=247.14ms min=160.89ms med=237.31ms max=1.05s    p(90)=263.08ms p(95)=285.4ms  p(99.9)=1.05s 
     http_req_failed................: 0.00%   ✓ 0          ✗ 12234
     http_req_receiving.............: avg=92.51µs  min=26.45µs  med=48.83µs  max=15.28ms  p(90)=113.23µs p(95)=243.14µs p(99.9)=3.05ms
     http_req_sending...............: avg=82.9µs   min=5.36µs   med=11.33µs  max=238.62ms p(90)=33.8µs   p(95)=127.73µs p(99.9)=6.59ms
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=246.96ms min=160.8ms  med=237.17ms max=1.05s    p(90)=262.94ms p(95)=285.23ms p(99.9)=1.05s 
     http_reqs......................: 12234   159.271729/s
     iteration_duration.............: avg=248.28ms min=194.37ms med=237.68ms max=1.05s    p(90)=263.44ms p(95)=285.88ms p(99.9)=1.05s 
     iterations.....................: 12134   157.969851/s
     success_rate...................: 100.00% ✓ 12134      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 35784      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 14 MB   182 kB/s
     http_req_blocked...............: avg=27.36µs  min=1.19µs   med=2.78µs   max=13.14ms  p(90)=4.55µs   p(95)=5.84µs   p(99.9)=8.36ms  
     http_req_connecting............: avg=23.65µs  min=0s       med=0s       max=13.1ms   p(90)=0s       p(95)=0s       p(99.9)=8.31ms  
     http_req_duration..............: avg=250.61ms min=139.39ms med=247.11ms max=836.03ms p(90)=272.75ms p(95)=281.55ms p(99.9)=830.2ms 
       { expected_response:true }...: avg=250.61ms min=139.39ms med=247.11ms max=836.03ms p(90)=272.75ms p(95)=281.55ms p(99.9)=830.2ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 12028
     http_req_receiving.............: avg=91.86µs  min=26.31µs  med=49.77µs  max=10.11ms  p(90)=117.32µs p(95)=237.46µs p(99.9)=3.16ms  
     http_req_sending...............: avg=138.47µs min=5.59µs   med=11.4µs   max=198.79ms p(90)=33.6µs   p(95)=125.9µs  p(99.9)=13.08ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=250.38ms min=139.31ms med=246.97ms max=835.98ms p(90)=272.58ms p(95)=281.33ms p(99.9)=829.98ms
     http_reqs......................: 12028   156.587965/s
     iteration_duration.............: avg=251.68ms min=139.62ms med=247.5ms  max=836.2ms  p(90)=273.02ms p(95)=281.92ms p(99.9)=830.57ms
     iterations.....................: 11928   155.286103/s
     success_rate...................: 100.00% ✓ 11928      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33000      ✗ 0    
     data_received..................: 974 MB  12 MB/s
     data_sent......................: 13 MB   158 kB/s
     http_req_blocked...............: avg=22.01µs  min=1.28µs   med=2.71µs   max=7.72ms   p(90)=4.05µs   p(95)=5µs      p(99.9)=6.09ms  
     http_req_connecting............: avg=17.94µs  min=0s       med=0s       max=7.69ms   p(90)=0s       p(95)=0s       p(99.9)=6.07ms  
     http_req_duration..............: avg=272.48ms min=176.52ms med=273.73ms max=677.6ms  p(90)=306.58ms p(95)=315.02ms p(99.9)=571.48ms
       { expected_response:true }...: avg=272.48ms min=176.52ms med=273.73ms max=677.6ms  p(90)=306.58ms p(95)=315.02ms p(99.9)=571.48ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11100
     http_req_receiving.............: avg=133.2µs  min=29.42µs  med=51.78µs  max=121.85ms p(90)=159.65µs p(95)=448.03µs p(99.9)=4.11ms  
     http_req_sending...............: avg=71.87µs  min=5.99µs   med=11.23µs  max=193.11ms p(90)=75.87µs  p(95)=134.54µs p(99.9)=3.66ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=272.27ms min=176.46ms med=273.57ms max=669.99ms p(90)=306.43ms p(95)=314.75ms p(99.9)=559.89ms
     http_reqs......................: 11100   136.134268/s
     iteration_duration.............: avg=273.37ms min=176.79ms med=274.25ms max=693.66ms p(90)=306.96ms p(95)=315.45ms p(99.9)=624.6ms 
     iterations.....................: 11000   134.907833/s
     success_rate...................: 100.00% ✓ 11000      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29397      ✗ 0   
     data_received..................: 869 MB  11 MB/s
     data_sent......................: 12 MB   141 kB/s
     http_req_blocked...............: avg=81.15µs  min=1.53µs   med=4.19µs   max=20.64ms  p(90)=6.05µs   p(95)=7.12µs   p(99.9)=18ms    
     http_req_connecting............: avg=75.2µs   min=0s       med=0s       max=20.57ms  p(90)=0s       p(95)=0s       p(99.9)=17.96ms 
     http_req_duration..............: avg=305.22ms min=212.37ms med=302.81ms max=815.38ms p(90)=329.61ms p(95)=340.58ms p(99.9)=711.52ms
       { expected_response:true }...: avg=305.22ms min=212.37ms med=302.81ms max=815.38ms p(90)=329.61ms p(95)=340.58ms p(99.9)=711.52ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 9899
     http_req_receiving.............: avg=105.82µs min=31.08µs  med=81.25µs  max=9.07ms   p(90)=137.53µs p(95)=173.37µs p(99.9)=3.18ms  
     http_req_sending...............: avg=115.77µs min=6.65µs   med=16.02µs  max=211.01ms p(90)=32.91µs  p(95)=47.43µs  p(99.9)=6.81ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=305ms    min=212.28ms med=302.63ms max=808ms    p(90)=329.38ms p(95)=340.28ms p(99.9)=705.41ms
     http_reqs......................: 9899    121.191348/s
     iteration_duration.............: avg=306.64ms min=223.02ms med=303.31ms max=847.5ms  p(90)=330.05ms p(95)=341.24ms p(99.9)=762.59ms
     iterations.....................: 9799    119.967069/s
     success_rate...................: 100.00% ✓ 9799       ✗ 0   
     vus............................: 50      min=0        max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Sep 9, 2025

Overview for: constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 172 13989 total, 0 failed avg: 216ms, p95: 227ms
hive-router 172 13984 total, 0 failed avg: 216ms, p95: 224ms
cosmo 166 13526 total, 0 failed avg: 223ms, p95: 239ms
hive-gateway 151 11603 total, 0 failed avg: 260ms, p95: 293ms
hive-gateway-bun 148 11387 total, 0 failed avg: 265ms, p95: 386ms
apollo-router 124 10173 total, 0 failed avg: 297ms, p95: 342ms
apollo-gateway 85 7005 total, 0 failed avg: 432ms, p95: 475ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41667      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   201 kB/s
     http_req_blocked...............: avg=19.52µs  min=1.27µs   med=2µs      max=9.22ms   p(90)=3.55µs   p(95)=5.21µs   p(99.9)=6.81ms  
     http_req_connecting............: avg=16.78µs  min=0s       med=0s       max=9.19ms   p(90)=0s       p(95)=0s       p(99.9)=6.79ms  
     http_req_duration..............: avg=216.44ms min=156.79ms med=215.64ms max=606.23ms p(90)=224.7ms  p(95)=227.32ms p(99.9)=501.69ms
       { expected_response:true }...: avg=216.44ms min=156.79ms med=215.64ms max=606.23ms p(90)=224.7ms  p(95)=227.32ms p(99.9)=501.69ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13989
     http_req_receiving.............: avg=80.52µs  min=26.76µs  med=46.22µs  max=15.25ms  p(90)=96.94µs  p(95)=254.85µs p(99.9)=3.39ms  
     http_req_sending...............: avg=106.27µs min=5.98µs   med=8.77µs   max=376.88ms p(90)=33.47µs  p(95)=94.32µs  p(99.9)=6.02ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=216.26ms min=156.73ms med=215.54ms max=605.19ms p(90)=224.57ms p(95)=227.16ms p(99.9)=494.13ms
     http_reqs......................: 13989   172.590325/s
     iteration_duration.............: avg=216.71ms min=157.05ms med=215.87ms max=618.07ms p(90)=224.89ms p(95)=227.51ms p(99.9)=511.09ms
     iterations.....................: 13889   171.356567/s
     success_rate...................: 100.00% ✓ 13889      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41652      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   201 kB/s
     http_req_blocked...............: avg=42.91µs  min=1.15µs   med=2.23µs   max=15.33ms  p(90)=3.51µs   p(95)=4.79µs   p(99.9)=12.91ms 
     http_req_connecting............: avg=40.06µs  min=0s       med=0s       max=15.16ms  p(90)=0s       p(95)=0s       p(99.9)=12.89ms 
     http_req_duration..............: avg=215.86ms min=160.19ms med=214.68ms max=594.35ms p(90)=221.67ms p(95)=224.2ms  p(99.9)=507.2ms 
       { expected_response:true }...: avg=215.86ms min=160.19ms med=214.68ms max=594.35ms p(90)=221.67ms p(95)=224.2ms  p(99.9)=507.2ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 13984
     http_req_receiving.............: avg=74.34µs  min=24.8µs   med=42.95µs  max=6.93ms   p(90)=87.69µs  p(95)=266.31µs p(99.9)=1.35ms  
     http_req_sending...............: avg=171.87µs min=5.49µs   med=9.49µs   max=364.56ms p(90)=29.71µs  p(95)=98.55µs  p(99.9)=5.28ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=215.61ms min=160.1ms  med=214.6ms  max=590.51ms p(90)=221.54ms p(95)=224.01ms p(99.9)=484.75ms
     http_reqs......................: 13984   172.848723/s
     iteration_duration.............: avg=216.18ms min=160.36ms med=214.89ms max=610.29ms p(90)=221.87ms p(95)=224.4ms  p(99.9)=534.99ms
     iterations.....................: 13884   171.612677/s
     success_rate...................: 100.00% ✓ 13884      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40278      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   194 kB/s
     http_req_blocked...............: avg=43.73µs  min=1.23µs   med=2.69µs   max=15.75ms  p(90)=3.82µs   p(95)=4.68µs   p(99.9)=13.44ms 
     http_req_connecting............: avg=40.29µs  min=0s       med=0s       max=15.56ms  p(90)=0s       p(95)=0s       p(99.9)=13.34ms 
     http_req_duration..............: avg=223.43ms min=156.3ms  med=222.37ms max=594.18ms p(90)=234.76ms p(95)=238.86ms p(99.9)=493.33ms
       { expected_response:true }...: avg=223.43ms min=156.3ms  med=222.37ms max=594.18ms p(90)=234.76ms p(95)=238.86ms p(99.9)=493.33ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13526
     http_req_receiving.............: avg=240.24µs min=29.42µs  med=62.73µs  max=147.48ms p(90)=216.7µs  p(95)=491.07µs p(99.9)=18.63ms 
     http_req_sending...............: avg=84.65µs  min=6.11µs   med=11.33µs  max=205.2ms  p(90)=31.04µs  p(95)=119.9µs  p(99.9)=6.78ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=223.1ms  min=156.23ms med=222.13ms max=586.42ms p(90)=234.51ms p(95)=238.5ms  p(99.9)=487.38ms
     http_reqs......................: 13526   166.907072/s
     iteration_duration.............: avg=223.83ms min=156.48ms med=222.65ms max=637.16ms p(90)=235.01ms p(95)=239.11ms p(99.9)=520.66ms
     iterations.....................: 13426   165.6731/s
     success_rate...................: 100.00% ✓ 13426      ✗ 0    
     vus............................: 23      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 34509      ✗ 0    
     data_received..................: 1.0 GB  13 MB/s
     data_sent......................: 14 MB   177 kB/s
     http_req_blocked...............: avg=28.78µs  min=1.16µs   med=2.65µs   max=11.43ms  p(90)=4.11µs   p(95)=5.59µs   p(99.9)=8.96ms  
     http_req_connecting............: avg=25.32µs  min=0s       med=0s       max=11.4ms   p(90)=0s       p(95)=0s       p(99.9)=8.93ms  
     http_req_duration..............: avg=259.84ms min=142.47ms med=249.37ms max=967.17ms p(90)=271.07ms p(95)=293.11ms p(99.9)=964.45ms
       { expected_response:true }...: avg=259.84ms min=142.47ms med=249.37ms max=967.17ms p(90)=271.07ms p(95)=293.11ms p(99.9)=964.45ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11603
     http_req_receiving.............: avg=87.53µs  min=26.36µs  med=46.23µs  max=10.71ms  p(90)=112.65µs p(95)=363.69µs p(99.9)=1.77ms  
     http_req_sending...............: avg=194.76µs min=5.42µs   med=11.04µs  max=313.94ms p(90)=38.99µs  p(95)=135.65µs p(99.9)=10.16ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=259.56ms min=138.41ms med=249.22ms max=967.09ms p(90)=270.85ms p(95)=292.11ms p(99.9)=964.41ms
     http_reqs......................: 11603   151.760968/s
     iteration_duration.............: avg=261ms    min=142.74ms med=249.69ms max=967.44ms p(90)=271.38ms p(95)=293.97ms p(99.9)=964.6ms 
     iterations.....................: 11503   150.453022/s
     success_rate...................: 100.00% ✓ 11503      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33861      ✗ 0    
     data_received..................: 1.0 GB  13 MB/s
     data_sent......................: 13 MB   173 kB/s
     http_req_blocked...............: avg=30.73µs  min=1.12µs   med=2.7µs    max=11.65ms  p(90)=4.36µs   p(95)=5.68µs   p(99.9)=9.2ms   
     http_req_connecting............: avg=26.5µs   min=0s       med=0s       max=11.61ms  p(90)=0s       p(95)=0s       p(99.9)=9.17ms  
     http_req_duration..............: avg=265.46ms min=156.55ms med=255.21ms max=754.6ms  p(90)=274.89ms p(95)=385.86ms p(99.9)=661.75ms
       { expected_response:true }...: avg=265.46ms min=156.55ms med=255.21ms max=754.6ms  p(90)=274.89ms p(95)=385.86ms p(99.9)=661.75ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11387
     http_req_receiving.............: avg=98.55µs  min=25.9µs   med=47.96µs  max=11.32ms  p(90)=116.61µs p(95)=391.53µs p(99.9)=4.92ms  
     http_req_sending...............: avg=134.22µs min=5.47µs   med=11.41µs  max=225.26ms p(90)=38.65µs  p(95)=149.96µs p(99.9)=7.94ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=265.23ms min=156.49ms med=255.07ms max=753.87ms p(90)=274.69ms p(95)=383.81ms p(99.9)=652.13ms
     http_reqs......................: 11387   148.562027/s
     iteration_duration.............: avg=266.72ms min=156.76ms med=255.56ms max=799.51ms p(90)=275.32ms p(95)=388.24ms p(99.9)=685.96ms
     iterations.....................: 11287   147.257363/s
     success_rate...................: 100.00% ✓ 11287      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30219      ✗ 0    
     data_received..................: 893 MB  11 MB/s
     data_sent......................: 12 MB   145 kB/s
     http_req_blocked...............: avg=23.38µs  min=1.61µs   med=2.88µs   max=7.81ms   p(90)=4.2µs    p(95)=5.11µs   p(99.9)=6.3ms   
     http_req_connecting............: avg=19.8µs   min=0s       med=0s       max=7.77ms   p(90)=0s       p(95)=0s       p(99.9)=6.28ms  
     http_req_duration..............: avg=296.96ms min=157.49ms med=298.1ms  max=699.78ms p(90)=332.57ms p(95)=341.69ms p(99.9)=634.25ms
       { expected_response:true }...: avg=296.96ms min=157.49ms med=298.1ms  max=699.78ms p(90)=332.57ms p(95)=341.69ms p(99.9)=634.25ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10173
     http_req_receiving.............: avg=82.65µs  min=34.26µs  med=52.15µs  max=2.46ms   p(90)=97.14µs  p(95)=180.81µs p(99.9)=1.43ms  
     http_req_sending...............: avg=145.75µs min=6.95µs   med=11.19µs  max=357.11ms p(90)=24.87µs  p(95)=127µs    p(99.9)=3.49ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=296.73ms min=157.42ms med=297.96ms max=698.41ms p(90)=332.45ms p(95)=341.59ms p(99.9)=633.41ms
     http_reqs......................: 10173   124.970973/s
     iteration_duration.............: avg=298.14ms min=157.67ms med=298.59ms max=733.08ms p(90)=332.92ms p(95)=342.14ms p(99.9)=653.09ms
     iterations.....................: 10073   123.742516/s
     success_rate...................: 100.00% ✓ 10073      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 20715     ✗ 0   
     data_received..................: 615 MB  7.5 MB/s
     data_sent......................: 8.1 MB  100 kB/s
     http_req_blocked...............: avg=49.23µs  min=1.44µs   med=3.28µs   max=12.14ms  p(90)=5µs      p(95)=5.63µs   p(99.9)=10.48ms 
     http_req_connecting............: avg=45.26µs  min=0s       med=0s       max=12.1ms   p(90)=0s       p(95)=0s       p(99.9)=10.44ms 
     http_req_duration..............: avg=432.41ms min=211.23ms med=436.51ms max=853.47ms p(90)=462.11ms p(95)=474.53ms p(99.9)=783.41ms
       { expected_response:true }...: avg=432.41ms min=211.23ms med=436.51ms max=853.47ms p(90)=462.11ms p(95)=474.53ms p(99.9)=783.41ms
     http_req_failed................: 0.00%   ✓ 0         ✗ 7005
     http_req_receiving.............: avg=85.88µs  min=34.13µs  med=57.23µs  max=111.9ms  p(90)=103.37µs p(95)=122.88µs p(99.9)=770.21µs
     http_req_sending...............: avg=119.13µs min=6.54µs   med=13.06µs  max=201.27ms p(90)=20.54µs  p(95)=26.98µs  p(99.9)=5.93ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=432.2ms  min=211.11ms med=436.41ms max=852.02ms p(90)=462.02ms p(95)=474.31ms p(99.9)=781.96ms
     http_reqs......................: 7005    85.707554/s
     iteration_duration.............: avg=435.99ms min=280.15ms med=436.99ms max=901.47ms p(90)=462.62ms p(95)=474.93ms p(99.9)=836.01ms
     iterations.....................: 6905    84.484034/s
     success_rate...................: 100.00% ✓ 6905      ✗ 0   
     vus............................: 50      min=0       max=50
     vus_max........................: 50      min=50      max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Sep 9, 2025

Overview for: constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1746 105250 total, 0 failed avg: 28ms, p95: 50ms
grafbase 1681 101421 total, 0 failed avg: 29ms, p95: 51ms
cosmo 677 40954 total, 0 failed avg: 73ms, p95: 107ms
apollo-router 367 22358 total, 0 failed avg: 134ms, p95: 174ms
hive-gateway 309 18848 total, 0 failed avg: 159ms, p95: 232ms
hive-gateway-bun 283 17324 total, 0 failed avg: 173ms, p95: 221ms
apollo-gateway 119 7313 total, 0 failed avg: 411ms, p95: 484ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 315450      ✗ 0     
     data_received..................: 9.2 GB  153 MB/s
     data_sent......................: 122 MB  2.0 MB/s
     http_req_blocked...............: avg=5.58µs   min=1.19µs  med=2.73µs  max=9.5ms    p(90)=4.17µs   p(95)=5.18µs   p(99.9)=99.69µs
     http_req_connecting............: avg=2.27µs   min=0s      med=0s      max=9.46ms   p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_duration..............: avg=28.29ms  min=1.93ms  med=25.68ms max=457.1ms  p(90)=43.85ms  p(95)=50.12ms  p(99.9)=90.8ms 
       { expected_response:true }...: avg=28.29ms  min=1.93ms  med=25.68ms max=457.1ms  p(90)=43.85ms  p(95)=50.12ms  p(99.9)=90.8ms 
     http_req_failed................: 0.00%   ✓ 0           ✗ 105250
     http_req_receiving.............: avg=126.38µs min=26.09µs med=45.89µs max=57.61ms  p(90)=136.11µs p(95)=378.14µs p(99.9)=12.31ms
     http_req_sending...............: avg=91.64µs  min=5.64µs  med=10.61µs max=282.24ms p(90)=33.91µs  p(95)=133.87µs p(99.9)=11.77ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=28.07ms  min=1.89ms  med=25.53ms max=456ms    p(90)=43.47ms  p(95)=49.72ms  p(99.9)=85.06ms
     http_reqs......................: 105250  1746.848796/s
     iteration_duration.............: avg=28.52ms  min=4.04ms  med=25.89ms max=478.51ms p(90)=44.06ms  p(95)=50.32ms  p(99.9)=92ms   
     iterations.....................: 105150  1745.189082/s
     success_rate...................: 100.00% ✓ 105150      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 303963      ✗ 0     
     data_received..................: 8.9 GB  148 MB/s
     data_sent......................: 118 MB  2.0 MB/s
     http_req_blocked...............: avg=5.92µs   min=1.17µs  med=2.99µs  max=9.13ms   p(90)=4.14µs   p(95)=5.02µs   p(99.9)=111.62µs
     http_req_connecting............: avg=2.24µs   min=0s      med=0s      max=9.1ms    p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_duration..............: avg=29.35ms  min=2.53ms  med=26.32ms max=441.94ms p(90)=44.65ms  p(95)=51.33ms  p(99.9)=85.99ms 
       { expected_response:true }...: avg=29.35ms  min=2.53ms  med=26.32ms max=441.94ms p(90)=44.65ms  p(95)=51.33ms  p(99.9)=85.99ms 
     http_req_failed................: 0.00%   ✓ 0           ✗ 101421
     http_req_receiving.............: avg=133.69µs min=25.63µs med=47.82µs max=272.8ms  p(90)=136.84µs p(95)=376.6µs  p(99.9)=13.25ms 
     http_req_sending...............: avg=99.8µs   min=5.3µs   med=11.56µs max=235.03ms p(90)=36.67µs  p(95)=132.32µs p(99.9)=14.36ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=29.12ms  min=2.49ms  med=26.15ms max=421.86ms p(90)=44.23ms  p(95)=50.88ms  p(99.9)=84.52ms 
     http_reqs......................: 101421  1681.124057/s
     iteration_duration.............: avg=29.6ms   min=7.13ms  med=26.54ms max=459.12ms p(90)=44.89ms  p(95)=51.57ms  p(99.9)=86.95ms 
     iterations.....................: 101321  1679.466487/s
     success_rate...................: 100.00% ✓ 101321      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 122562     ✗ 0    
     data_received..................: 3.6 GB  60 MB/s
     data_sent......................: 48 MB   788 kB/s
     http_req_blocked...............: avg=9.24µs   min=1.28µs  med=2.84µs  max=9.37ms   p(90)=3.98µs   p(95)=4.73µs   p(99.9)=1.63ms  
     http_req_connecting............: avg=5.66µs   min=0s      med=0s      max=9.34ms   p(90)=0s       p(95)=0s       p(99.9)=1.45ms  
     http_req_duration..............: avg=73.02ms  min=2.74ms  med=72.02ms max=507.98ms p(90)=98.56ms  p(95)=106.78ms p(99.9)=268.42ms
       { expected_response:true }...: avg=73.02ms  min=2.74ms  med=72.02ms max=507.98ms p(90)=98.56ms  p(95)=106.78ms p(99.9)=268.42ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 40954
     http_req_receiving.............: avg=172.93µs min=30.26µs med=72.45µs max=109.51ms p(90)=148.78µs p(95)=384.29µs p(99.9)=16.68ms 
     http_req_sending...............: avg=65.04µs  min=6.08µs  med=11.37µs max=202.54ms p(90)=29.37µs  p(95)=120.6µs  p(99.9)=2.97ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=72.78ms  min=2.62ms  med=71.83ms max=476.45ms p(90)=98.3ms   p(95)=106.48ms p(99.9)=255.25ms
     http_reqs......................: 40954   677.848598/s
     iteration_duration.............: avg=73.45ms  min=6.59ms  med=72.3ms  max=546.26ms p(90)=98.83ms  p(95)=107.04ms p(99.9)=296.33ms
     iterations.....................: 40854   676.193452/s
     success_rate...................: 100.00% ✓ 40854      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 66774      ✗ 0    
     data_received..................: 2.0 GB  32 MB/s
     data_sent......................: 26 MB   428 kB/s
     http_req_blocked...............: avg=14.59µs  min=1.6µs   med=2.94µs   max=9.58ms   p(90)=4.52µs   p(95)=5.19µs   p(99.9)=5.39ms  
     http_req_connecting............: avg=10.9µs   min=0s      med=0s       max=9.52ms   p(90)=0s       p(95)=0s       p(99.9)=5.36ms  
     http_req_duration..............: avg=134.06ms min=6.01ms  med=133.32ms max=581.95ms p(90)=164.21ms p(95)=173.97ms p(99.9)=412.19ms
       { expected_response:true }...: avg=134.06ms min=6.01ms  med=133.32ms max=581.95ms p(90)=164.21ms p(95)=173.97ms p(99.9)=412.19ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 22358
     http_req_receiving.............: avg=81.93µs  min=33.63µs med=54.05µs  max=70.82ms  p(90)=102.89µs p(95)=135.32µs p(99.9)=1.38ms  
     http_req_sending...............: avg=97.11µs  min=7.43µs  med=11.87µs  max=415.38ms p(90)=20.99µs  p(95)=36.61µs  p(99.9)=1.9ms   
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=133.88ms min=5.95ms  med=133.19ms max=580.32ms p(90)=164.08ms p(95)=173.82ms p(99.9)=406.75ms
     http_reqs......................: 22358   367.757447/s
     iteration_duration.............: avg=134.92ms min=26.89ms med=133.68ms max=626.7ms  p(90)=164.47ms p(95)=174.25ms p(99.9)=429.35ms
     iterations.....................: 22258   366.112589/s
     success_rate...................: 100.00% ✓ 22258      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 56244      ✗ 0    
     data_received..................: 1.7 GB  27 MB/s
     data_sent......................: 22 MB   360 kB/s
     http_req_blocked...............: avg=38.69µs  min=1.24µs  med=2.8µs    max=20.01ms  p(90)=4.8µs    p(95)=6.11µs   p(99.9)=14.39ms 
     http_req_connecting............: avg=34.47µs  min=0s      med=0s       max=19.8ms   p(90)=0s       p(95)=0s       p(99.9)=14.34ms 
     http_req_duration..............: avg=158.88ms min=6.89ms  med=147.89ms max=656.72ms p(90)=181.38ms p(95)=232.14ms p(99.9)=508.2ms 
       { expected_response:true }...: avg=158.88ms min=6.89ms  med=147.89ms max=656.72ms p(90)=181.38ms p(95)=232.14ms p(99.9)=508.2ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 18848
     http_req_receiving.............: avg=104.88µs min=27.51µs med=51.41µs  max=35.36ms  p(90)=120.84µs p(95)=291.74µs p(99.9)=4.47ms  
     http_req_sending...............: avg=83.77µs  min=5.65µs  med=11.45µs  max=214.48ms p(90)=33.34µs  p(95)=131.56µs p(99.9)=4.76ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=158.69ms min=6.82ms  med=147.74ms max=655.51ms p(90)=181.14ms p(95)=231.43ms p(99.9)=507.89ms
     http_reqs......................: 18848   309.182837/s
     iteration_duration.............: avg=160.07ms min=43.79ms med=148.27ms max=711.02ms p(90)=181.83ms p(95)=250.44ms p(99.9)=521.78ms
     iterations.....................: 18748   307.542436/s
     success_rate...................: 100.00% ✓ 18748      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 51672      ✗ 0    
     data_received..................: 1.5 GB  25 MB/s
     data_sent......................: 20 MB   330 kB/s
     http_req_blocked...............: avg=28.15µs  min=1.17µs  med=2.83µs   max=16.39ms  p(90)=5.02µs   p(95)=6.51µs   p(99.9)=10.97ms 
     http_req_connecting............: avg=23.97µs  min=0s      med=0s       max=16.36ms  p(90)=0s       p(95)=0s       p(99.9)=10.7ms  
     http_req_duration..............: avg=173.08ms min=7.38ms  med=160.49ms max=620.87ms p(90)=193.22ms p(95)=220.97ms p(99.9)=578.34ms
       { expected_response:true }...: avg=173.08ms min=7.38ms  med=160.49ms max=620.87ms p(90)=193.22ms p(95)=220.97ms p(99.9)=578.34ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 17324
     http_req_receiving.............: avg=111.17µs min=28.94µs med=56.6µs   max=145.63ms p(90)=124.53µs p(95)=248.15µs p(99.9)=3.67ms  
     http_req_sending...............: avg=92.59µs  min=5.79µs  med=11.56µs  max=173.8ms  p(90)=33.15µs  p(95)=132.24µs p(99.9)=10.6ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=172.88ms min=7.23ms  med=160.36ms max=612.62ms p(90)=193ms    p(95)=220.72ms p(99.9)=578.23ms
     http_reqs......................: 17324   283.706064/s
     iteration_duration.............: avg=174.42ms min=25.31ms med=160.84ms max=661.59ms p(90)=193.58ms p(95)=222.47ms p(99.9)=579.67ms
     iterations.....................: 17224   282.068417/s
     success_rate...................: 100.00% ✓ 17224      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 21639      ✗ 0   
     data_received..................: 642 MB  11 MB/s
     data_sent......................: 8.5 MB  139 kB/s
     http_req_blocked...............: avg=44.33µs  min=1.24µs  med=3.06µs   max=11.73ms  p(90)=4.61µs   p(95)=5.3µs    p(99.9)=10.14ms 
     http_req_connecting............: avg=39.14µs  min=0s      med=0s       max=11.7ms   p(90)=0s       p(95)=0s       p(99.9)=10.12ms 
     http_req_duration..............: avg=410.96ms min=7.37ms  med=410.48ms max=864.89ms p(90)=466.17ms p(95)=483.57ms p(99.9)=783.74ms
       { expected_response:true }...: avg=410.96ms min=7.37ms  med=410.48ms max=864.89ms p(90)=466.17ms p(95)=483.57ms p(99.9)=783.74ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 7313
     http_req_receiving.............: avg=62.99µs  min=26.8µs  med=52.64µs  max=1.28ms   p(90)=96.64µs  p(95)=111.79µs p(99.9)=335.7µs 
     http_req_sending...............: avg=92.24µs  min=5.84µs  med=12.29µs  max=233.76ms p(90)=19.78µs  p(95)=23.43µs  p(99.9)=3.45ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=410.81ms min=7.33ms  med=410.35ms max=863.78ms p(90)=466.06ms p(95)=483.39ms p(99.9)=782.63ms
     http_reqs......................: 7313    119.526965/s
     iteration_duration.............: avg=417.16ms min=83.22ms med=411ms    max=898.51ms p(90)=466.88ms p(95)=484.17ms p(99.9)=883.73ms
     iterations.....................: 7213    117.89252/s
     success_rate...................: 100.00% ✓ 7213       ✗ 0   
     vus............................: 37      min=37       max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@ardatan ardatan merged commit 42b0dae into main Sep 10, 2025
30 checks passed
@ardatan ardatan deleted the renovate/capture-website-cli-5.x branch September 10, 2025 08:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dependencies Pull requests that update a dependency file
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant