Skip to content

Conversation

@renovate
Copy link
Contributor

@renovate renovate bot commented Oct 29, 2025

This PR contains the following updates:

Package Type Update Change Age Confidence
node uses-with major 22.21 -> 24.11 age confidence
@types/node (source) devDependencies major 22.18.12 -> 24.9.2 age confidence

Release Notes

actions/node-versions (node)

v24.11.0: 24.11.0

Compare Source

Node.js 24.11.0

v24.10.0: 24.10.0

Compare Source

Node.js 24.10.0

v24.9.0: 24.9.0

Compare Source

Node.js 24.9.0

v24.8.0: 24.8.0

Compare Source

Node.js 24.8.0

v24.7.0: 24.7.0

Compare Source

Node.js 24.7.0

v24.6.0: 24.6.0

Compare Source

Node.js 24.6.0

v24.5.0: 24.5.0

Compare Source

Node.js 24.5.0

v24.4.1: 24.4.1

Compare Source

Node.js 24.4.1

v24.4.0: 24.4.0

Compare Source

Node.js 24.4.0

v24.3.0: 24.3.0

Compare Source

Node.js 24.3.0

v24.2.0: 24.2.0

Compare Source

Node.js 24.2.0

v24.1.0: 24.1.0

Compare Source

Node.js 24.1.0

v24.0.2: 24.0.2

Compare Source

Node.js 24.0.2

v24.0.1: 24.0.1

Compare Source

Node.js 24.0.1

v24.0.0: 24.0.0

Compare Source

Node.js 24.0.0


Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about these updates again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Oct 29, 2025
@github-actions
Copy link

💻 Website Preview

The latest changes are available as preview in: https://e466038a.federation-gateway-benchmark.pages.dev

@github-actions
Copy link

Overview for: constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1939 116866 total, 0 failed avg: 25ms, p95: 47ms
grafbase 1632 98469 total, 0 failed avg: 30ms, p95: 53ms
cosmo 654 39567 total, 0 failed avg: 76ms, p95: 111ms
apollo-router 373 22687 total, 0 failed avg: 132ms, p95: 173ms
hive-gateway-bun 291 17860 total, 0 failed avg: 168ms, p95: 336ms
hive-gateway 286 17541 total, 0 failed avg: 171ms, p95: 278ms
apollo-gateway 120 7344 total, 0 failed avg: 409ms, p95: 480ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 350298      ✗ 0     
     data_received..................: 10 GB   170 MB/s
     data_sent......................: 136 MB  2.3 MB/s
     http_req_blocked...............: avg=4.29µs   min=957ns   med=2.47µs  max=6.46ms   p(90)=3.79µs  p(95)=4.4µs    p(99.9)=47.48µs
     http_req_connecting............: avg=1.4µs    min=0s      med=0s      max=6.43ms   p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_duration..............: avg=25.45ms  min=1.74ms  med=22.8ms  max=407.83ms p(90)=40.15ms p(95)=46.59ms  p(99.9)=78.74ms
       { expected_response:true }...: avg=25.45ms  min=1.74ms  med=22.8ms  max=407.83ms p(90)=40.15ms p(95)=46.59ms  p(99.9)=78.74ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 116866
     http_req_receiving.............: avg=109.41µs min=21.73µs med=41.76µs max=100.03ms p(90)=97.56µs p(95)=323.05µs p(99.9)=11.47ms
     http_req_sending...............: avg=97.36µs  min=4.09µs  med=9.17µs  max=326.13ms p(90)=21.88µs p(95)=121.31µs p(99.9)=13.66ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=25.25ms  min=1.69ms  med=22.64ms max=406.79ms p(90)=39.78ms p(95)=46.17ms  p(99.9)=76.95ms
     http_reqs......................: 116866  1939.783759/s
     iteration_duration.............: avg=25.68ms  min=4.51ms  med=23.01ms max=426.87ms p(90)=40.37ms p(95)=46.81ms  p(99.9)=79.01ms
     iterations.....................: 116766  1938.123923/s
     success_rate...................: 100.00% ✓ 116766      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 295107      ✗ 0    
     data_received..................: 8.7 GB  144 MB/s
     data_sent......................: 115 MB  1.9 MB/s
     http_req_blocked...............: avg=5.85µs   min=1.23µs  med=2.93µs  max=8.95ms   p(90)=3.99µs   p(95)=4.62µs   p(99.9)=115.37µs
     http_req_connecting............: avg=2.32µs   min=0s      med=0s      max=8.92ms   p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_duration..............: avg=30.19ms  min=2.53ms  med=26.97ms max=445ms    p(90)=46.29ms  p(95)=52.93ms  p(99.9)=91.32ms 
       { expected_response:true }...: avg=30.19ms  min=2.53ms  med=26.97ms max=445ms    p(90)=46.29ms  p(95)=52.93ms  p(99.9)=91.32ms 
     http_req_failed................: 0.00%   ✓ 0           ✗ 98469
     http_req_receiving.............: avg=143.81µs min=24.75µs med=45.93µs max=50.19ms  p(90)=132.02µs p(95)=377.11µs p(99.9)=16.47ms 
     http_req_sending...............: avg=127.06µs min=5.18µs  med=11.3µs  max=419.39ms p(90)=35.67µs  p(95)=131.97µs p(99.9)=17.3ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=29.91ms  min=2.48ms  med=26.79ms max=444.27ms p(90)=45.82ms  p(95)=52.43ms  p(99.9)=86.62ms 
     http_reqs......................: 98469   1632.559152/s
     iteration_duration.............: avg=30.49ms  min=7.32ms  med=27.25ms max=466.93ms p(90)=46.57ms  p(95)=53.21ms  p(99.9)=91.64ms 
     iterations.....................: 98369   1630.90121/s
     success_rate...................: 100.00% ✓ 98369       ✗ 0    
     vus............................: 50      min=50        max=50 
     vus_max........................: 50      min=50        max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 118401     ✗ 0    
     data_received..................: 3.5 GB  58 MB/s
     data_sent......................: 46 MB   762 kB/s
     http_req_blocked...............: avg=10.71µs  min=1.29µs  med=2.98µs  max=11.58ms  p(90)=4.29µs   p(95)=5.35µs   p(99.9)=2.61ms  
     http_req_connecting............: avg=7.01µs   min=0s      med=0s      max=11.55ms  p(90)=0s       p(95)=0s       p(99.9)=2.58ms  
     http_req_duration..............: avg=75.53ms  min=2.92ms  med=74.46ms max=524.33ms p(90)=102.43ms p(95)=110.69ms p(99.9)=305.22ms
       { expected_response:true }...: avg=75.53ms  min=2.92ms  med=74.46ms max=524.33ms p(90)=102.43ms p(95)=110.69ms p(99.9)=305.22ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 39567
     http_req_receiving.............: avg=182.19µs min=30.48µs med=78.3µs  max=41.22ms  p(90)=159.14µs p(95)=409.24µs p(99.9)=16.73ms 
     http_req_sending...............: avg=47.36µs  min=5.67µs  med=11.36µs max=147.65ms p(90)=29.35µs  p(95)=124.82µs p(99.9)=2.98ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=75.3ms   min=2.82ms  med=74.24ms max=523.3ms  p(90)=102.17ms p(95)=110.36ms p(99.9)=304.73ms
     http_reqs......................: 39567   654.750755/s
     iteration_duration.............: avg=76.02ms  min=3.94ms  med=74.79ms max=553.94ms p(90)=102.75ms p(95)=110.99ms p(99.9)=318.85ms
     iterations.....................: 39467   653.095965/s
     success_rate...................: 100.00% ✓ 39467      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 67761      ✗ 0    
     data_received..................: 2.0 GB  33 MB/s
     data_sent......................: 26 MB   434 kB/s
     http_req_blocked...............: avg=13.6µs   min=1.94µs  med=3.05µs   max=9.83ms   p(90)=4.33µs   p(95)=5.12µs   p(99.9)=4.4ms   
     http_req_connecting............: avg=9.81µs   min=0s      med=0s       max=9.79ms   p(90)=0s       p(95)=0s       p(99.9)=4.39ms  
     http_req_duration..............: avg=131.99ms min=5.99ms  med=130.88ms max=602.76ms p(90)=162.42ms p(95)=172.81ms p(99.9)=426.55ms
       { expected_response:true }...: avg=131.99ms min=5.99ms  med=130.88ms max=602.76ms p(90)=162.42ms p(95)=172.81ms p(99.9)=426.55ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 22687
     http_req_receiving.............: avg=91.11µs  min=35.37µs med=54.07µs  max=268.67ms p(90)=102.99µs p(95)=131.57µs p(99.9)=1.69ms  
     http_req_sending...............: avg=67.65µs  min=7.5µs   med=11.81µs  max=370.93ms p(90)=19.19µs  p(95)=36.58µs  p(99.9)=1.85ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=131.84ms min=5.94ms  med=130.74ms max=580.22ms p(90)=162.34ms p(95)=172.7ms  p(99.9)=413.68ms
     http_reqs......................: 22687   373.27935/s
     iteration_duration.............: avg=132.9ms  min=25.04ms med=131.28ms max=655.95ms p(90)=162.81ms p(95)=173.19ms p(99.9)=439.35ms
     iterations.....................: 22587   371.634006/s
     success_rate...................: 100.00% ✓ 22587      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 53280      ✗ 0    
     data_received..................: 1.6 GB  26 MB/s
     data_sent......................: 21 MB   339 kB/s
     http_req_blocked...............: avg=20.96µs  min=1.24µs  med=2.75µs   max=11.87ms  p(90)=4.53µs   p(95)=5.65µs   p(99.9)=7.72ms  
     http_req_connecting............: avg=16.88µs  min=0s      med=0s       max=11.84ms  p(90)=0s       p(95)=0s       p(99.9)=7.69ms  
     http_req_duration..............: avg=167.87ms min=6.99ms  med=156.26ms max=675.23ms p(90)=189.34ms p(95)=336.48ms p(99.9)=503.02ms
       { expected_response:true }...: avg=167.87ms min=6.99ms  med=156.26ms max=675.23ms p(90)=189.34ms p(95)=336.48ms p(99.9)=503.02ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 17860
     http_req_receiving.............: avg=97.11µs  min=26.49µs med=47.08µs  max=31.76ms  p(90)=109.6µs  p(95)=211.4µs  p(99.9)=4.25ms  
     http_req_sending...............: avg=134.18µs min=5.49µs  med=11.21µs  max=248.31ms p(90)=33.05µs  p(95)=128.52µs p(99.9)=6.94ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=167.64ms min=6.94ms  med=156.1ms  max=673.83ms p(90)=189.04ms p(95)=336.01ms p(99.9)=493.58ms
     http_reqs......................: 17860   291.393882/s
     iteration_duration.............: avg=169.16ms min=26.43ms med=156.67ms max=714.11ms p(90)=189.74ms p(95)=337.23ms p(99.9)=563.06ms
     iterations.....................: 17760   289.762337/s
     success_rate...................: 100.00% ✓ 17760      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 52323      ✗ 0    
     data_received..................: 1.5 GB  25 MB/s
     data_sent......................: 20 MB   334 kB/s
     http_req_blocked...............: avg=21.04µs  min=1.22µs  med=2.88µs   max=11.87ms  p(90)=4.78µs   p(95)=6.07µs   p(99.9)=7.8ms   
     http_req_connecting............: avg=16.85µs  min=0s      med=0s       max=11.84ms  p(90)=0s       p(95)=0s       p(99.9)=7.74ms  
     http_req_duration..............: avg=170.95ms min=6.83ms  med=159.23ms max=984.11ms p(90)=191.34ms p(95)=278.48ms p(99.9)=902.14ms
       { expected_response:true }...: avg=170.95ms min=6.83ms  med=159.23ms max=984.11ms p(90)=191.34ms p(95)=278.48ms p(99.9)=902.14ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 17541
     http_req_receiving.............: avg=105.08µs min=25.96µs med=49.96µs  max=132.68ms p(90)=111.03µs p(95)=213.86µs p(99.9)=4.55ms  
     http_req_sending...............: avg=103.41µs min=5.41µs  med=11.5µs   max=264.34ms p(90)=33.77µs  p(95)=132.07µs p(99.9)=6.92ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=170.75ms min=6.77ms  med=159.08ms max=982.08ms p(90)=191.19ms p(95)=277.65ms p(99.9)=902.06ms
     http_reqs......................: 17541   286.935813/s
     iteration_duration.............: avg=172.34ms min=24.95ms med=159.7ms  max=984.39ms p(90)=191.81ms p(95)=293.03ms p(99.9)=902.47ms
     iterations.....................: 17441   285.300012/s
     success_rate...................: 100.00% ✓ 17441      ✗ 0    
     vus............................: 20      min=20       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 21732      ✗ 0   
     data_received..................: 645 MB  11 MB/s
     data_sent......................: 8.5 MB  140 kB/s
     http_req_blocked...............: avg=43.83µs  min=1.35µs   med=2.81µs   max=11.57ms  p(90)=4.47µs   p(95)=5.16µs   p(99.9)=9.99ms  
     http_req_connecting............: avg=40.46µs  min=0s       med=0s       max=11.53ms  p(90)=0s       p(95)=0s       p(99.9)=9.96ms  
     http_req_duration..............: avg=409.18ms min=7.3ms    med=409.27ms max=749.54ms p(90)=464.01ms p(95)=480.19ms p(99.9)=678.35ms
       { expected_response:true }...: avg=409.18ms min=7.3ms    med=409.27ms max=749.54ms p(90)=464.01ms p(95)=480.19ms p(99.9)=678.35ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 7344
     http_req_receiving.............: avg=73.48µs  min=30.23µs  med=50.83µs  max=75.93ms  p(90)=95.97µs  p(95)=111.06µs p(99.9)=609.69µs
     http_req_sending...............: avg=71.59µs  min=6.44µs   med=11.77µs  max=82.95ms  p(90)=19.67µs  p(95)=23.98µs  p(99.9)=6.31ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=409.04ms min=7.25ms   med=409.17ms max=733.44ms p(90)=463.88ms p(95)=480.1ms  p(99.9)=672.57ms
     http_reqs......................: 7344    120.176165/s
     iteration_duration.............: avg=415.07ms min=194.83ms med=409.85ms max=777.61ms p(90)=464.81ms p(95)=481.08ms p(99.9)=698.63ms
     iterations.....................: 7244    118.539779/s
     success_rate...................: 100.00% ✓ 7244       ✗ 0   
     vus............................: 28      min=28       max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

Overview for: ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1808 112633 total, 0 failed avg: 124ms, p95: 300ms
grafbase 1512 95655 total, 0 failed avg: 145ms, p95: 339ms
cosmo 682 43540 total, 0 failed avg: 322ms, p95: 736ms
apollo-router 397 26638 total, 0 failed avg: 529ms, p95: 1230ms ❌ 25 unexpected GraphQL errors
hive-gateway-bun 257 17975 total, 0 failed avg: 779ms, p95: 1673ms
hive-gateway 250 17279 total, 0 failed avg: 809ms, p95: 1715ms
apollo-gateway 143 9943 total, 0 failed avg: 1295ms, p95: 2702ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 334899      ✗ 0     
     data_received..................: 9.9 GB  159 MB/s
     data_sent......................: 131 MB  2.1 MB/s
     http_req_blocked...............: avg=530.28µs min=1.17µs  med=2.64µs   max=362.49ms p(90)=4.07µs   p(95)=4.78µs   p(99.9)=184.28ms
     http_req_connecting............: avg=526.39µs min=0s      med=0s       max=362.46ms p(90)=0s       p(95)=0s       p(99.9)=184.13ms
     http_req_duration..............: avg=123.55ms min=1.64ms  med=111.6ms  max=444.36ms p(90)=250.22ms p(95)=299.58ms p(99.9)=397.65ms
       { expected_response:true }...: avg=123.55ms min=1.64ms  med=111.6ms  max=444.36ms p(90)=250.22ms p(95)=299.58ms p(99.9)=397.65ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 112633
     http_req_receiving.............: avg=563.8µs  min=23.74µs med=42.26µs  max=145.56ms p(90)=95.82µs  p(95)=401.61µs p(99.9)=77.9ms  
     http_req_sending...............: avg=464.54µs min=5.32µs  med=10.4µs   max=143.09ms p(90)=21.64µs  p(95)=129.45µs p(99.9)=74.69ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=122.52ms min=1.6ms   med=110.64ms max=421.45ms p(90)=247.66ms p(95)=297.37ms p(99.9)=393.44ms
     http_reqs......................: 112633  1808.61686/s
     iteration_duration.............: avg=125.5ms  min=1.79ms  med=113.16ms max=766.03ms p(90)=252.8ms  p(95)=302.96ms p(99.9)=438.92ms
     iterations.....................: 111633  1792.559249/s
     success_rate...................: 100.00% ✓ 111633      ✗ 0     
     vus............................: 73      min=0         max=495 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 283965      ✗ 0    
     data_received..................: 8.4 GB  133 MB/s
     data_sent......................: 111 MB  1.8 MB/s
     http_req_blocked...............: avg=720.09µs min=1.17µs  med=2.94µs   max=521.66ms p(90)=4.36µs   p(95)=5.33µs   p(99.9)=230.55ms
     http_req_connecting............: avg=712.66µs min=0s      med=0s       max=521.62ms p(90)=0s       p(95)=0s       p(99.9)=230.49ms
     http_req_duration..............: avg=145.4ms  min=2.52ms  med=134.55ms max=489.69ms p(90)=290.08ms p(95)=339.45ms p(99.9)=438.85ms
       { expected_response:true }...: avg=145.4ms  min=2.52ms  med=134.55ms max=489.69ms p(90)=290.08ms p(95)=339.45ms p(99.9)=438.85ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 95655
     http_req_receiving.............: avg=668µs    min=24.45µs med=47.81µs  max=184.14ms p(90)=110.02µs p(95)=441.9µs  p(99.9)=91.75ms 
     http_req_sending...............: avg=602.64µs min=5.17µs  med=11.69µs  max=159.42ms p(90)=31.27µs  p(95)=140.87µs p(99.9)=85.76ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=144.12ms min=2.47ms  med=133.25ms max=460.41ms p(90)=287.64ms p(95)=336.47ms p(99.9)=433.1ms 
     http_reqs......................: 95655   1512.236318/s
     iteration_duration.............: avg=148.07ms min=2.83ms  med=136.52ms max=933.13ms p(90)=292.92ms p(95)=343.37ms p(99.9)=542.11ms
     iterations.....................: 94655   1496.427042/s
     success_rate...................: 100.00% ✓ 94655       ✗ 0    
     vus............................: 74      min=0         max=495
     vus_max........................: 500     min=500       max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 127620     ✗ 0    
     data_received..................: 3.8 GB  60 MB/s
     data_sent......................: 51 MB   795 kB/s
     http_req_blocked...............: avg=134.61µs min=1.3µs   med=2.9µs    max=236.29ms p(90)=4.32µs   p(95)=5.87µs   p(99.9)=40.74ms
     http_req_connecting............: avg=129.51µs min=0s      med=0s       max=236.14ms p(90)=0s       p(95)=0s       p(99.9)=40.41ms
     http_req_duration..............: avg=322.44ms min=2.77ms  med=294.52ms max=1.19s    p(90)=654.05ms p(95)=736.46ms p(99.9)=1.02s  
       { expected_response:true }...: avg=322.44ms min=2.77ms  med=294.52ms max=1.19s    p(90)=654.05ms p(95)=736.46ms p(99.9)=1.02s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 43540
     http_req_receiving.............: avg=602.64µs min=29.44µs med=59.56µs  max=164.13ms p(90)=189.97µs p(95)=481µs    p(99.9)=85.58ms
     http_req_sending...............: avg=193.13µs min=6.06µs  med=11.31µs  max=166.09ms p(90)=30.75µs  p(95)=130.68µs p(99.9)=40.26ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=321.64ms min=2.71ms  med=293.81ms max=1.18s    p(90)=651.95ms p(95)=734.12ms p(99.9)=1.01s  
     http_reqs......................: 43540   682.390756/s
     iteration_duration.............: avg=330.62ms min=3.04ms  med=303.42ms max=1.19s    p(90)=658.78ms p(95)=739.67ms p(99.9)=1.02s  
     iterations.....................: 42540   666.718024/s
     success_rate...................: 100.00% ✓ 42540      ✗ 0    
     vus............................: 29      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 25613 / ✗ 25
     ✓ valid response structure

     checks.........................: 99.96% ✓ 76888      ✗ 25   
     data_received..................: 2.3 GB 35 MB/s
     data_sent......................: 31 MB  463 kB/s
     http_req_blocked...............: avg=77.2µs   min=1.72µs  med=2.9µs    max=78.43ms p(90)=4.63µs   p(95)=6.99µs   p(99.9)=23.52ms
     http_req_connecting............: avg=72.14µs  min=0s      med=0s       max=78.38ms p(90)=0s       p(95)=0s       p(99.9)=23.45ms
     http_req_duration..............: avg=529.27ms min=6.01ms  med=489.92ms max=1.85s   p(90)=1.08s    p(95)=1.22s    p(99.9)=1.73s  
       { expected_response:true }...: avg=529.27ms min=6.01ms  med=489.92ms max=1.85s   p(90)=1.08s    p(95)=1.22s    p(99.9)=1.73s  
     http_req_failed................: 0.00%  ✓ 0          ✗ 26638
     http_req_receiving.............: avg=128.03µs min=29.97µs med=51.95µs  max=75.57ms p(90)=103.49µs p(95)=238.81µs p(99.9)=11.3ms 
     http_req_sending...............: avg=122.89µs min=7.23µs  med=11.54µs  max=73.88ms p(90)=30.88µs  p(95)=123.66µs p(99.9)=23.4ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=529.02ms min=5.96ms  med=489.76ms max=1.85s   p(90)=1.08s    p(95)=1.22s    p(99.9)=1.73s  
     http_reqs......................: 26638  397.436/s
     iteration_duration.............: avg=550.3ms  min=6.45ms  med=517.04ms max=1.85s   p(90)=1.09s    p(95)=1.23s    p(99.9)=1.73s  
     iterations.....................: 25637  382.501191/s
     success_rate...................: 99.90% ✓ 25612      ✗ 25   
     vus............................: 62     min=0        max=497
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 50925      ✗ 0    
     data_received..................: 1.6 GB  23 MB/s
     data_sent......................: 21 MB   302 kB/s
     http_req_blocked...............: avg=109.21µs min=1.29µs  med=2.79µs   max=92.42ms p(90)=4.84µs  p(95)=7.72µs   p(99.9)=29.68ms
     http_req_connecting............: avg=102.84µs min=0s      med=0s       max=92.37ms p(90)=0s      p(95)=0s       p(99.9)=29.62ms
     http_req_duration..............: avg=778.6ms  min=7.05ms  med=717.21ms max=5.55s   p(90)=1.52s   p(95)=1.67s    p(99.9)=4.48s  
       { expected_response:true }...: avg=778.6ms  min=7.05ms  med=717.21ms max=5.55s   p(90)=1.52s   p(95)=1.67s    p(99.9)=4.48s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 17975
     http_req_receiving.............: avg=165.64µs min=26.56µs med=44.69µs  max=85.84ms p(90)=94.97µs p(95)=154.96µs p(99.9)=25.65ms
     http_req_sending...............: avg=184.89µs min=5.93µs  med=11.17µs  max=80.44ms p(90)=30.14µs p(95)=92.04µs  p(99.9)=29.49ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=778.25ms min=6.97ms  med=717.13ms max=5.55s   p(90)=1.52s   p(95)=1.67s    p(99.9)=4.48s  
     http_reqs......................: 17975   257.493122/s
     iteration_duration.............: avg=824.76ms min=8.49ms  med=768.49ms max=5.57s   p(90)=1.54s   p(95)=1.69s    p(99.9)=4.64s  
     iterations.....................: 16975   243.168052/s
     success_rate...................: 100.00% ✓ 16975      ✗ 0    
     vus............................: 64      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 48837      ✗ 0    
     data_received..................: 1.5 GB  22 MB/s
     data_sent......................: 20 MB   294 kB/s
     http_req_blocked...............: avg=148.51µs min=1.38µs  med=3.05µs   max=113.03ms p(90)=5.24µs  p(95)=8.04µs   p(99.9)=45.92ms
     http_req_connecting............: avg=142.62µs min=0s      med=0s       max=112.89ms p(90)=0s      p(95)=0s       p(99.9)=45.85ms
     http_req_duration..............: avg=808.82ms min=6.75ms  med=766.64ms max=5.66s    p(90)=1.59s   p(95)=1.71s    p(99.9)=4.81s  
       { expected_response:true }...: avg=808.82ms min=6.75ms  med=766.64ms max=5.66s    p(90)=1.59s   p(95)=1.71s    p(99.9)=4.81s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 17279
     http_req_receiving.............: avg=183.87µs min=27.89µs med=47.3µs   max=88.88ms  p(90)=99.28µs p(95)=176.86µs p(99.9)=22.72ms
     http_req_sending...............: avg=207.74µs min=6.02µs  med=11.52µs  max=89.56ms  p(90)=33.19µs p(95)=128.48µs p(99.9)=42.01ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=808.43ms min=6.7ms   med=765.98ms max=5.66s    p(90)=1.59s   p(95)=1.71s    p(99.9)=4.81s  
     http_reqs......................: 17279   250.02063/s
     iteration_duration.............: avg=858.95ms min=8.45ms  med=838.72ms max=5.67s    p(90)=1.6s    p(95)=1.72s    p(99.9)=4.91s  
     iterations.....................: 16279   235.551006/s
     success_rate...................: 100.00% ✓ 16279      ✗ 0    
     vus............................: 71      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 26829      ✗ 0    
     data_received..................: 873 MB  13 MB/s
     data_sent......................: 12 MB   172 kB/s
     http_req_blocked...............: avg=56.33µs min=1.42µs  med=4.07µs  max=37.17ms p(90)=7µs      p(95)=21.88µs  p(99.9)=14.49ms
     http_req_connecting............: avg=48.79µs min=0s      med=0s      max=37.1ms  p(90)=0s       p(95)=0s       p(99.9)=14.41ms
     http_req_duration..............: avg=1.29s   min=7.84ms  med=1.27s   max=16.98s  p(90)=2.22s    p(95)=2.7s     p(99.9)=15.17s 
       { expected_response:true }...: avg=1.29s   min=7.84ms  med=1.27s   max=16.98s  p(90)=2.22s    p(95)=2.7s     p(99.9)=15.17s 
     http_req_failed................: 0.00%   ✓ 0          ✗ 9943 
     http_req_receiving.............: avg=93.05µs min=30.54µs med=71.01µs max=15.72ms p(90)=125.24µs p(95)=162.19µs p(99.9)=2.01ms 
     http_req_sending...............: avg=66.74µs min=6.42µs  med=15.35µs max=35.16ms p(90)=35.84µs  p(95)=57.88µs  p(99.9)=9.1ms  
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=1.29s   min=7.75ms  med=1.26s   max=16.98s  p(90)=2.22s    p(95)=2.7s     p(99.9)=15.17s 
     http_reqs......................: 9943    143.477543/s
     iteration_duration.............: avg=1.43s   min=8.77ms  med=1.4s    max=16.99s  p(90)=2.28s    p(95)=2.74s    p(99.9)=15.44s 
     iterations.....................: 8943    129.047538/s
     success_rate...................: 100.00% ✓ 8943       ✗ 0    
     vus............................: 90      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

Overview for: constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 173 14041 total, 0 failed avg: 215ms, p95: 226ms
hive-router 169 13743 total, 0 failed avg: 220ms, p95: 231ms
cosmo 167 13530 total, 0 failed avg: 223ms, p95: 247ms
hive-gateway 166 12729 total, 0 failed avg: 237ms, p95: 259ms
hive-gateway-bun 165 12651 total, 0 failed avg: 239ms, p95: 265ms
apollo-router 134 10978 total, 0 failed avg: 275ms, p95: 318ms
apollo-gateway 125 10242 total, 0 failed avg: 295ms, p95: 327ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41823      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   202 kB/s
     http_req_blocked...............: avg=18.82µs  min=1.23µs   med=1.89µs   max=9.28ms   p(90)=3.25µs   p(95)=4.61µs   p(99.9)=6.42ms  
     http_req_connecting............: avg=16.11µs  min=0s       med=0s       max=9.25ms   p(90)=0s       p(95)=0s       p(99.9)=6.4ms   
     http_req_duration..............: avg=214.87ms min=157.49ms med=214.04ms max=613.02ms p(90)=223.21ms p(95)=225.79ms p(99.9)=527.46ms
       { expected_response:true }...: avg=214.87ms min=157.49ms med=214.04ms max=613.02ms p(90)=223.21ms p(95)=225.79ms p(99.9)=527.46ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 14041
     http_req_receiving.............: avg=95.69µs  min=24.64µs  med=44.71µs  max=235.37ms p(90)=89.99µs  p(95)=243.25µs p(99.9)=6.34ms  
     http_req_sending...............: avg=141.3µs  min=5.6µs    med=8.26µs   max=378.68ms p(90)=29.05µs  p(95)=97.03µs  p(99.9)=10.81ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=214.63ms min=157.33ms med=213.91ms max=597.68ms p(90)=223.07ms p(95)=225.6ms  p(99.9)=479.85ms
     http_reqs......................: 14041   173.647075/s
     iteration_duration.............: avg=215.19ms min=157.78ms med=214.28ms max=637.23ms p(90)=223.43ms p(95)=225.99ms p(99.9)=549.29ms
     iterations.....................: 13941   172.41036/s
     success_rate...................: 100.00% ✓ 13941      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40929      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   197 kB/s
     http_req_blocked...............: avg=20.04µs  min=1.19µs   med=2µs      max=9.24ms   p(90)=3.35µs   p(95)=4.49µs   p(99.9)=6.81ms  
     http_req_connecting............: avg=16.51µs  min=0s       med=0s       max=9.21ms   p(90)=0s       p(95)=0s       p(99.9)=6.79ms  
     http_req_duration..............: avg=220.18ms min=121.75ms med=219.26ms max=612.82ms p(90)=227.79ms p(95)=230.74ms p(99.9)=513.3ms 
       { expected_response:true }...: avg=220.18ms min=121.75ms med=219.26ms max=612.82ms p(90)=227.79ms p(95)=230.74ms p(99.9)=513.3ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 13743
     http_req_receiving.............: avg=80.16µs  min=23.69µs  med=41.89µs  max=11.43ms  p(90)=85.54µs  p(95)=227.08µs p(99.9)=5.88ms  
     http_req_sending...............: avg=90µs     min=5.57µs   med=8.27µs   max=367.6ms  p(90)=26.91µs  p(95)=95.8µs   p(99.9)=6.21ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=220.01ms min=121.7ms  med=219.17ms max=612.1ms  p(90)=227.58ms p(95)=230.58ms p(99.9)=503.22ms
     http_reqs......................: 13743   169.757545/s
     iteration_duration.............: avg=220.51ms min=121.97ms med=219.52ms max=622.96ms p(90)=228ms    p(95)=230.93ms p(99.9)=523.72ms
     iterations.....................: 13643   168.522315/s
     success_rate...................: 100.00% ✓ 13643      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40290      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   194 kB/s
     http_req_blocked...............: avg=16.13µs  min=1.07µs   med=2.68µs   max=7.21ms   p(90)=4.05µs   p(95)=5.32µs   p(99.9)=5.01ms  
     http_req_connecting............: avg=12.75µs  min=0s       med=0s       max=7.17ms   p(90)=0s       p(95)=0s       p(99.9)=4.97ms  
     http_req_duration..............: avg=223.13ms min=130.18ms med=222.05ms max=598.2ms  p(90)=241.41ms p(95)=246.97ms p(99.9)=497.26ms
       { expected_response:true }...: avg=223.13ms min=130.18ms med=222.05ms max=598.2ms  p(90)=241.41ms p(95)=246.97ms p(99.9)=497.26ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13530
     http_req_receiving.............: avg=507.82µs min=26.95µs  med=55.55µs  max=38.23ms  p(90)=342.62µs p(95)=777.55µs p(99.9)=27.21ms 
     http_req_sending...............: avg=146.79µs min=4.71µs   med=10.35µs  max=308.47ms p(90)=23.96µs  p(95)=124.91µs p(99.9)=3.55ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=222.48ms min=127.13ms med=221.52ms max=597.33ms p(90)=240.7ms  p(95)=246.37ms p(99.9)=492.04ms
     http_reqs......................: 13530   167.035634/s
     iteration_duration.............: avg=223.53ms min=130.41ms med=222.43ms max=610.64ms p(90)=241.68ms p(95)=247.28ms p(99.9)=518.06ms
     iterations.....................: 13430   165.801076/s
     success_rate...................: 100.00% ✓ 13430      ✗ 0    
     vus............................: 46      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37887      ✗ 0    
     data_received..................: 1.1 GB  15 MB/s
     data_sent......................: 15 MB   193 kB/s
     http_req_blocked...............: avg=20.88µs  min=892ns    med=2.32µs   max=9.2ms    p(90)=4.08µs   p(95)=5.64µs   p(99.9)=6.67ms  
     http_req_connecting............: avg=17.75µs  min=0s       med=0s       max=9.17ms   p(90)=0s       p(95)=0s       p(99.9)=6.65ms  
     http_req_duration..............: avg=237.13ms min=160.49ms med=229.21ms max=723.76ms p(90)=250.76ms p(95)=259.33ms p(99.9)=606.3ms 
       { expected_response:true }...: avg=237.13ms min=160.49ms med=229.21ms max=723.76ms p(90)=250.76ms p(95)=259.33ms p(99.9)=606.3ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 12729
     http_req_receiving.............: avg=86.9µs   min=21.13µs  med=43.98µs  max=25.45ms  p(90)=105.01µs p(95)=221.98µs p(99.9)=4.21ms  
     http_req_sending...............: avg=70.87µs  min=4.3µs    med=9.87µs   max=167.76ms p(90)=29.48µs  p(95)=120.49µs p(99.9)=5.07ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=236.97ms min=160.37ms med=229.1ms  max=722.92ms p(90)=250.61ms p(95)=259.16ms p(99.9)=605.16ms
     http_reqs......................: 12729   166.269917/s
     iteration_duration.............: avg=238.1ms  min=163.09ms med=229.54ms max=758.15ms p(90)=251.09ms p(95)=259.8ms  p(99.9)=661.92ms
     iterations.....................: 12629   164.963688/s
     success_rate...................: 100.00% ✓ 12629      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37653      ✗ 0    
     data_received..................: 1.1 GB  15 MB/s
     data_sent......................: 15 MB   192 kB/s
     http_req_blocked...............: avg=21.26µs  min=956ns    med=2.65µs   max=9.85ms   p(90)=4.4µs    p(95)=6.12µs   p(99.9)=6.57ms  
     http_req_connecting............: avg=17.3µs   min=0s       med=0s       max=9.81ms   p(90)=0s       p(95)=0s       p(99.9)=6.33ms  
     http_req_duration..............: avg=238.51ms min=149.83ms med=230.91ms max=729.26ms p(90)=250.6ms  p(95)=265.35ms p(99.9)=635.24ms
       { expected_response:true }...: avg=238.51ms min=149.83ms med=230.91ms max=729.26ms p(90)=250.6ms  p(95)=265.35ms p(99.9)=635.24ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12651
     http_req_receiving.............: avg=79.5µs   min=21.91µs  med=45.3µs   max=17.63ms  p(90)=92.8µs   p(95)=159.82µs p(99.9)=3.66ms  
     http_req_sending...............: avg=49.64µs  min=4.2µs    med=10.03µs  max=90.46ms  p(90)=22.18µs  p(95)=105.91µs p(99.9)=3.93ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=238.38ms min=148.58ms med=230.81ms max=728.48ms p(90)=250.47ms p(95)=265.17ms p(99.9)=634.33ms
     http_reqs......................: 12651   165.258204/s
     iteration_duration.............: avg=239.44ms min=150.04ms med=231.22ms max=761.56ms p(90)=250.91ms p(95)=265.95ms p(99.9)=662.71ms
     iterations.....................: 12551   163.951919/s
     success_rate...................: 100.00% ✓ 12551      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 32634      ✗ 0    
     data_received..................: 963 MB  12 MB/s
     data_sent......................: 13 MB   157 kB/s
     http_req_blocked...............: avg=16.86µs  min=1.6µs    med=2.93µs   max=5.76ms   p(90)=4.33µs   p(95)=5.28µs   p(99.9)=4.36ms  
     http_req_connecting............: avg=13.11µs  min=0s       med=0s       max=5.73ms   p(90)=0s       p(95)=0s       p(99.9)=4.34ms  
     http_req_duration..............: avg=275.11ms min=147.05ms med=276.48ms max=671.55ms p(90)=309.47ms p(95)=318.25ms p(99.9)=595.04ms
       { expected_response:true }...: avg=275.11ms min=147.05ms med=276.48ms max=671.55ms p(90)=309.47ms p(95)=318.25ms p(99.9)=595.04ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10978
     http_req_receiving.............: avg=120.75µs min=30.12µs  med=52.43µs  max=80.42ms  p(90)=140.08µs p(95)=399.02µs p(99.9)=5.34ms  
     http_req_sending...............: avg=107.16µs min=6.71µs   med=10.92µs  max=295.51ms p(90)=27.47µs  p(95)=132.15µs p(99.9)=4.32ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=274.88ms min=142.38ms med=276.29ms max=670.6ms  p(90)=309.21ms p(95)=317.86ms p(99.9)=594.13ms
     http_reqs......................: 10978   134.650241/s
     iteration_duration.............: avg=276.08ms min=147.29ms med=277.08ms max=701.12ms p(90)=309.96ms p(95)=318.56ms p(99.9)=618.2ms 
     iterations.....................: 10878   133.423695/s
     success_rate...................: 100.00% ✓ 10878      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30426      ✗ 0    
     data_received..................: 900 MB  11 MB/s
     data_sent......................: 12 MB   146 kB/s
     http_req_blocked...............: avg=32.57µs  min=1.34µs   med=3.15µs   max=11.56ms  p(90)=4.73µs   p(95)=5.81µs   p(99.9)=9.49ms  
     http_req_connecting............: avg=27.34µs  min=0s       med=0s       max=11.52ms  p(90)=0s       p(95)=0s       p(99.9)=9.16ms  
     http_req_duration..............: avg=295.19ms min=210.45ms med=292.82ms max=829.85ms p(90)=316.37ms p(95)=327.26ms p(99.9)=724.01ms
       { expected_response:true }...: avg=295.19ms min=210.45ms med=292.82ms max=829.85ms p(90)=316.37ms p(95)=327.26ms p(99.9)=724.01ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10242
     http_req_receiving.............: avg=76.77µs  min=30.72µs  med=54.9µs   max=5.01ms   p(90)=105.07µs p(95)=128.86µs p(99.9)=1.79ms  
     http_req_sending...............: avg=86.96µs  min=6.12µs   med=12.71µs  max=353.42ms p(90)=22.26µs  p(95)=38.33µs  p(99.9)=3.41ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=295.03ms min=210.34ms med=292.71ms max=829ms    p(90)=316.24ms p(95)=327.15ms p(99.9)=722.89ms
     http_reqs......................: 10242   125.633852/s
     iteration_duration.............: avg=296.51ms min=214.98ms med=293.3ms  max=877.06ms p(90)=316.82ms p(95)=327.65ms p(99.9)=757.54ms
     iterations.....................: 10142   124.407198/s
     success_rate...................: 100.00% ✓ 10142      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

Overview for: constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 172 13991 total, 0 failed avg: 216ms, p95: 227ms
hive-router 167 13591 total, 0 failed avg: 223ms, p95: 234ms
cosmo 158 12897 total, 0 failed avg: 234ms, p95: 257ms
hive-gateway-bun 149 11420 total, 0 failed avg: 264ms, p95: 323ms
hive-gateway 148 11379 total, 0 failed avg: 266ms, p95: 326ms
apollo-router 121 9921 total, 0 failed avg: 304ms, p95: 351ms
apollo-gateway 83 6819 total, 0 failed avg: 445ms, p95: 492ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41673      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   201 kB/s
     http_req_blocked...............: avg=19.33µs  min=1.28µs   med=1.99µs   max=9.26ms   p(90)=3.47µs   p(95)=4.75µs   p(99.9)=6.78ms  
     http_req_connecting............: avg=16.66µs  min=0s       med=0s       max=9.23ms   p(90)=0s       p(95)=0s       p(99.9)=6.76ms  
     http_req_duration..............: avg=215.9ms  min=158.76ms med=215.01ms max=618.17ms p(90)=224.54ms p(95)=227.48ms p(99.9)=526.62ms
       { expected_response:true }...: avg=215.9ms  min=158.76ms med=215.01ms max=618.17ms p(90)=224.54ms p(95)=227.48ms p(99.9)=526.62ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13991
     http_req_receiving.............: avg=80.19µs  min=27.91µs  med=46.19µs  max=21.43ms  p(90)=89.21µs  p(95)=239.39µs p(99.9)=4.7ms   
     http_req_sending...............: avg=154.78µs min=5.94µs   med=8.55µs   max=390.3ms  p(90)=29.19µs  p(95)=96.2µs   p(99.9)=7.76ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=215.66ms min=158.71ms med=214.91ms max=617.37ms p(90)=224.37ms p(95)=227.28ms p(99.9)=501.66ms
     http_reqs......................: 13991   172.882172/s
     iteration_duration.............: avg=216.19ms min=158.93ms med=215.28ms max=626.99ms p(90)=224.77ms p(95)=227.69ms p(99.9)=536.71ms
     iterations.....................: 13891   171.646505/s
     success_rate...................: 100.00% ✓ 13891      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40473      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   195 kB/s
     http_req_blocked...............: avg=18.87µs  min=1.21µs   med=2.11µs   max=8.97ms   p(90)=3.03µs   p(95)=4.05µs   p(99.9)=6.53ms  
     http_req_connecting............: avg=16.38µs  min=0s       med=0s       max=8.94ms   p(90)=0s       p(95)=0s       p(99.9)=6.51ms  
     http_req_duration..............: avg=222.51ms min=158.67ms med=221.61ms max=612.75ms p(90)=231.04ms p(95)=234.21ms p(99.9)=519.84ms
       { expected_response:true }...: avg=222.51ms min=158.67ms med=221.61ms max=612.75ms p(90)=231.04ms p(95)=234.21ms p(99.9)=519.84ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13591
     http_req_receiving.............: avg=80.75µs  min=23.22µs  med=41.76µs  max=18.98ms  p(90)=84.74µs  p(95)=226.84µs p(99.9)=6.54ms  
     http_req_sending...............: avg=132.18µs min=5.51µs   med=9.09µs   max=380.87ms p(90)=27.59µs  p(95)=93.16µs  p(99.9)=4.92ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=222.3ms  min=158.63ms med=221.51ms max=611.89ms p(90)=230.87ms p(95)=233.98ms p(99.9)=503.45ms
     http_reqs......................: 13591   167.927038/s
     iteration_duration.............: avg=222.88ms min=158.85ms med=221.87ms max=624.92ms p(90)=231.23ms p(95)=234.39ms p(99.9)=536.66ms
     iterations.....................: 13491   166.691463/s
     success_rate...................: 100.00% ✓ 13491      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 38391     ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   185 kB/s
     http_req_blocked...............: avg=18.14µs  min=1.32µs   med=2.81µs   max=7.74ms   p(90)=4.41µs   p(95)=5.51µs   p(99.9)=5.63ms  
     http_req_connecting............: avg=14.75µs  min=0s       med=0s       max=7.71ms   p(90)=0s       p(95)=0s       p(99.9)=5.61ms  
     http_req_duration..............: avg=234.04ms min=120.4ms  med=233.36ms max=629.71ms p(90)=251.31ms p(95)=256.99ms p(99.9)=529.96ms
       { expected_response:true }...: avg=234.04ms min=120.4ms  med=233.36ms max=629.71ms p(90)=251.31ms p(95)=256.99ms p(99.9)=529.96ms
     http_req_failed................: 0.00%   ✓ 0         ✗ 12897
     http_req_receiving.............: avg=206.53µs min=31.2µs   med=54.27µs  max=34.26ms  p(90)=131.26µs p(95)=412.66µs p(99.9)=23.7ms  
     http_req_sending...............: avg=120.55µs min=5.58µs   med=10.49µs  max=227.73ms p(90)=21.44µs  p(95)=118.61µs p(99.9)=3.55ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=233.72ms min=116.55ms med=233.14ms max=628.87ms p(90)=250.93ms p(95)=256.49ms p(99.9)=529.13ms
     http_reqs......................: 12897   158.86009/s
     iteration_duration.............: avg=234.58ms min=120.65ms med=233.7ms  max=659.87ms p(90)=251.6ms  p(95)=257.31ms p(99.9)=573.29ms
     iterations.....................: 12797   157.62833/s
     success_rate...................: 100.00% ✓ 12797     ✗ 0    
     vus............................: 17      min=0       max=50 
     vus_max........................: 50      min=50      max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33960      ✗ 0    
     data_received..................: 1.0 GB  13 MB/s
     data_sent......................: 13 MB   174 kB/s
     http_req_blocked...............: avg=27.01µs  min=1.1µs    med=2.57µs   max=11.39ms  p(90)=3.98µs   p(95)=5.2µs    p(99.9)=8.27ms 
     http_req_connecting............: avg=23.67µs  min=0s       med=0s       max=11.34ms  p(90)=0s       p(95)=0s       p(99.9)=8.21ms 
     http_req_duration..............: avg=264.33ms min=132.72ms med=252.54ms max=1.13s    p(90)=272.98ms p(95)=322.9ms  p(99.9)=1.12s  
       { expected_response:true }...: avg=264.33ms min=132.72ms med=252.54ms max=1.13s    p(90)=272.98ms p(95)=322.9ms  p(99.9)=1.12s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 11420
     http_req_receiving.............: avg=96.52µs  min=24.39µs  med=43.1µs   max=10.77ms  p(90)=102.98µs p(95)=371.31µs p(99.9)=5.83ms 
     http_req_sending...............: avg=157.26µs min=5.32µs   med=10.62µs  max=209.96ms p(90)=36.65µs  p(95)=153.38µs p(99.9)=11.57ms
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=264.08ms min=128.36ms med=252.38ms max=1.13s    p(90)=272.64ms p(95)=319.08ms p(99.9)=1.12s  
     http_reqs......................: 11420   149.526431/s
     iteration_duration.............: avg=265.63ms min=132.91ms med=252.9ms  max=1.13s    p(90)=273.36ms p(95)=326.1ms  p(99.9)=1.12s  
     iterations.....................: 11320   148.217093/s
     success_rate...................: 100.00% ✓ 11320      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33837      ✗ 0    
     data_received..................: 999 MB  13 MB/s
     data_sent......................: 13 MB   173 kB/s
     http_req_blocked...............: avg=30.82µs  min=1.15µs   med=2.67µs   max=11.83ms  p(90)=4.05µs   p(95)=5.47µs   p(99.9)=9.53ms  
     http_req_connecting............: avg=26.37µs  min=0s       med=0s       max=11.79ms  p(90)=0s       p(95)=0s       p(99.9)=9.5ms   
     http_req_duration..............: avg=265.59ms min=132.21ms med=255.27ms max=883ms    p(90)=279.81ms p(95)=325.66ms p(99.9)=879.04ms
       { expected_response:true }...: avg=265.59ms min=132.21ms med=255.27ms max=883ms    p(90)=279.81ms p(95)=325.66ms p(99.9)=879.04ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11379
     http_req_receiving.............: avg=91.93µs  min=25.36µs  med=45.05µs  max=13.58ms  p(90)=102.17µs p(95)=356.3µs  p(99.9)=4.62ms  
     http_req_sending...............: avg=96.08µs  min=5.51µs   med=11µs     max=233.89ms p(90)=35.44µs  p(95)=145.67µs p(99.9)=5.58ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=265.4ms  min=132.15ms med=255.17ms max=882.96ms p(90)=279.58ms p(95)=325.04ms p(99.9)=878.99ms
     http_reqs......................: 11379   148.841202/s
     iteration_duration.............: avg=266.92ms min=132.44ms med=255.66ms max=883.25ms p(90)=280.25ms p(95)=327.14ms p(99.9)=879.27ms
     iterations.....................: 11279   147.533168/s
     success_rate...................: 100.00% ✓ 11279      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29463      ✗ 0   
     data_received..................: 871 MB  11 MB/s
     data_sent......................: 12 MB   142 kB/s
     http_req_blocked...............: avg=29.15µs  min=1.86µs   med=3.03µs   max=10.15ms  p(90)=4.63µs   p(95)=5.73µs   p(99.9)=7.99ms  
     http_req_connecting............: avg=25.07µs  min=0s       med=0s       max=10.07ms  p(90)=0s       p(95)=0s       p(99.9)=7.97ms  
     http_req_duration..............: avg=304.32ms min=174.68ms med=306.24ms max=772.61ms p(90)=341.15ms p(95)=351.38ms p(99.9)=663.92ms
       { expected_response:true }...: avg=304.32ms min=174.68ms med=306.24ms max=772.61ms p(90)=341.15ms p(95)=351.38ms p(99.9)=663.92ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 9921
     http_req_receiving.............: avg=115.13µs min=34.94µs  med=54.2µs   max=228.71ms p(90)=107.67µs p(95)=244.52µs p(99.9)=1.84ms  
     http_req_sending...............: avg=139.17µs min=8.06µs   med=11.63µs  max=371.1ms  p(90)=30.65µs  p(95)=144.72µs p(99.9)=4.28ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=304.06ms min=174.6ms  med=306.06ms max=758.01ms p(90)=340.93ms p(95)=351.01ms p(99.9)=656.08ms
     http_reqs......................: 9921    121.821588/s
     iteration_duration.............: avg=305.65ms min=174.96ms med=306.82ms max=788.53ms p(90)=341.54ms p(95)=351.83ms p(99.9)=679.28ms
     iterations.....................: 9821    120.593672/s
     success_rate...................: 100.00% ✓ 9821       ✗ 0   
     vus............................: 50      min=0        max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 20157     ✗ 0   
     data_received..................: 599 MB  7.3 MB/s
     data_sent......................: 7.9 MB  97 kB/s
     http_req_blocked...............: avg=47.03µs  min=1.32µs   med=3.76µs   max=11.82ms  p(90)=5.66µs   p(95)=6.4µs    p(99.9)=10.35ms 
     http_req_connecting............: avg=42.48µs  min=0s       med=0s       max=11.79ms  p(90)=0s       p(95)=0s       p(99.9)=10.32ms 
     http_req_duration..............: avg=444.66ms min=212.16ms med=449.92ms max=864.51ms p(90)=478.34ms p(95)=492.17ms p(99.9)=787.29ms
       { expected_response:true }...: avg=444.66ms min=212.16ms med=449.92ms max=864.51ms p(90)=478.34ms p(95)=492.17ms p(99.9)=787.29ms
     http_req_failed................: 0.00%   ✓ 0         ✗ 6819
     http_req_receiving.............: avg=76.73µs  min=30.65µs  med=66.79µs  max=1.22ms   p(90)=112.77µs p(95)=130.36µs p(99.9)=472.86µs
     http_req_sending...............: avg=107.69µs min=6.22µs   med=15.08µs  max=154ms    p(90)=23.34µs  p(95)=34.44µs  p(99.9)=10.81ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=444.47ms min=212.05ms med=449.82ms max=863.55ms p(90)=478.23ms p(95)=492.02ms p(99.9)=786.39ms
     http_reqs......................: 6819    83.366167/s
     iteration_duration.............: avg=448.56ms min=281.29ms med=450.47ms max=884.11ms p(90)=479.06ms p(95)=492.71ms p(99.9)=818.75ms
     iterations.....................: 6719    82.14361/s
     success_rate...................: 100.00% ✓ 6719      ✗ 0   
     vus............................: 50      min=0       max=50
     vus_max........................: 50      min=50      max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant