Skip to content

2021 05 10 bench results

Andrea edited this page May 11, 2021 · 3 revisions

Benchmarked on: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz, 32G RAM

Benchmark duration per suite: 300s Commit: e52aca9

Config:

GRPC_BENCHMARK_DURATION=300s
GRPC_SERVER_CPUS=<1-3>
GRPC_SERVER_RAM=512m
GRPC_CLIENT_CONNECTIONS=50
GRPC_CLIENT_CONCURRENCY=1000
GRPC_CLIENT_QPS=0
GRPC_CLIENT_CPUS=9
GRPC_REQUEST_PAYLOAD=100B

1 CPU Server

WIP

2 CPU Server

--------------------------------------------------------------------------------------------------------------------------------
| name               |   req/s |   avg. latency |        90 % in |        95 % in |        99 % in | avg. cpu |   avg. memory |
--------------------------------------------------------------------------------------------------------------------------------
| dotnet_grpc        |   65677 |       15.11 ms |       21.67 ms |       25.89 ms |       42.95 ms |  200.05% |    132.36 MiB |
| cpp_grpc_mt        |   64724 |       15.37 ms |       27.99 ms |       32.52 ms |       38.64 ms |  204.79% |     22.25 MiB |
| java_grpc_pgc      |   63075 |       15.75 ms |       62.48 ms |       77.01 ms |      106.26 ms |  203.31% |    196.53 MiB |
| rust_tonic_mt      |   59731 |       16.67 ms |       42.54 ms |       75.00 ms |      119.87 ms |   200.9% |     16.25 MiB |
| rust_grpcio        |   58300 |       17.06 ms |       22.96 ms |       24.96 ms |       31.05 ms |  202.68% |     41.52 MiB |
| java_grpc_g1gc     |   57033 |       17.41 ms |       69.22 ms |       84.24 ms |      119.44 ms |  203.82% |    180.86 MiB |
| java_grpc_she      |   52780 |       18.80 ms |       78.27 ms |       93.63 ms |      180.37 ms |   203.7% |    393.13 MiB |
| rust_thruster_mt   |   51649 |       19.29 ms |       49.43 ms |       87.63 ms |      143.30 ms |   201.4% |     14.16 MiB |
| java_grpc_zgc      |   51474 |       19.27 ms |       60.72 ms |       79.17 ms |      110.06 ms |   202.8% |    116.39 MiB |
| rust_tonic_st      |   49574 |       20.11 ms |       23.92 ms |       25.40 ms |       28.06 ms |  101.18% |     13.18 MiB |
| java_grpc_sgc      |   49324 |       20.17 ms |       57.72 ms |       78.48 ms |      131.01 ms |  200.47% |     93.66 MiB |
| rust_thruster_st   |   41674 |       23.93 ms |       28.16 ms |       29.68 ms |       32.11 ms |  101.56% |     12.12 MiB |
| go_grpc            |   38695 |       25.66 ms |       68.03 ms |       74.96 ms |       87.05 ms |  204.04% |     33.38 MiB |
| cpp_grpc_st        |   30219 |       33.03 ms |       36.36 ms |       37.55 ms |       39.64 ms |  102.39% |      8.19 MiB |
| crystal_grpc       |   22481 |       44.38 ms |       52.35 ms |       54.27 ms |       58.07 ms |   114.7% |     24.57 MiB |
| swift_grpc         |   21660 |       46.08 ms |       48.32 ms |       49.06 ms |       50.96 ms |  201.84% |      6.46 MiB |
| kotlin_grpc        |   19368 |       51.52 ms |      102.26 ms |      113.38 ms |      214.15 ms |  204.09% |    273.08 MiB |
| csharp_grpc        |   18904 |       52.79 ms |       85.25 ms |       90.65 ms |      100.93 ms |  204.73% |    109.46 MiB |
| haskell_mu         |   18269 |       54.66 ms |       71.75 ms |       75.82 ms |       84.42 ms |  203.44% |    171.33 MiB |
| java_micronaut     |   18057 |       54.75 ms |       88.67 ms |       98.57 ms |      182.88 ms |  177.53% |    481.44 MiB |
| node_grpc_st       |   12066 |       82.75 ms |       92.36 ms |       95.99 ms |      101.94 ms |  103.61% |     48.32 MiB |
| dart_grpc          |   10351 |       96.51 ms |       16.13 ms |         1.07 s |         1.19 s |  106.98% |     26.68 MiB |
| elixir_grpc        |    8298 |      120.39 ms |      140.64 ms |      147.27 ms |      160.95 ms |  203.76% |     82.73 MiB |
| node_grpcjs_st     |    7177 |      139.18 ms |      150.26 ms |      153.91 ms |      161.80 ms |  115.98% |     41.33 MiB |
| scala_akka         |    4776 |      209.10 ms |      381.94 ms |      495.42 ms |      798.40 ms |  200.29% |    174.23 MiB |
| java_aot           |    4688 |      213.02 ms |      438.45 ms |      509.42 ms |      713.40 ms |  174.08% |    264.58 MiB |
| python_grpc        |    4058 |      246.11 ms |      275.74 ms |      280.78 ms |      288.40 ms |  150.15% |      33.7 MiB |
| php_grpc           |    3922 |      254.66 ms |      289.79 ms |      290.94 ms |      293.23 ms |  205.12% |      65.4 MiB |
| ruby_grpc          |    2629 |      379.64 ms |      404.55 ms |      411.17 ms |      429.52 ms |   131.9% |     30.81 MiB |
--------------------------------------------------------------------------------------------------------------------------------

3 CPU Server

--------------------------------------------------------------------------------------------------------------------------------
| name               |   req/s |   avg. latency |        90 % in |        95 % in |        99 % in | avg. cpu |   avg. memory |
--------------------------------------------------------------------------------------------------------------------------------
| cpp_grpc_mt        |   86641 |       11.25 ms |       19.91 ms |       25.34 ms |       43.66 ms |  263.25% |     39.39 MiB |
| java_grpc_pgc      |   85985 |       11.29 ms |       46.48 ms |       61.04 ms |       89.31 ms |  258.97% |    206.06 MiB |
| java_grpc_g1gc     |   83142 |       11.71 ms |       52.42 ms |       67.52 ms |       95.02 ms |  273.39% |    192.72 MiB |
| java_grpc_zgc      |   82240 |       11.82 ms |       43.12 ms |       62.25 ms |       95.57 ms |  288.41% |    118.79 MiB |
| dotnet_grpc        |   80847 |       12.23 ms |       20.01 ms |       24.00 ms |       34.65 ms |   257.9% |    116.52 MiB |
| rust_grpcio        |   80541 |       12.05 ms |       20.26 ms |       26.22 ms |       47.39 ms |  269.13% |     38.68 MiB |
| java_grpc_she      |   80263 |       12.12 ms |       63.59 ms |       74.34 ms |       99.72 ms |  283.43% |    408.19 MiB |
| rust_tonic_mt      |   79969 |       12.27 ms |       23.57 ms |       31.53 ms |       49.77 ms |  278.14% |     15.89 MiB |
| go_grpc            |   78745 |       12.51 ms |       23.61 ms |       28.49 ms |       38.21 ms |  307.37% |     32.91 MiB |
| rust_thruster_mt   |   70841 |       13.92 ms |       26.71 ms |       36.15 ms |       56.03 ms |  290.39% |      14.2 MiB |
| java_grpc_sgc      |   68530 |       14.43 ms |       44.05 ms |       59.98 ms |       94.81 ms |  246.81% |    101.23 MiB |
| rust_tonic_st      |   49124 |       20.30 ms |       23.35 ms |       25.70 ms |       28.78 ms |  101.55% |     13.32 MiB |
| rust_thruster_st   |   41717 |       23.91 ms |       29.40 ms |       30.58 ms |       33.54 ms |  101.64% |     11.88 MiB |
| java_micronaut     |   34514 |       28.53 ms |       68.08 ms |       79.03 ms |      113.44 ms |  249.03% |     490.3 MiB |
| csharp_grpc        |   34196 |       29.10 ms |       53.09 ms |       58.59 ms |       68.70 ms |  306.74% |    110.67 MiB |
| kotlin_grpc        |   32645 |       30.46 ms |       94.29 ms |      103.71 ms |      185.80 ms |  306.52% |     292.9 MiB |
| swift_grpc         |   30365 |       32.86 ms |       35.59 ms |       36.46 ms |       37.97 ms |  302.29% |      6.79 MiB |
| cpp_grpc_st        |   30060 |       33.21 ms |       35.54 ms |       36.98 ms |       39.32 ms |  102.41% |      8.56 MiB |
| haskell_mu         |   23758 |       42.02 ms |       57.51 ms |       61.93 ms |       69.39 ms |  302.21% |    211.45 MiB |
| crystal_grpc       |   22478 |       44.39 ms |       52.29 ms |       53.92 ms |       57.82 ms |  115.67% |     24.62 MiB |
| node_grpc_st       |   12405 |       80.48 ms |       87.87 ms |       92.34 ms |       97.80 ms |  103.48% |     46.65 MiB |
| elixir_grpc        |   11982 |       83.37 ms |       99.09 ms |      105.03 ms |      118.39 ms |  304.81% |      97.9 MiB |
| dart_grpc          |   10220 |       97.75 ms |       17.92 ms |         1.07 s |         1.18 s |  106.64% |     26.57 MiB |
| java_aot           |    9107 |      109.66 ms |      260.98 ms |      323.00 ms |      414.14 ms |  242.03% |    259.79 MiB |
| scala_akka         |    8532 |      117.06 ms |      218.99 ms |      286.15 ms |      502.96 ms |  290.92% |    172.44 MiB |
| node_grpcjs_st     |    7155 |      139.58 ms |      151.06 ms |      154.63 ms |      163.08 ms |  116.26% |     41.98 MiB |
| php_grpc           |    6566 |      152.13 ms |      182.15 ms |      183.36 ms |      186.08 ms |   308.6% |      65.1 MiB |
| python_grpc        |    4096 |      243.84 ms |      272.72 ms |      276.89 ms |      284.52 ms |  150.26% |     34.13 MiB |
| ruby_grpc          |    2614 |      381.94 ms |      405.86 ms |      411.26 ms |      431.37 ms |  132.08% |     30.93 MiB |
--------------------------------------------------------------------------------------------------------------------------------