I've tested simple http performance tests, and this is the comparison.

https://soonpoong-hong.github.io/performance-test-of-various-frameworks/

• netty
• armeria
• akka-http
• vertx
• spring webflux
• springboot 2.3.9
• springboot 2.3.9 with spring security
• springboot 2.3.9 by kotlin
• graalvm with spring-native
• golang with gin

• Tested in AWS cloud ec2.
• server spec

  • client(tool) : t3.medium (2 cpu, 4G memory)
  • server : t3.medium (2 cpu, 4G memory)

• Performance testing tool : Gatling
• Testing load is 10,000 concurrent user.
• The testing tool request a URL of millisecond. (varying by millisecond)

  (ex) /1616726889044

• The target server extract the url and responds a text that is the three times to the url.

  (ex) 161672688904416167268890441616726889044

• Test duration : 1 minute

• It's just a very simple request. And doesn't match real situation.

  (no database, no redis, no message queue, no http-client ...)

• System resource usage was not monitored.
• netty is a network library, so it is not suitable for this. But as I was curious to see how much performance would come out, so I added netty.

• In mean time, the lower is the better.
• In counts/sec, the higher is the better.

First, keep in mind that this test is simply responding some text.

In other words, unless we make something like a gateway, this test may not make much sense.

Because, the eco system and ease of development and maintenance are much more important.

OK, My Conclusion is,

• Golang is the best in cost performance.
• Non-blocking certainly has better performance than blocking.
  • But, what about the hassle and complexity of non-blocking?
• There is no performance degradation due to using kotlin.
• There is about 50% performance degradation by using spring security.
• Graalvm has a very good startup time, but the throughput is similar.

In the executable-outputs directory, There are executable jars and runtime files.

You can execute the jar with java 11.

[examples]

java -jar armeria-fat.jar

./gin-main

./rocklike.test.graalvmtest.graalvmserver