Skip to content

Instantly share code, notes, and snippets.

@omnibs
Last active June 10, 2024 17:47
Show Gist options
  • Select an option

  • Save omnibs/e5e72b31e6bd25caf39a to your computer and use it in GitHub Desktop.

Select an option

Save omnibs/e5e72b31e6bd25caf39a to your computer and use it in GitHub Desktop.
Phoenix Showdown Comparative Benchmarks @ Rackspace
PHOENIX
```
root@onmetal-client:~# wrk -t20 -c100 -d30S --timeout 2000 "http://10.184.11.239:4000/showdown"
Running 30s test @ http://10.184.11.239:4000/showdown
20 threads and 100 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 595.50us 398.08us 62.05ms 99.05%
Req/Sec 8.50k 304.25 9.20k 70.34%
5087667 requests in 30.10s, 10.42GB read
Requests/sec: 169030.24
Transfer/sec: 354.47MB
```
PLUG
```
root@onmetal-client:~# wrk -t20 -c100 -d30S --timeout 2000 "http://10.184.11.239:4000/showdown"
Running 30s test @ http://10.184.11.239:4000/showdown
20 threads and 100 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 631.83us 2.22ms 217.98ms 99.05%
Req/Sec 9.99k 761.02 18.66k 78.99%
5969613 requests in 30.10s, 12.00GB read
Requests/sec: 198328.21
Transfer/sec: 408.34MB
```
PLAY
```
root@onmetal-client:~# wrk -t20 -c100 -d30S --timeout 2000 "http://10.184.11.239:5000/showdown"
Running 30s test @ http://10.184.11.239:5000/showdown
20 threads and 100 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 1.89ms 14.17ms 349.18ms 98.57%
Req/Sec 8.80k 1.58k 23.45k 86.04%
5154091 requests in 30.10s, 9.82GB read
Requests/sec: 171236.03
Transfer/sec: 334.12MB
```
RAILS
```
root@onmetal-client:~# wrk -t20 -c100 -d30S --timeout 2000 "http://10.184.11.239:3000/showdown"
Running 30s test @ http://10.184.11.239:3000/showdown
20 threads and 100 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 8.50ms 4.07ms 61.71ms 70.94%
Req/Sec 598.10 40.81 740.00 71.03%
357320 requests in 30.02s, 788.91MB read
Requests/sec: 11903.48
Transfer/sec: 26.28MB
```
SINATRA
```
root@onmetal-client:~# wrk -t20 -c100 -d30S --timeout 2000 "http://10.184.11.239:9292/showdown"
Running 30s test @ http://10.184.11.239:9292/showdown
20 threads and 100 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 3.50ms 2.53ms 56.23ms 74.62%
Req/Sec 1.54k 414.73 5.33k 65.96%
919897 requests in 30.10s, 1.85GB read
Requests/sec: 30561.95
Transfer/sec: 63.04MB
```
GIN
```
root@onmetal-client:~# wrk -t20 -c100 -d30S --timeout 2000 "http://10.184.11.239:3000/showdown"
Running 30s test @ http://10.184.11.239:3000/showdown
20 threads and 100 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 655.59us 573.14us 10.11ms 89.21%
Req/Sec 8.86k 759.03 15.02k 82.84%
5302230 requests in 30.10s, 10.31GB read
Requests/sec: 176156.41
Transfer/sec: 350.61MB
```
MARTINI
```
root@onmetal-client:~# wrk -t20 -c100 -d30S --timeout 2000 "http://10.184.11.239:3000/showdown"
Running 30s test @ http://10.184.11.239:3000/showdown
20 threads and 100 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 3.35ms 2.52ms 32.73ms 60.45%
Req/Sec 1.61k 99.91 1.98k 68.77%
962648 requests in 30.01s, 1.87GB read
Requests/sec: 32077.24
Transfer/sec: 63.84MB
```
@zepplock
Copy link

zepplock commented Jul 9, 2015

Would be great to see updated .NET results ;)

@omnibs
Copy link
Author

omnibs commented Jul 20, 2015

I've been busy lately, but I plan on running Windows + Linux benches on Amazon. Amazon has that whole deal with network drivers for 10gbit to work so I've been putting it off heh

I did run linux benchmarks on the same machine that got me 19k on ASP.Net and results were not amazing at all. Top performers did around 80k req/s. I guess virtualization really sucks (yay for OnMetal).

@bbhoss
Copy link

bbhoss commented Sep 15, 2015

I think benchmarking things on AWS is pretty pointless. You never know what hardware you're going to get or how utilized it is. No test run has a chance at ever being even similar to others, unless you're running on dedicated hardware.

@TheCrott
Copy link

Please update Phoenix to the latest stable, since this benchmark is using beta version of Phoenix

@slashmili
Copy link

What does exactly the Consistency column mean?

@peteygao
Copy link

peteygao commented Apr 3, 2016

Consistency refers to Standard Deviation (as per the Greek letter Sigma: σ). Roughly speaking, 68% of all requests fall within the stated "deviation" in terms of milliseconds. More about Standard Deviation on Wikipedia.

@naterh
Copy link

naterh commented Jul 3, 2016

I would be curious to see the same tests ran on Rackspace's new-ish OnMetal v2 servers that come with better virt networking.

@omnibs
Copy link
Author

omnibs commented Jul 13, 2016

Didn't know they had better network on v2, interesting. @naterh do you have a source on that? All I found was about some VPN-ish hybrid cloud stuff.

Honestly I just saw the specs had lower clocks and didn't bother playing with them haha

@wbednarski
Copy link

Can you use a monospace font in the table for numbers? Thanks!

@kioqq
Copy link

kioqq commented Sep 26, 2016

try iris for golang https://github.com/kataras/iris :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment