Skip to content

Commit

Permalink
add benchmark script
Browse files Browse the repository at this point in the history
  • Loading branch information
@timodonnell
timodonnell committed Sep 8, 2016
1 parent b64a3f0 commit 021d719
Show file tree
Hide file tree
Showing 14 changed files with 3,102 additions and 4 deletions.
2 changes: 1 addition & 1 deletion kubernetes/README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ I called mine "tim-ml1":

```
gcloud container clusters create tim-ml1 \
--zone us-east1-b --num-nodes=1 \
--zone us-east1-b --num-nodes=2 \
--enable-autoscaling --min-nodes=1 --max-nodes=100 \
--machine-type=n1-standard-32
```
Expand Down
0 kubernetes/results_benchmark.raw → ...s/benchmark-results/results_benchmark.raw
View file
File renamed without changes.
15 changes: 15 additions & 0 deletions kubernetes/benchmark-results/results_benchmark10.raw
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,15 @@
RESULT_ROW, 224, 0, 1000, 0.0, 10.0, 0.0, 0.0, 53.92003083229065
RESULT_ROW, 224, 1, 1000, 0.0, 10.0, 0.0, 0.0, 53.93908405303955
RESULT_ROW, 224, 2, 1000, 0.0, 10.0, 0.0, 0.0, 53.878063917160034
RESULT_ROW, 256, 0, 1000, 0.0, 10.0, 0.0, 0.0, 48.545482873916626
RESULT_ROW, 256, 1, 1000, 0.0, 10.0, 0.0, 0.0, 50.177205085754395
RESULT_ROW, 256, 2, 1000, 0.0, 10.0, 0.0, 0.0, 48.74381184577942
RESULT_ROW, 288, 0, 1000, 0.0, 10.0, 0.0, 0.0, 47.75320386886597
RESULT_ROW, 288, 1, 1000, 0.0, 10.0, 0.0, 0.0, 48.4234459400177
RESULT_ROW, 288, 2, 1000, 0.0, 10.0, 0.0, 0.0, 47.895039796829224
RESULT_ROW, 320, 0, 1000, 0.0, 10.0, 0.0, 0.0, 47.990293979644775
RESULT_ROW, 320, 1, 1000, 0.0, 10.0, 0.0, 0.0, 47.207963943481445
RESULT_ROW, 320, 2, 1000, 0.0, 10.0, 0.0, 0.0, 47.350040912628174
RESULT_ROW, 352, 0, 1000, 0.0, 10.0, 0.0, 0.0, 49.93977904319763
RESULT_ROW, 352, 1, 1000, 0.0, 10.0, 0.0, 0.0, 53.96366286277771
RESULT_ROW, 352, 2, 1000, 0.0, 10.0, 0.0, 0.0, 72.05771589279175
33 changes: 33 additions & 0 deletions kubernetes/benchmark-results/results_benchmark11.raw
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
RESULT_ROW, 32, 0, 1000, 0.0, 10.0, 0.0, 0.0, 320.91107988357544
RESULT_ROW, 32, 1, 1000, 0.0, 10.0, 0.0, 0.0, 320.8384041786194
RESULT_ROW, 32, 2, 1000, 0.0, 10.0, 0.0, 0.0, 320.8641049861908
RESULT_ROW, 64, 0, 1000, 0.0, 10.0, 0.0, 0.0, 161.79911398887634
RESULT_ROW, 64, 1, 1000, 0.0, 10.0, 0.0, 0.0, 161.78207397460938
RESULT_ROW, 64, 2, 1000, 0.0, 10.0, 0.0, 0.0, 162.1464478969574
RESULT_ROW, 96, 0, 1000, 0.0, 10.0, 0.0, 0.0, 111.85675597190857
RESULT_ROW, 96, 1, 1000, 0.0, 10.0, 0.0, 0.0, 112.16340589523315
RESULT_ROW, 96, 2, 1000, 0.0, 10.0, 0.0, 0.0, 111.73591709136963
RESULT_ROW, 128, 0, 1000, 0.0, 10.0, 0.0, 0.0, 83.91730904579163
RESULT_ROW, 128, 1, 1000, 0.0, 10.0, 0.0, 0.0, 83.90164089202881
RESULT_ROW, 128, 2, 1000, 0.0, 10.0, 0.0, 0.0, 83.92996406555176
RESULT_ROW, 160, 0, 1000, 0.0, 10.0, 0.0, 0.0, 71.75929713249207
RESULT_ROW, 160, 1, 1000, 0.0, 10.0, 0.0, 0.0, 71.80702590942383
RESULT_ROW, 160, 2, 1000, 0.0, 10.0, 0.0, 0.0, 71.81047892570496
RESULT_ROW, 192, 0, 1000, 0.0, 10.0, 0.0, 0.0, 61.767974853515625
RESULT_ROW, 192, 1, 1000, 0.0, 10.0, 0.0, 0.0, 61.72499680519104
RESULT_ROW, 192, 2, 1000, 0.0, 10.0, 0.0, 0.0, 61.66155505180359
RESULT_ROW, 224, 0, 1000, 0.0, 10.0, 0.0, 0.0, 53.92003083229065
RESULT_ROW, 224, 1, 1000, 0.0, 10.0, 0.0, 0.0, 53.93908405303955
RESULT_ROW, 224, 2, 1000, 0.0, 10.0, 0.0, 0.0, 53.878063917160034
RESULT_ROW, 256, 0, 1000, 0.0, 10.0, 0.0, 0.0, 48.545482873916626
RESULT_ROW, 256, 1, 1000, 0.0, 10.0, 0.0, 0.0, 50.177205085754395
RESULT_ROW, 256, 2, 1000, 0.0, 10.0, 0.0, 0.0, 48.74381184577942
RESULT_ROW, 288, 0, 1000, 0.0, 10.0, 0.0, 0.0, 47.75320386886597
RESULT_ROW, 288, 1, 1000, 0.0, 10.0, 0.0, 0.0, 48.4234459400177
RESULT_ROW, 288, 2, 1000, 0.0, 10.0, 0.0, 0.0, 47.895039796829224
RESULT_ROW, 320, 0, 1000, 0.0, 10.0, 0.0, 0.0, 47.990293979644775
RESULT_ROW, 320, 1, 1000, 0.0, 10.0, 0.0, 0.0, 47.207963943481445
RESULT_ROW, 320, 2, 1000, 0.0, 10.0, 0.0, 0.0, 47.350040912628174
RESULT_ROW, 352, 0, 1000, 0.0, 10.0, 0.0, 0.0, 49.93977904319763
RESULT_ROW, 352, 1, 1000, 0.0, 10.0, 0.0, 0.0, 53.96366286277771
RESULT_ROW, 352, 2, 1000, 0.0, 10.0, 0.0, 0.0, 72.05771589279175
0 kubernetes/results_benchmark2.raw → .../benchmark-results/results_benchmark2.raw
View file
File renamed without changes.
0 kubernetes/results_benchmark3.raw → .../benchmark-results/results_benchmark3.raw
View file
File renamed without changes.
21 changes: 21 additions & 0 deletions kubernetes/benchmark-results/results_benchmark4.raw
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
RESULT_ROW, 100, 0, 1000, 0.0, 10.0, 0.0, 0.1, 105.65198588371277
RESULT_ROW, 100, 1, 1000, 0.0, 10.0, 0.0, 0.1, 105.60476899147034
RESULT_ROW, 100, 2, 1000, 0.0, 10.0, 0.0, 0.1, 106.59537100791931
RESULT_ROW, 200, 0, 1000, 0.0, 10.0, 0.0, 0.1, 66.53109121322632
RESULT_ROW, 200, 1, 1000, 0.0, 10.0, 0.0, 0.1, 65.69239711761475
RESULT_ROW, 200, 2, 1000, 0.0, 10.0, 0.0, 0.1, 66.18847012519836
RESULT_ROW, 300, 0, 1000, 0.0, 10.0, 0.0, 0.1, 76.61892509460449
RESULT_ROW, 300, 1, 1000, 0.0, 10.0, 0.0, 0.1, 76.85183906555176
RESULT_ROW, 300, 2, 1000, 0.0, 10.0, 0.0, 0.1, 113.06410598754883
RESULT_ROW, 400, 0, 1000, 0.0, 10.0, 0.0, 0.1, 136.72272300720215
RESULT_ROW, 400, 1, 1000, 0.0, 10.0, 0.0, 0.1, 104.70713090896606
RESULT_ROW, 400, 2, 1000, 0.0, 10.0, 0.0, 0.1, 104.70143699645996
RESULT_ROW, 500, 0, 1000, 0.0, 10.0, 0.0, 0.1, 107.49091100692749
RESULT_ROW, 500, 1, 1000, 0.0, 10.0, 0.0, 0.1, 106.73337602615356
RESULT_ROW, 500, 2, 1000, 0.0, 10.0, 0.0, 0.1, 114.98330521583557
RESULT_ROW, 600, 0, 1000, 0.0, 10.0, 0.0, 0.1, 166.69982290267944
RESULT_ROW, 600, 1, 1000, 0.0, 10.0, 0.0, 0.1, 201.3470959663391
RESULT_ROW, 600, 2, 1000, 0.0, 10.0, 0.0, 0.1, 214.60028290748596
RESULT_ROW, 700, 0, 1000, 0.0, 10.0, 0.0, 0.1, 339.46028089523315
RESULT_ROW, 700, 1, 1000, 0.0, 10.0, 0.0, 0.1, 327.47149896621704
RESULT_ROW, 700, 2, 1000, 0.0, 10.0, 0.0, 0.1, 462.31038308143616
21 changes: 21 additions & 0 deletions kubernetes/benchmark-results/results_benchmark5.raw
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
RESULT_ROW, 100, 0, 1000, 0.1, 10.0, 0.0, 0.1, 137.59303212165833
RESULT_ROW, 100, 1, 1000, 0.1, 10.0, 0.0, 0.1, 126.02190089225769
RESULT_ROW, 100, 2, 1000, 0.1, 10.0, 0.0, 0.1, 124.09759593009949
RESULT_ROW, 200, 0, 1000, 0.1, 10.0, 0.0, 0.1, 122.41988587379456
RESULT_ROW, 200, 1, 1000, 0.1, 10.0, 0.0, 0.1, 115.14284992218018
RESULT_ROW, 200, 2, 1000, 0.1, 10.0, 0.0, 0.1, 109.59381103515625
RESULT_ROW, 300, 0, 1000, 0.1, 10.0, 0.0, 0.1, 124.75409197807312
RESULT_ROW, 300, 1, 1000, 0.1, 10.0, 0.0, 0.1, 119.62863779067993
RESULT_ROW, 300, 2, 1000, 0.1, 10.0, 0.0, 0.1, 119.72993588447571
RESULT_ROW, 400, 0, 1000, 0.1, 10.0, 0.0, 0.1, 141.47108697891235
RESULT_ROW, 400, 1, 1000, 0.1, 10.0, 0.0, 0.1, 155.54113388061523
RESULT_ROW, 400, 2, 1000, 0.1, 10.0, 0.0, 0.1, 166.62374806404114
RESULT_ROW, 500, 0, 1000, 0.1, 10.0, 0.0, 0.1, 212.83816981315613
RESULT_ROW, 500, 1, 1000, 0.1, 10.0, 0.0, 0.1, 186.0480179786682
RESULT_ROW, 500, 2, 1000, 0.1, 10.0, 0.0, 0.1, 176.18352890014648
RESULT_ROW, 600, 0, 1000, 0.1, 10.0, 0.0, 0.1, 304.9387938976288
RESULT_ROW, 600, 1, 1000, 0.1, 10.0, 0.0, 0.1, 294.1322660446167
RESULT_ROW, 600, 2, 1000, 0.1, 10.0, 0.0, 0.1, 249.73363614082336
RESULT_ROW, 700, 0, 1000, 0.1, 10.0, 0.0, 0.1, 468.2880439758301
RESULT_ROW, 700, 1, 1000, 0.1, 10.0, 0.0, 0.1, 484.45794200897217
RESULT_ROW, 700, 2, 1000, 0.1, 10.0, 0.0, 0.1, 1011.4865069389343
33 changes: 33 additions & 0 deletions kubernetes/benchmark-results/results_benchmark6.raw
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
RESULT_ROW, 32, 0, 1000, 0.1, 10.0, 0.0, 0.1, 327.09326815605164
RESULT_ROW, 32, 1, 1000, 0.1, 10.0, 0.0, 0.1, 325.55563497543335
RESULT_ROW, 32, 2, 1000, 0.1, 10.0, 0.0, 0.1, 325.6496047973633
RESULT_ROW, 64, 0, 1000, 0.1, 10.0, 0.0, 0.1, 173.65734815597534
RESULT_ROW, 64, 1, 1000, 0.1, 10.0, 0.0, 0.1, 173.8906660079956
RESULT_ROW, 64, 2, 1000, 0.1, 10.0, 0.0, 0.1, 173.8694188594818
RESULT_ROW, 96, 0, 1000, 0.1, 10.0, 0.0, 0.1, 133.41964197158813
RESULT_ROW, 96, 1, 1000, 0.1, 10.0, 0.0, 0.1, 125.51445603370667
RESULT_ROW, 96, 2, 1000, 0.1, 10.0, 0.0, 0.1, 124.30567216873169
RESULT_ROW, 128, 0, 1000, 0.1, 10.0, 0.0, 0.1, 109.89015197753906
RESULT_ROW, 128, 1, 1000, 0.1, 10.0, 0.0, 0.1, 117.26590609550476
RESULT_ROW, 128, 2, 1000, 0.1, 10.0, 0.0, 0.1, 124.34307599067688
RESULT_ROW, 160, 0, 1000, 0.1, 10.0, 0.0, 0.1, 113.9062569141388
RESULT_ROW, 160, 1, 1000, 0.1, 10.0, 0.0, 0.1, 95.84425282478333
RESULT_ROW, 160, 2, 1000, 0.1, 10.0, 0.0, 0.1, 95.88284707069397
RESULT_ROW, 192, 0, 1000, 0.1, 10.0, 0.0, 0.1, 103.34966015815735
RESULT_ROW, 192, 1, 1000, 0.1, 10.0, 0.0, 0.1, 117.76010918617249
RESULT_ROW, 192, 2, 1000, 0.1, 10.0, 0.0, 0.1, 125.86918497085571
RESULT_ROW, 224, 0, 1000, 0.1, 10.0, 0.0, 0.1, 153.10672903060913
RESULT_ROW, 224, 1, 1000, 0.1, 10.0, 0.0, 0.1, 160.39879894256592
RESULT_ROW, 224, 2, 1000, 0.1, 10.0, 0.0, 0.1, 150.85584688186646
RESULT_ROW, 256, 0, 1000, 0.1, 10.0, 0.0, 0.1, 121.74514508247375
RESULT_ROW, 256, 1, 1000, 0.1, 10.0, 0.0, 0.1, 113.40481686592102
RESULT_ROW, 256, 2, 1000, 0.1, 10.0, 0.0, 0.1, 107.93885803222656
RESULT_ROW, 288, 0, 1000, 0.1, 10.0, 0.0, 0.1, 139.23394298553467
RESULT_ROW, 288, 1, 1000, 0.1, 10.0, 0.0, 0.1, 143.1108009815216
RESULT_ROW, 288, 2, 1000, 0.1, 10.0, 0.0, 0.1, 129.0538010597229
RESULT_ROW, 320, 0, 1000, 0.1, 10.0, 0.0, 0.1, 139.27452087402344
RESULT_ROW, 320, 1, 1000, 0.1, 10.0, 0.0, 0.1, 127.22174787521362
RESULT_ROW, 320, 2, 1000, 0.1, 10.0, 0.0, 0.1, 152.22650599479675
RESULT_ROW, 352, 0, 1000, 0.1, 10.0, 0.0, 0.1, 179.51897406578064
RESULT_ROW, 352, 1, 1000, 0.1, 10.0, 0.0, 0.1, 157.2225320339203
RESULT_ROW, 352, 2, 1000, 0.1, 10.0, 0.0, 0.1, 130.6831991672516
9 changes: 9 additions & 0 deletions kubernetes/benchmark-results/results_benchmark7.raw
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
RESULT_ROW, 32, 0, 1000, 0.0, 10.0, 0.0, 0.0, 320.91107988357544
RESULT_ROW, 32, 1, 1000, 0.0, 10.0, 0.0, 0.0, 320.8384041786194
RESULT_ROW, 32, 2, 1000, 0.0, 10.0, 0.0, 0.0, 320.8641049861908
RESULT_ROW, 64, 0, 1000, 0.0, 10.0, 0.0, 0.0, 161.79911398887634
RESULT_ROW, 64, 1, 1000, 0.0, 10.0, 0.0, 0.0, 161.78207397460938
RESULT_ROW, 64, 2, 1000, 0.0, 10.0, 0.0, 0.0, 162.1464478969574
RESULT_ROW, 96, 0, 1000, 0.0, 10.0, 0.0, 0.0, 111.85675597190857
RESULT_ROW, 96, 1, 1000, 0.0, 10.0, 0.0, 0.0, 112.16340589523315
RESULT_ROW, 96, 2, 1000, 0.0, 10.0, 0.0, 0.0, 111.73591709136963
9 changes: 9 additions & 0 deletions kubernetes/benchmark-results/results_benchmark8.raw
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
RESULT_ROW, 128, 0, 1000, 0.0, 10.0, 0.0, 0.0, 83.91730904579163
RESULT_ROW, 128, 1, 1000, 0.0, 10.0, 0.0, 0.0, 83.90164089202881
RESULT_ROW, 128, 2, 1000, 0.0, 10.0, 0.0, 0.0, 83.92996406555176
RESULT_ROW, 160, 0, 1000, 0.0, 10.0, 0.0, 0.0, 71.75929713249207
RESULT_ROW, 160, 1, 1000, 0.0, 10.0, 0.0, 0.0, 71.80702590942383
RESULT_ROW, 160, 2, 1000, 0.0, 10.0, 0.0, 0.0, 71.81047892570496
RESULT_ROW, 192, 0, 1000, 0.0, 10.0, 0.0, 0.0, 61.767974853515625
RESULT_ROW, 192, 1, 1000, 0.0, 10.0, 0.0, 0.0, 61.72499680519104
RESULT_ROW, 192, 2, 1000, 0.0, 10.0, 0.0, 0.0, 61.66155505180359
18 changes: 18 additions & 0 deletions kubernetes/benchmark-results/results_benchmark9.raw
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,18 @@
RESULT_ROW, 32, 0, 1000, 0.0, 10.0, 0.0, 0.0, 320.91107988357544
RESULT_ROW, 32, 1, 1000, 0.0, 10.0, 0.0, 0.0, 320.8384041786194
RESULT_ROW, 32, 2, 1000, 0.0, 10.0, 0.0, 0.0, 320.8641049861908
RESULT_ROW, 64, 0, 1000, 0.0, 10.0, 0.0, 0.0, 161.79911398887634
RESULT_ROW, 64, 1, 1000, 0.0, 10.0, 0.0, 0.0, 161.78207397460938
RESULT_ROW, 64, 2, 1000, 0.0, 10.0, 0.0, 0.0, 162.1464478969574
RESULT_ROW, 96, 0, 1000, 0.0, 10.0, 0.0, 0.0, 111.85675597190857
RESULT_ROW, 96, 1, 1000, 0.0, 10.0, 0.0, 0.0, 112.16340589523315
RESULT_ROW, 96, 2, 1000, 0.0, 10.0, 0.0, 0.0, 111.73591709136963
RESULT_ROW, 128, 0, 1000, 0.0, 10.0, 0.0, 0.0, 83.91730904579163
RESULT_ROW, 128, 1, 1000, 0.0, 10.0, 0.0, 0.0, 83.90164089202881
RESULT_ROW, 128, 2, 1000, 0.0, 10.0, 0.0, 0.0, 83.92996406555176
RESULT_ROW, 160, 0, 1000, 0.0, 10.0, 0.0, 0.0, 71.75929713249207
RESULT_ROW, 160, 1, 1000, 0.0, 10.0, 0.0, 0.0, 71.80702590942383
RESULT_ROW, 160, 2, 1000, 0.0, 10.0, 0.0, 0.0, 71.81047892570496
RESULT_ROW, 192, 0, 1000, 0.0, 10.0, 0.0, 0.0, 61.767974853515625
RESULT_ROW, 192, 1, 1000, 0.0, 10.0, 0.0, 0.0, 61.72499680519104
RESULT_ROW, 192, 2, 1000, 0.0, 10.0, 0.0, 0.0, 61.66155505180359
6 changes: 3 additions & 3 deletions kubernetes/spec.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@ spec:
app: daskd
role: scheduler
type: LoadBalancer
---
---
apiVersion: extensions/v1beta1
kind: Deployment
metadata:
Expand All @@ -40,7 +40,7 @@ spec:
command: ["venv-py3/bin/dask-scheduler"]
resources:
requests:
cpu: 1
cpu: 10
# memory: 5000Mi
ports:
- containerPort: 8786
Expand Down Expand Up @@ -68,6 +68,6 @@ spec:
]
resources:
requests:
cpu: 1
cpu: 10
# memory: 2000Mi

Loading

0 comments on commit 021d719

Please sign in to comment.