Skip to content

Commit

Permalink
More data
Browse files Browse the repository at this point in the history
  • Loading branch information
matthiasgoergens committed Jan 14, 2025
1 parent ee60662 commit 1e3b895
Show file tree
Hide file tree
Showing 16 changed files with 413 additions and 2 deletions.
3 changes: 3 additions & 0 deletions plotting/ceno.data
Original file line number Diff line number Diff line change
Expand Up @@ -376,6 +376,7 @@
11935 ceno 24.93
14254 ceno 26.59
15097 ceno 26.79
15298 ceno 26.94
18092 ceno 28.62
18125 ceno 28.39
18506 ceno 28.77
Expand All @@ -390,5 +391,7 @@
27592 ceno 37.69
29328 ceno 39.19
29750 ceno 42.74
30869 ceno 42.43
31065 ceno 43.25
32352 ceno
32746 ceno 43.15
17 changes: 16 additions & 1 deletion plotting/plot.gnuplot
Original file line number Diff line number Diff line change
Expand Up @@ -11,11 +11,26 @@ set grid
set xlabel "input length"
set ylabel "time to prove sorting (s)"

# =========== DEFINE FUNCTIONS FOR FIT ===========
# We'll fit each data set separately to its own line.
f_sp1(x) = a_sp1*x + b_sp1
f_ceno(x) = a_ceno*x + b_ceno

# =========== DO THE FITS ===========

# Fit sp1 data
fit f_sp1(x) "sp1.data" using 1:3 via a_sp1, b_sp1

# Fit ceno data
fit f_ceno(x) "ceno.data" using 1:3 via a_ceno, b_ceno

# 3) Plot: sp1 and ceno from the same data file
plot "sp1.data" using 1:3 \
with points title "SP1 with AVX512", \
f_sp1(x) title sprintf("sp1 fit: y=%.3fx+%.3f", a_sp1, b_sp1) lw 2, \
"ceno.data" using 1:3 \
with points title "Ceno"
with points title "Ceno", \
f_ceno(x) title sprintf("ceno fit: y=%.3fx+%.3f", a_ceno, b_ceno) lw 2

# 4) Close the output
set output
4 changes: 3 additions & 1 deletion plotting/sp1.data
Original file line number Diff line number Diff line change
Expand Up @@ -376,6 +376,7 @@
11935 sp1 37.57
14254 sp1 39.26
15097 sp1 41.22
15298 sp1 40.72
18092 sp1 44.43
18125 sp1 44.04
18506 sp1 44.53
Expand All @@ -390,6 +391,7 @@
27592 sp1 55.8
29328 sp1 56.88
29750 sp1 58.3
30869 sp1
30869 sp1 60.78
31065 sp1 58.53
32352 sp1 60.22
32746 sp1 60.56
Binary file modified plotting/sp1_ceno_scatter.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file not shown.
Original file line number Diff line number Diff line change
@@ -0,0 +1,23 @@
Command being timed: "cargo run --package=ceno_zkvm --bin=e2e --profile=release -- --hints=/home/matthias/scroll/prog/zkVM-benchmarks/sorting-output/15298-2025-01-14T15:05:58,962039461+00:00/ceno/hints /home/matthias/scroll/prog/zkVM-benchmarks/ceno/examples/target/riscv32im-ceno-zkvm-elf/release/examples/sorting"
User time (seconds): 862.07
System time (seconds): 55.56
Percent of CPU this job got: 3405%
Elapsed (wall clock) time (h:mm:ss or m:ss): 0:26.94
Average shared text size (kbytes): 0
Average unshared data size (kbytes): 0
Average stack size (kbytes): 0
Average total size (kbytes): 0
Maximum resident set size (kbytes): 8784088
Average resident set size (kbytes): 0
Major (requiring I/O) page faults: 0
Minor (reclaiming a frame) page faults: 5055786
Voluntary context switches: 1017066
Involuntary context switches: 181872
Swaps: 0
File system inputs: 0
File system outputs: 32
Socket messages sent: 0
Socket messages received: 0
Signals delivered: 0
Page size (bytes): 4096
Exit status: 0
96 changes: 96 additions & 0 deletions sorting-output/15298-2025-01-14T15:06:26,545251494+00:00/sp1/log
Original file line number Diff line number Diff line change
@@ -0,0 +1,96 @@
2025-01-14T15:06:27.937698Z  WARN SP1_PROVER environment variable not set, defaulting to 'cpu'
2025-01-14T15:06:28.396507Z  INFO vk verification: true
n: 15298
2025-01-14T15:06:30.738456Z  INFO prove_core: clk = 0 pc = 0x200d04
stdout: WARNING: Using insecure random number generator.
2025-01-14T15:06:30.899442Z  INFO prove_core: clk = 0 pc = 0x200d04
stdout: WARNING: Using insecure random number generator.
2025-01-14T15:06:31.668304Z  INFO prove_core: deferred 1 records
2025-01-14T15:06:31.925643Z  INFO prove_core: Shard Lifted: Index=1, Cluster=210
2025-01-14T15:06:31.925666Z  INFO prove_core: Chip Cpu: 21 -> 21
2025-01-14T15:06:31.925669Z  INFO prove_core: Chip DivRem: 2 -> 10
2025-01-14T15:06:31.925671Z  INFO prove_core: Chip AddSub: 21 -> 21
2025-01-14T15:06:31.925672Z  INFO prove_core: Chip Bitwise: 19 -> 19
2025-01-14T15:06:31.925675Z  INFO prove_core: Chip Mul: 10 -> 17
2025-01-14T15:06:31.925677Z  INFO prove_core: Chip ShiftRight: 18 -> 18
2025-01-14T15:06:31.925678Z  INFO prove_core: Chip ShiftLeft: 18 -> 18
2025-01-14T15:06:31.925679Z  INFO prove_core: Chip Lt: 17 -> 18
2025-01-14T15:06:31.925680Z  INFO prove_core: Chip MemoryLocal: 13 -> 18
2025-01-14T15:06:31.925682Z  INFO prove_core: Chip MemoryInstrs: 20 -> 20
2025-01-14T15:06:31.925683Z  INFO prove_core: Chip Auipc: 9 -> 18
2025-01-14T15:06:31.925684Z  INFO prove_core: Chip Branch: 16 -> 18
2025-01-14T15:06:31.925685Z  INFO prove_core: Chip Jump: 13 -> 18
2025-01-14T15:06:31.925686Z  INFO prove_core: Chip Global: 16 -> 17
2025-01-14T15:06:31.925688Z  INFO prove_core: Chip SyscallCore: 2 -> 10
2025-01-14T15:06:31.925689Z  INFO prove_core: Chip SyscallInstrs: 2 -> 10
2025-01-14T15:06:31.925927Z  INFO prove_core: Shard Lifted: Index=2, Cluster=179
2025-01-14T15:06:31.925931Z  INFO prove_core: Chip Cpu: 21 -> 21
2025-01-14T15:06:31.925932Z  INFO prove_core: Chip AddSub: 21 -> 21
2025-01-14T15:06:31.925934Z  INFO prove_core: Chip Bitwise: 14 -> 17
2025-01-14T15:06:31.925935Z  INFO prove_core: Chip Mul: 10 -> 17
2025-01-14T15:06:31.925936Z  INFO prove_core: Chip ShiftRight: 12 -> 17
2025-01-14T15:06:31.925938Z  INFO prove_core: Chip ShiftLeft: 18 -> 18
2025-01-14T15:06:31.925939Z  INFO prove_core: Chip Lt: 20 -> 20
2025-01-14T15:06:31.925940Z  INFO prove_core: Chip MemoryLocal: 13 -> 18
2025-01-14T15:06:31.925941Z  INFO prove_core: Chip MemoryInstrs: 20 -> 20
2025-01-14T15:06:31.925942Z  INFO prove_core: Chip Auipc: 12 -> 18
2025-01-14T15:06:31.925943Z  INFO prove_core: Chip Branch: 19 -> 19
2025-01-14T15:06:31.925945Z  INFO prove_core: Chip Jump: 15 -> 18
2025-01-14T15:06:31.925946Z  INFO prove_core: Chip Global: 16 -> 17
2025-01-14T15:06:31.926869Z  INFO prove_core: Shard Lifted: Index=3, Cluster=207
2025-01-14T15:06:31.926878Z  INFO prove_core: Chip Cpu: 20 -> 20
2025-01-14T15:06:31.926880Z  INFO prove_core: Chip AddSub: 20 -> 20
2025-01-14T15:06:31.926881Z  INFO prove_core: Chip Bitwise: 14 -> 16
2025-01-14T15:06:31.926882Z  INFO prove_core: Chip Mul: 9 -> 16
2025-01-14T15:06:31.926884Z  INFO prove_core: Chip ShiftRight: 11 -> 16
2025-01-14T15:06:31.926885Z  INFO prove_core: Chip ShiftLeft: 16 -> 16
2025-01-14T15:06:31.926886Z  INFO prove_core: Chip Lt: 19 -> 19
2025-01-14T15:06:31.926887Z  INFO prove_core: Chip MemoryLocal: 12 -> 17
2025-01-14T15:06:31.926888Z  INFO prove_core: Chip MemoryInstrs: 18 -> 18
2025-01-14T15:06:31.926890Z  INFO prove_core: Chip Auipc: 11 -> 17
2025-01-14T15:06:31.926891Z  INFO prove_core: Chip Branch: 17 -> 17
2025-01-14T15:06:31.926892Z  INFO prove_core: Chip Jump: 14 -> 17
2025-01-14T15:06:31.926893Z  INFO prove_core: Chip Global: 15 -> 16
2025-01-14T15:06:31.926894Z  INFO prove_core: Chip SyscallCore: 5 -> 10
2025-01-14T15:06:31.926895Z  INFO prove_core: Chip SyscallInstrs: 5 -> 10
2025-01-14T15:06:32.134226Z  INFO prove_core:generate main traces: close time.busy=207ms time.idle=1.85µs index=0
2025-01-14T15:07:06.751114Z  INFO prove_core: execution report (totals): total_cycles=4935295, total_syscall_cycles=20, touched_memory_addresses=51323
2025-01-14T15:07:06.751141Z  INFO prove_core: execution report (opcode counts):
2025-01-14T15:07:06.751150Z  INFO prove_core: 1546200 add
2025-01-14T15:07:06.751153Z  INFO prove_core: 853569 lw
2025-01-14T15:07:06.751155Z  INFO prove_core: 799772 sw
2025-01-14T15:07:06.751157Z  INFO prove_core: 411866 sll
2025-01-14T15:07:06.751159Z  INFO prove_core: 256866 bltu
2025-01-14T15:07:06.751161Z  INFO prove_core: 200663 xor
2025-01-14T15:07:06.751162Z  INFO prove_core: 194017 sltu
2025-01-14T15:07:06.751164Z  INFO prove_core: 190771 srl
2025-01-14T15:07:06.751165Z  INFO prove_core: 187388 or
2025-01-14T15:07:06.751166Z  INFO prove_core: 94387 bne
2025-01-14T15:07:06.751168Z  INFO prove_core: 61027 beq
2025-01-14T15:07:06.751169Z  INFO prove_core: 60788 bgeu
2025-01-14T15:07:06.751170Z  INFO prove_core: 35351 jal
2025-01-14T15:07:06.751172Z  INFO prove_core: 16076 sub
2025-01-14T15:07:06.751173Z  INFO prove_core: 9916 jalr
2025-01-14T15:07:06.751174Z  INFO prove_core: 8369 and
2025-01-14T15:07:06.751175Z  INFO prove_core: 4961 auipc
2025-01-14T15:07:06.751177Z  INFO prove_core: 1985 mul
2025-01-14T15:07:06.751178Z  INFO prove_core: 474 sb
2025-01-14T15:07:06.751185Z  INFO prove_core: 329 lbu
2025-01-14T15:07:06.751187Z  INFO prove_core: 250 mulhu
2025-01-14T15:07:06.751190Z  INFO prove_core: 242 blt
2025-01-14T15:07:06.751191Z  INFO prove_core: 20 ecall
2025-01-14T15:07:06.751193Z  INFO prove_core: 4 lb
2025-01-14T15:07:06.751194Z  INFO prove_core: 3 divu
2025-01-14T15:07:06.751195Z  INFO prove_core: 1 bge
2025-01-14T15:07:06.751197Z  INFO prove_core: execution report (syscall counts):
2025-01-14T15:07:06.751203Z  INFO prove_core: 8 commit
2025-01-14T15:07:06.751205Z  INFO prove_core: 8 commit_deferred_proofs
2025-01-14T15:07:06.751207Z  INFO prove_core: 1 halt
2025-01-14T15:07:06.751208Z  INFO prove_core: 1 write
2025-01-14T15:07:06.751210Z  INFO prove_core: 1 hint_len
2025-01-14T15:07:06.751211Z  INFO prove_core: 1 hint_read
2025-01-14T15:07:06.751219Z  INFO prove_core: summary: cycles=4935295, e2e=36.013407518s, khz=137.04
2025-01-14T15:07:06.756564Z  INFO prove_core: close time.busy=34.8s time.idle=1.24s
Successfully generated proof!
2025-01-14T15:07:07.472175Z  INFO verify: close time.busy=699ms time.idle=1.99µs
Successfully verified proof!
Original file line number Diff line number Diff line change
@@ -0,0 +1,23 @@
Command being timed: "cargo run --release -- --n=15298 --prove"
User time (seconds): 1680.46
System time (seconds): 67.58
Percent of CPU this job got: 4292%
Elapsed (wall clock) time (h:mm:ss or m:ss): 0:40.72
Average shared text size (kbytes): 0
Average unshared data size (kbytes): 0
Average stack size (kbytes): 0
Average total size (kbytes): 0
Maximum resident set size (kbytes): 24201792
Average resident set size (kbytes): 0
Major (requiring I/O) page faults: 0
Minor (reclaiming a frame) page faults: 15612857
Voluntary context switches: 870297
Involuntary context switches: 105327
Swaps: 0
File system inputs: 0
File system outputs: 944
Socket messages sent: 0
Socket messages received: 0
Signals delivered: 0
Page size (bytes): 4096
Exit status: 0
40 changes: 40 additions & 0 deletions sorting-output/30869-2025-01-14T15:04:14,089365301+00:00/sp1/log
Original file line number Diff line number Diff line change
Expand Up @@ -84,3 +84,43 @@ stdout: WARNING: Using insecure random number generator.
2025-01-14T15:04:20.703379Z  INFO prove_core: Chip SyscallCore: 5 -> 10
2025-01-14T15:04:20.703380Z  INFO prove_core: Chip SyscallInstrs: 5 -> 10
2025-01-14T15:04:21.086998Z  INFO prove_core:generate main traces: close time.busy=383ms time.idle=2.24µs index=0
2025-01-14T15:05:13.430852Z  INFO prove_core: execution report (totals): total_cycles=10370685, total_syscall_cycles=20, touched_memory_addresses=82465
2025-01-14T15:05:13.430879Z  INFO prove_core: execution report (opcode counts):
2025-01-14T15:05:13.430887Z  INFO prove_core: 3300092 add
2025-01-14T15:05:13.430891Z  INFO prove_core: 1782153 lw
2025-01-14T15:05:13.430893Z  INFO prove_core: 1675130 sw
2025-01-14T15:05:13.430895Z  INFO prove_core: 859820 sll
2025-01-14T15:05:13.430897Z  INFO prove_core: 554422 bltu
2025-01-14T15:05:13.430898Z  INFO prove_core: 423238 sltu
2025-01-14T15:05:13.430900Z  INFO prove_core: 402020 xor
2025-01-14T15:05:13.430903Z  INFO prove_core: 381028 srl
2025-01-14T15:05:13.430904Z  INFO prove_core: 375081 or
2025-01-14T15:05:13.430905Z  INFO prove_core: 204987 bne
2025-01-14T15:05:13.430907Z  INFO prove_core: 130007 bgeu
2025-01-14T15:05:13.430908Z  INFO prove_core: 124194 beq
2025-01-14T15:05:13.430909Z  INFO prove_core: 74998 jal
2025-01-14T15:05:13.430911Z  INFO prove_core: 31960 sub
2025-01-14T15:05:13.430912Z  INFO prove_core: 20103 jalr
2025-01-14T15:05:13.430913Z  INFO prove_core: 15970 and
2025-01-14T15:05:13.430914Z  INFO prove_core: 10055 auipc
2025-01-14T15:05:13.430916Z  INFO prove_core: 3609 mul
2025-01-14T15:05:13.430917Z  INFO prove_core: 552 sb
2025-01-14T15:05:13.430918Z  INFO prove_core: 484 blt
2025-01-14T15:05:13.430920Z  INFO prove_core: 418 lbu
2025-01-14T15:05:13.430921Z  INFO prove_core: 336 mulhu
2025-01-14T15:05:13.430922Z  INFO prove_core: 20 ecall
2025-01-14T15:05:13.430924Z  INFO prove_core: 4 lb
2025-01-14T15:05:13.430925Z  INFO prove_core: 3 divu
2025-01-14T15:05:13.430926Z  INFO prove_core: 1 bge
2025-01-14T15:05:13.430929Z  INFO prove_core: execution report (syscall counts):
2025-01-14T15:05:13.430935Z  INFO prove_core: 8 commit
2025-01-14T15:05:13.430937Z  INFO prove_core: 8 commit_deferred_proofs
2025-01-14T15:05:13.430938Z  INFO prove_core: 1 halt
2025-01-14T15:05:13.430939Z  INFO prove_core: 1 write
2025-01-14T15:05:13.430941Z  INFO prove_core: 1 hint_len
2025-01-14T15:05:13.430942Z  INFO prove_core: 1 hint_read
2025-01-14T15:05:13.430949Z  INFO prove_core: summary: cycles=10370685, e2e=55.181661174s, khz=187.94
2025-01-14T15:05:13.434952Z  INFO prove_core: close time.busy=52.7s time.idle=2.51s
Successfully generated proof!
2025-01-14T15:05:14.501883Z  INFO verify: close time.busy=1.05s time.idle=2.94µs
Successfully verified proof!
Original file line number Diff line number Diff line change
@@ -0,0 +1,23 @@
Command being timed: "cargo run --release -- --n=30869 --prove"
User time (seconds): 3320.49
System time (seconds): 116.76
Percent of CPU this job got: 5654%
Elapsed (wall clock) time (h:mm:ss or m:ss): 1:00.78
Average shared text size (kbytes): 0
Average unshared data size (kbytes): 0
Average stack size (kbytes): 0
Average total size (kbytes): 0
Maximum resident set size (kbytes): 60378208
Average resident set size (kbytes): 0
Major (requiring I/O) page faults: 1
Minor (reclaiming a frame) page faults: 29547768
Voluntary context switches: 1262140
Involuntary context switches: 323833
Swaps: 0
File system inputs: 0
File system outputs: 1008
Socket messages sent: 0
Socket messages received: 0
Signals delivered: 0
Page size (bytes): 4096
Exit status: 0
Binary file not shown.
Original file line number Diff line number Diff line change
@@ -0,0 +1,23 @@
Command being timed: "cargo run --package=ceno_zkvm --bin=e2e --profile=release -- --hints=/home/matthias/scroll/prog/zkVM-benchmarks/sorting-output/30869-2025-01-14T15:05:15,830604293+00:00/ceno/hints /home/matthias/scroll/prog/zkVM-benchmarks/ceno/examples/target/riscv32im-ceno-zkvm-elf/release/examples/sorting"
User time (seconds): 1474.92
System time (seconds): 102.87
Percent of CPU this job got: 3717%
Elapsed (wall clock) time (h:mm:ss or m:ss): 0:42.43
Average shared text size (kbytes): 0
Average unshared data size (kbytes): 0
Average stack size (kbytes): 0
Average total size (kbytes): 0
Maximum resident set size (kbytes): 19556028
Average resident set size (kbytes): 0
Major (requiring I/O) page faults: 3
Minor (reclaiming a frame) page faults: 14005087
Voluntary context switches: 1191936
Involuntary context switches: 209871
Swaps: 0
File system inputs: 0
File system outputs: 32
Socket messages sent: 0
Socket messages received: 0
Signals delivered: 0
Page size (bytes): 4096
Exit status: 0
Loading

0 comments on commit 1e3b895

Please sign in to comment.