rework benchmarks: script and output format
this is an attempt at making benchmarks easier to work with
-
benchmarks runwill read benchmarks from NUON data and run them -
benchmarks plotwill plot benchmark results - the output format will be something
- a directory whose name is the hash of the CPU spec and the Komodo commit hash
- contains
cpu.jsonwith the CPU info - contains
komodo.txtwith the Komodo commit hash - contains NDJSON result files
💡 Noteresults will typically be uploaded to https://gitlab.isae-supaero.fr/dragoon/komodo-benchmark-results
💡 Notethis MR goes alongside the
komodo-benchmark-results@222b2afcommit
changelog
- bump Nushell to 0.101.0
- parallel
$in=> remove uselesslet input = $inwhen possible, e.g. still required when using the function's$inin aforloop -
group-bychanged =>group-by x --to-tablewill now produce a table with columnsxanditemsinstead ofgroupanditemsas in 0.95.0
- parallel
- add link to results repo
- the Nushell benchmarks lib
- rename
--forceto--no-confirm (-y) - add
--append - reject columns that GPLT will complain about, e.g.
$.points.kfor the FRI plots - add
--saveto the FRI plot
- rename
- move the "field" and "curve group" benchmarks from
benchmarks/src/bin/operations/tobenchmarks/src/bin/ - remove
benchmarks/params/fri.nubecause it's been uniformized with the other methods - rewrite the README
- add main function to
benchmarks/that runs the benchmarks from a NUON record specification - simplify the output of FRI run
TODO
-
fix "atomic operations" (done in 4f69a1d6) -
check that plotting still works
images
Field
Linear algebra
FEC
ZK
FRI
Edited by STEVAN Antoine





















