benchee v0.2.0 Release Notes
Release Date: 2016-06-11 // almost 8 years ago-
๐ This release introduces warmup for benchmarks, nicer console output and the new
Benchee.measure
that runs the benchmarks previously defined instead of running them instantly.๐ฅ Breaking Changes (User Facing)
- ๐ท
Benchee.benchmark/3
now doesn't run the benchmark anymore but simply adds it to:jobs
in the config. The whole benchmark suite is then run viaBenchee.measure/1
. This only affects you if you used the more verbose way of defining benchmarks,Benchee.run/2
still work as before.
๐ฅ Breaking Changes (Plugins)
- ๐ท the defined benchmarking are now preserved after running the benchmark under the
:jobs
key of the suite. Run times are added to the:run_times
key of the suite (important for alternative statistics implementations)
๐ Features (User Facing)
๐ง configuring a warmup time to run functions before measurements are taken can be configured via the
warmup
key in the config defaulting to 2 (seconds)๐ statistics in console output are aligned right now for better comparisons
๐ last blank line of console output removed
๐ Features (Plugins)
- additionally supply the total standard deviation of iterations per second as
std_dev_ips
afterBenchee.Statistics.statistics
๐ Bugfixes
- if no time/warmup is specified the function won't be called at all
- ๐ท