benchee v0.2.0 Release Notes

Release Date: 2016-06-11 // almost 8 years ago
  • ๐Ÿš€ This release introduces warmup for benchmarks, nicer console output and the new Benchee.measure that runs the benchmarks previously defined instead of running them instantly.

    ๐Ÿ’ฅ Breaking Changes (User Facing)

    • ๐Ÿ‘ท Benchee.benchmark/3 now doesn't run the benchmark anymore but simply adds it to :jobs in the config. The whole benchmark suite is then run via Benchee.measure/1. This only affects you if you used the more verbose way of defining benchmarks, Benchee.run/2 still work as before.

    ๐Ÿ’ฅ Breaking Changes (Plugins)

    • ๐Ÿ‘ท the defined benchmarking are now preserved after running the benchmark under the :jobs key of the suite. Run times are added to the :run_times key of the suite (important for alternative statistics implementations)

    ๐Ÿ”‹ Features (User Facing)

    • ๐Ÿ”ง configuring a warmup time to run functions before measurements are taken can be configured via the warmup key in the config defaulting to 2 (seconds)

    • ๐Ÿ‘ statistics in console output are aligned right now for better comparisons

    • ๐Ÿšš last blank line of console output removed

    ๐Ÿ”‹ Features (Plugins)

    • additionally supply the total standard deviation of iterations per second as std_dev_ips after Benchee.Statistics.statistics

    ๐Ÿ›  Bugfixes

    • if no time/warmup is specified the function won't be called at all