Continuous Performance Regression Testing for CI/CD

Developers strive to produce efficient code. Many times, developers will add code to their repositories and test it to make sure it works, but they are forgetting one very important step: benchmarking! Benchmarking allows developers to see the performance impact on their code output. If properly integrated into a CI/CD pipeline, it could prevent catastrophic drops in performance before any code is shipped/deployed at all. 

CyBench is based on the JMH framework, which is known for benchmarking Java code. It makes benchmarking easy, offering various plugins into build tools such as Maven or Gradle and IDEs such as Eclipse or IntelliJ. CyBench will allow you to benchmark builds, releases, algorithms, code, libraries, and more! It will also store your benchmarks for you so that you can automate a performance regression test workflow. All you have to do is sign up for an account, integrate CyBench into your project, and set up a configuration for performance regression testing.

By integrating CyBench into your CI/CD pipeline, you will be able to prevent code deployments with potentially critical impacts to the performance of your application. As a DevOps engineer, you can ensure your team is putting out the best code possible before shipping to customers.

CyBench is currently free to use. To get started, first create an account on the CyBench website (CyBench will ask you to sign in via GitHub). Next, head to the CyBench Launcher GitHub page to begin creating benchmarks for your project and incorporating all that CyBench has to offer. 

To learn more, head to the Wiki, where you will find overviews on how to use the various plugins and tools CyBench offers. Additionally, there is a collection of videos to help get you set up and learn everything about CyBench on Vimeo.