What to expect after adopting a code review tool like Codacy

In this article:
Subscribe to our blog:

In a previous article, we’ve covered how much technical debt and code quality issues are costing you and how Codacy can help you reduce that cost. Now, let’s see what changes in your data when you use an automated code review tool like Codacy.

The data below belongs to 5 repositories with a team of 120 developers behind, collaborating on a daily basis. We analyzed these 5 repositories for 90 days. Here’s what we found out.

Please note this analysis was part of an experiment we did, and this is not the type of chart you’ll see in Codacy.

Total of PRs blocked automatically

In the 5 repos we analyzed, we managed to stop 468 PRs from merging because they didn’t meet the organization’s code quality standards. This is crucial to prevent new issues from entering the code base and decrease technical debt.

Q1 - Total of PRs blocked automatically
Total of PRs blocked automatically, by project, over 90 days.

And also, by blocking these 468 PRs automatically, we saved the team a significant amount of time, as they no longer need to look for these issues manually. Instead, they can spend their time focusing on more complex issues that Codacy cannot pick up. Plus, with the code quality reports provided, each developer quickly understood the existing issues and how to fix them.

Evolution of PRs blocked automatically

Over time, we observe that automated code reviews provide value to this organization since we see a drop in blocked PRs. In short, this means each developer behind the PR learns from the reports provided, and they’re not repeating the same mistakes repeatedly. They can easily spot which lines of code contain issues or security breaks and fix them on demand.

Q2 - Evolution of PRs blocked automatically
Evolution of PRs blocked automatically, by project, over 90 days

In the long run, by decreasing technical debt, we make sure that engineers use most of their time to build new features instead of fixing and maintaining bad quality code.

Issues management

Total of issues fixed, by issue category

In the same 5 repos, 34 883 issues have been fixed and removed from the repos in different issues categories.

Q3 - Total of issues fixed, by issue category
Total of issues fixed, by issue category, over 90 days.

Our reports also showed that a significant amount of the issues that the team is fixing are related to code complexity. This means that, over time, the code on these repositories has become more maintainable. Guaranteeing code maintainability is important because it allows you to, for example:

  • Make changes in the code quickly, without introducing problems with the change;
  • Add new features efficiently;
  • Improve the overall performance of your code;
  • Onboard new developers quickly.

Total of issues found and fixed

In the 5 repos we’ve analyzed, many new code lines likely entered the code base; hence the spike in issues found and fixed in the following chart.

Q4 - Total of issues found and fixed
Total of issues found and fixed, over 90 days. 

This is positive since the issues flagged are being fixed and removed from the repos. This impacts positively the technical debt over time.

Deployment frequency per active developers

The deployment frequency of all active developers in the 5 repos we analyzed is steadily increasing. This also indicates that using automated code review tools increases engineering productivity.

Q5 - Deployment frequency per active developers
Deployment frequency per active developers, over 90 days. 

Conclusion

It’s hard to tell if your organization will behave similarly to the team behind these 5 repos. There’s a chance your team behaves differently if you have not fully integrated the use of an automated code review tool into your engineering workflow. 

However, when you integrate Codacy into your engineering by establishing code quality standards at the org level and onboarding your team, we usually see the same pattern described in this article. With time, fewer PRs will be blocked as Codacy flags issues and shares learnings with your engineers. The team can fix issues independently, increasing deployment activity. 

RELATED
BLOG POSTS

Webinar Recap: The Future of AI-Assisted Development and Code Quality
We hosted a webinar on September 27 in collaboration with Techstrong Learning, which focused on how artificial intelligence (AI) is powering great...
Why our customers made the switch to Codacy
Software engineering teams across several industries are always looking for the best tools to use on their CI/CD pipelines. Here are the top 5 reasons...
Reading & Understanding Codacy’s Reporting Feature
This blog post on Codacy’s reporting feature was originally written by Dishant Khanna. Dishant is a student at the Bharati Vidyapeeth’s College of...

Automate code
reviews on your commits and pull request

Group 13