Expand +

Case Study


Kraft Foods Completes Journey to 80% Automation of Business Process Tests

by Ken Murphy, Editorial Director | insiderPROFILES, Volume 5, Issue 1

January 1, 2014

This article explores Kraft Food Group's  journey toward the automation of regression testing with Worksoft. About five years ago, Kraft began a major SAP implementation for its North America operations. Its manual regression testing processes struggled to keep up with the volume of regression scripts needed to be executed for all the new releases going into production. An HP solution helped Kraft achieve about 50% automation of its regression test script inventory. The company then decided to implement a second application, Worksoft Certify, to increase its automated inventory, with a goal of reducing the number of defects making their way into production, as well as automating non-SAP applications. Read more to learn how Kraft achieved its goal.



Kraft Foods Group is one of the largest consumer packaged food and beverage companies in North America — where at least one of its brands can be found in nearly every household. Complex supply and distribution networks support the production and distribution of two billion-dollar brands — Kraft and Oscar Mayer — and several million-dollar brands, and disruption to supply chain or distribution capabilities could adversely affect this market penetration. Because Kraft Foods increasingly relies on its IT infrastructure to manage business operations and comply with various regulatory, legal, and tax requirements, it can’t afford shutdowns or other failures during software upgrades or enhancements.

At a Glance

Goal: Kraft wanted to increase the automated test coverage of its core business processes from 50% to 80% to improve its defect detection rate and reduce test cycle time and effort

Strategy: Added Worksoft Certify for end-to-end automated testing across its SAP ecosystem

Outcome: Decreased the number of defects in production, achieved the goal of 80% automation, and significantly reduced the time and effort spent on manual script development, testing, and maintenance

The importance of keeping defects out of production took on added importance for Kraft about five years ago when it began a major SAP implementation for its North America operations. Its manual regression testing processes struggled to keep up with the volume of regression scripts needed to be executed for all the new releases going into production.

By implementing some test management software by HP, Kraft was able to automate 50% of its regression test script inventory, focusing primarily on regression testing for its SAP applications by partnering with Infosys Limited. Because of the success with these tools, Kraft decided to implement a second application to increase its automated inventory with a goal of reducing the number of defects that were making their way into production. Additionally, Kraft decided to automate the highly integrated non-SAP applications. This decision came about in September 2012 — shortly before Kraft split off its confections and snack business. 


"Once you automate and execute a
few of their business processes and
everyone sees how simple it is, you
get that buy-in and they come to
your door wanting more."

- Lori Etelamaki, Associate Director of Quality and Testing, Kraft Foods


It’s rare for a company with a history dating back a century to adopt a startup mentality, but with the business split, the rebranded Kraft started thinking like a smaller company — one that was keenly focused on avoiding any major production errors. Now, with a single instance of SAP ERP, a production error in a new release could potentially affect the entire business. Also, the business consolidation meant the company could operate with a leaner IT department. And by significantly automating the regression test inventory, this leaner IT organization could manage more frequent regression cycles to support the system and configuration changes.

Lori Etelamaki, Kraft’s Associate Director of Quality and Testing, had two goals for the organization’s new automation tool: automate 80% of its regression inventory, and do so without disrupting the business. She says, "Minimizing the impact to the project teams working on implementing the applications is important, because if they are busy testing, then they are not focused on innovation, financials, or providing business value."

The overriding goal, of course, is minimizing disruption to the customer — keeping Kraft brands in refrigerators and pantries. "There are certain things you can’t afford to mess up," Etelamaki says. "Quality always has to be there to make sure we’re not stopping production lines or trucks aren’t waiting for inventory."

Worksoft Fills the Gap

Knowing that the volume of regression test scripts would increase, one requirement for the new automation tool was that it be able to maintain and manage a heavy volume of processes. Another was ease of use. Partly
because of these factors, Kraft decided to implement Worksoft Certify, the flagship product from SAP partner Worksoft that promises end-to-end business process validation across the entire SAP ecosystem.

"We previously had some challenges around testing SAP NetWeaver Portal and SAP GUI applications, as well as some non-SAP applications like web apps connecting to our servers," Etelamaki says. "We believed that Worksoft would work well on an end-to-end scale."

Because testers don’t need programming skills to be trained to use Worksoft Certify, adding the new application was easy, especially because Kraft already had an automated testing framework in place that testers were familiar with. To further help ease the transition, in conjunction with automating its initial regression inventory, Kraft established a testing center of excellence (TCoE), using Infosys Limited as its partner for testing services. This TCoE provided test planning, scripting, execution, and automation across various test cycles.

With the addition of the Worksoft application, this team of testers was then responsible for building up the automation portfolio for all critical SAP and SAP-integrated applications. In the manual regression testing environment, regression testing was the domain of the particular project or business team — a labor-intensive approach. The TCoE allowed the flexibility of executing the automated regression inventory for major releases, minor releases, and monthly break/fix releases, significantly increasing the test coverage and reducing defects introduced into production.

"One benefit of a TCoE was a continuity of resources," explains Etelamaki. "We didn’t want to have situations where a project team would implement an application, and then when a new update would come along, those team members were no longer available. A centralized team for executing the automation process knowing the scenarios and exactly what needs to be done is the glue between all the multiple releases."

Increasing Automation Inventory

In building its automation inventory, Etelamaki’s project team channeled its focus on identifying and executing automated regression testing for core end-to-end business processes. The team looked at integration scripts in use for prior releases as a starting point, and built its inventory based on whether the scripts were for core processes. Every time an application went into production, the key question was whether new functionality was added and, if so, whether that functionality touches a core process or introduces a new business scenario. The new Worksoft application needed to extend out to Kraft’s roughly 80 non-SAP integrated applications to reach the stated goal of automating 80% of regression testing.

Another decision the team made was to target automation only for stabilized applications, to help build a run and re-use inventory, and then proactively update those test cases to reflect upcoming release changes. This is where the new application’s ease of use came into play. "I could have my Infosys functional testers learn Worksoft, update the test, and put it back into the queue," Etelamaki says. "That was key for efficiency. And because of that simplicity, those testers would often approach me with new ideas for how to use the automation application in other areas."

Changing the Business Mindset

The approach for automated testing was to start with a key functional area, and automate enough scenarios to significantly reduce the impact on the business. Kraft started with a very critical and highly integrated order-to-cash process. "The business teams would say that it would be quicker for them to just do it themselves," says Etelamaki. "It’s difficult to explain that it would end up saving them several days of work every time there’s a new release, and we need a little time up front to ensure the process is appropriately documented for testing — so we took a "show-me" approach. We demonstrated the execution of automated scripts took a fraction of the time that the manual execution took. Also, the business was only required to validate the exceptions."

Company Snapshot
Kraft Foods Group, Inc.

Headquarters: Northfield, Illinois

Industry: Consumer manufactured goods

Revenue: $18.3 billion (2012)

Net income: $1.6 billion (2012)

Employees: 23,000

Company details:

  • Kraft Foods was established in 1909 as J.L. Kraft & Bros. Co., by Co-Founder and President James Lewis Kraft (1874-1953).
  • Kraft was granted a patent for what became known as process cheese in 1916; his pasteurization and homogenization processes allowed cheese to be packaged and sold in convenient sizes for wider availability. In 1915, Kraft sold $5,000 worth of process cheese. The next year sales skyrocketed to $150,000.
  • Household penetration is 98% in the US and 99% in Canada.
  • Kraft has 27 brands with more than $100 million in annual sales.
  • In October 2012, Kraft Foods, Inc. split into two separate businesses, with Kraft Foods Group as a grocery business with iconic brands such as Velveeta, Jell-O, Kraft Macaroni & Cheese, Maxwell House, and Kool-Aid. Mondelēz International Inc. was created as a dessert and snacks-based business. Its brands include Nabisco, Cadbury, and Halls.

SAP solutions:

  • SAP NetWeaver BW
  • SAP NetWeaver Portal
  • SAP NetWeaver PI
  • SAP NetWeaver MDM
  • SAP Solution Manager
  • SAP solutions for GRC

After automation occurs, however, the inventory queue grows quickly. "Once you automate and execute a few of their business processes and they see how simple it is, you get that buy-in and everyone comes to your door wanting more," says Etelamaki. This user acceptance helped make increasing the automation inventory from 50% to 80% a relatively straightforward endeavor, especially because Etelamaki’s team was able to show rather quickly that the upfront effort, which was initially met with resistance by business teams, was actually paying dividends in higher quality and shortened timelines.

This success was reflected in break fixes and monthly production cycles. "Normally, teams don’t have a large window for testing, and the testing time for monthly cycles is very short," says Etelamaki. "Now, our teams are a lot more confident knowing that it will only take us three days to run these tests before go-live. And because the testing does find defects, we’ve been able to prove that it’s worth our time and effort."

Mobile, the Next Wave

Because Kraft reached its goal of automating more than 80% of its core business process tests with little disruption to business teams, the organization can now plan its release cycles differently because testing cycle times have been reduced. "All the manual, labor-intensive work that used to take weeks to perform is now done in days and, in some cases, even hours," Etelamaki says. "A previous four-week regression cycle now can be done in half the time, with 80% completed in the first three days. So not only do we have time to identify and fix errors, but since we have several releases a year, we have a lot more available time to devote instead to blueprinting, development, or other phases. We can actually have more releases and innovate faster."

With the success of Worksoft Certify, Kraft started implementing Worksoft Certify for Mobile to its testing suite in November. "That is the next big frontier," says Etelamaki.

Worksoft Helps Kraft Cut Costs and Increase Quality with Automated Business Process Validation

Worksoft provides a top-ranked industry platform for automated business process validation. Companies use Worksoft software to shorten project timelines, reduce costs, innovate faster, and improve business process quality for enterprise systems, including SAP solutions and all cloud, mobile, and portal technologies. In a nutshell, Worksoft ensures that business processes continue to work even when mission-critical enterprise systems change. With this technology, companies can increase quality and lower costs — at the same time.

After a major SAP implementation, Kraft Foods Group found that manual testing processes could not keep pace with the increased number of regression test cycles of new releases. As a result, Kraft implemented Worksoft Certify for highly automated testing of its business-critical processes. With an increased automation portfolio, Kraft was able to dramatically increase its coverage and automate over 80% of its regression testing for both SAP and non-SAP business systems.  

“By turning to Worksoft for end-to-end business process validation, Kraft avoids the potential business disruption of software defects in production. In other words, this lowers technology risk and the impact of recurring changes in the company’s application environment,” said Shoeb Javed, CTO for Worksoft. “At the same time, high automation helps Kraft achieve cost savings, improve efficiency, and maximize staff productivity.”

Worksoft Certify is easy to use and provides the industry’s highest levels of automation — often exceeding 80% coverage of a company’s critical business processes. Leading global brands and more than 200 SAP companies worldwide have embraced Worksoft’s automated business process validation software to ensure quality execution and minimize risk. For more information, visit


An email has been sent to:

More from SAPinsider


Please log in to post a comment.