The Problem With Vanity Metrics in Modern Marketing

Industry & Competitive Context

The carbonated soft drink (CSD) industry in the United States has, for decades, been defined by two rivals: The Coca-Cola Company and PepsiCo. Through the 1990s and 2000s, Coca-Cola held the number one position by volume, while Pepsi-Cola occupied the number two spot, a position it had defended for decades. By 2010, however, the category itself was shrinking. Total U.S. carbonated soft drink volume had been declining since a 2004 peak of roughly 10.2 billion cases, and consumer preference was steadily shifting toward diet and low-calorie variants. This created a market where incremental share gains mattered enormously, and where brand visibility during high-reach moments, such as the Super Bowl, had historically played an outsized role in defending share.

Advertising during the Super Bowl had been a fixture of PepsiCo’s marketing calendar for 23 consecutive years. Between 1999 and 2009 alone, PepsiCo spent more than $142 million on Super Bowl advertising for its beverage portfolio. This was a period in which mass broadcast reach a single telecast drawing more than 95 million viewers, representing roughly 42 percent of U.S. television households was considered one of the most efficient ways to reach a national audience in a single moment.

Brand Situation Prior to the Campaign

Entering 2010, Pepsi-Cola held the number two position in the U.S. carbonated soft drink market, trailing only regular Coca-Cola. Diet Coke, Coca-Cola’s diet variant, was running a close third, nearly matching Pepsi-Cola’s share by the end of 2009. PepsiCo, as a corporate parent, held a smaller but still significant gap behind The Coca-Cola Company in aggregate cola category share. The company had also been experiencing a gradual erosion in market share in the years prior, a trend that concerned its marketing leadership and prompted a strategic reconsideration of how the company allocated its advertising budget.

Strategic Objective

In December 2009, PepsiCo announced it would not purchase advertising time during the 2010 Super Bowl for its flagship cola brands, ending its 23-year presence in the broadcast. The company stated the decision was not driven by cost considerations. Instead, PepsiCo redirected more than $20 million — the approximate equivalent of its typical Super Bowl spend — into a new initiative called the Pepsi Refresh Project, an online, crowd-sourced philanthropic program. The stated objective, as articulated by PepsiCo’s marketing leadership at the time, including director of marketing Ana Maria Irazabal, was to build a direct, participatory relationship with consumers through social and digital channels rather than one-way broadcast advertising, and in doing so to strengthen brand affinity and corporate reputation in a media environment that was rapidly shifting toward digital and social platforms.

This represented a deliberate strategic bet: substituting a proven, high-reach, short-duration broadcast vehicle for a sustained, participation-based digital program whose commercial payoff was less direct and harder to attribute.

Campaign Architecture & Execution

The Pepsi Refresh Project launched on January 13, 2010, through a dedicated website, refresheverything.com. The mechanic was straightforward: members of the public submitted ideas for community and social-impact projects across categories including health, education, the arts, neighborhoods, and the environment. The public then voted on submissions, with the public voting period beginning February 1, 2010. Winning ideas received grants ranging from $5,000 to $250,000, funded out of the $20 million pool, with Pepsi committing to award up to $1.3 million in grants each month over the course of the year.

The program generated an immediate and large volume of participation. Within weeks of launch, the website had received roughly 1,000 project submissions. By late March 2010, when PepsiCo announced its first round of 32 grant winners including a grant supporting Teach For America’s teacher recruitment and training efforts the company reported that ideas posted to the site had collectively received nearly 3.5 million votes. PepsiCo’s own marketing leadership described the response as “overwhelming” in public statements at the time.

The company extended the program beyond its original one-year scope, committing in late 2010 to continue the Refresh Project into 2011 at the same monthly investment level and to expand it into European and Asian markets. However, the program also encountered operational difficulties that are relevant to any assessment of its design. In September 2010, the Refresh Project was criticized after a coalition of nonprofit organizations was accused of coordinating votes in a manner that critics argued violated the program’s own contest terms. In January 2011, The New York Times reported allegations that some participants had used fraudulent or coordinated voting tactics to improve their standing in the contest. In response, PepsiCo revised the program’s rules in early 2011, including limiting participants to five votes per day and increasing its auditing of vote tallies, in an effort to preserve the integrity of the contest.

Positioning & Consumer Insight

The underlying insight behind the Refresh Project was that consumers, particularly younger and digitally engaged audiences, were growing more receptive to brands that demonstrated social purpose and invited participation rather than brands that simply broadcast a message at them. This was consistent with a broader industry-wide shift in marketing thinking during this period, in which social media platforms such as Facebook which by 2010 had grown to roughly 350 million users worldwide were seen by many marketers as offering a more efficient and more “authentic” channel for brand engagement than traditional 30-second television spots.

PepsiCo’s leadership believed that a philanthropic, participatory model would generate goodwill and engagement metrics votes, submissions, website traffic, social media mentions, and brand awareness that would translate into stronger brand equity and, over time, into business results. This is precisely the assumption that the campaign’s outcome would go on to test.

Media & Channel Strategy

The campaign’s channel strategy was unusual for its scale in that it deliberately avoided mass broadcast media for Pepsi’s core cola brands in favor of an owned digital property (refresheverything.com), supported by Facebook (the Pepsi Refresh Project Facebook page was used to run elements of the program, including a “Celebrity Challenge” component decided by Facebook votes) and public relations coverage generated by the novelty of the approach. It is worth noting, for accuracy, that PepsiCo did not withdraw from the Super Bowl broadcast altogether in 2010; the company continued to purchase Super Bowl advertising time for other brands in its portfolio, including Frito-Lay’s Doritos, while Gatorade maintained its sideline presence at the event. The withdrawal was specific to Pepsi’s cola beverage brands.

By 2011, PepsiCo began to recalibrate its channel mix. The company returned to Super Bowl-adjacent marketing activity for Pepsi MAX through a user-generated advertising contest, and separately entered into a reported $60 million marketing tie-up with the television competition show “The X Factor,” signaling a partial return to traditional, broadcast-weighted advertising even as the Refresh Project continued to run in parallel.

Business & Brand Outcomes

The documented business outcome is the central fact of this case. According to year-end 2010 data published by Beverage Digest, a trade publication and data service widely used as an industry benchmark, Diet Coke overtook Pepsi-Cola to become the second-most popular carbonated soft drink brand in the United States for the first time, a position Pepsi-Cola had held for decades. Beverage Digest reported that regular Coca-Cola retained the number one position with a 17 percent market share. Diet Coke recorded a 9.9 percent share, narrowly ahead of Pepsi-Cola’s 9.5 percent share. Pepsi-Cola’s volume declined by 4.8 percent year-over-year, a steeper decline than Diet Coke experienced over the same period, pushing Pepsi-Cola into third place in the individual-brand rankings. Coca-Cola sold approximately 927 million cases of Diet Coke in 2010, compared to Pepsi’s 892 million cases of Pepsi-Cola.

At the corporate parent level, the shift was smaller in absolute terms but directionally consistent: PepsiCo’s aggregate share of the cola category slipped from 29.9 percent to 29.3 percent over the year, while The Coca-Cola Company’s aggregate share rose slightly, from 41.9 percent to 42 percent.

John Sicher, editor and publisher of Beverage Digest, publicly attributed part of Pepsi’s decline to the Refresh Project, stating that while the program was commendable on its own terms, it had not, in his assessment, given the Pepsi cola brand “the justice it deserves” in a competitive category where visible, brand-specific marketing mattered. He characterized the 2010 results as a “wake-up call” for the company.

It is important to be precise about what the available public record does and does not establish. No independently verified, publicly disclosed data directly and definitively isolates the Refresh Project as the sole or even primary cause of Pepsi-Cola’s share decline, and multiple industry commentators at the time argued that the causal link was asserted more often than it was proven, noting that Pepsi’s share had already been eroding in prior years under more conventional advertising. What the public record does establish, without ambiguity, is a temporal coincidence that became central to how the campaign was subsequently discussed in trade and business press: a year in which Pepsi generated substantial digital engagement metrics millions of votes, a large volume of project submissions, extensive press coverage, and PepsiCo’s own characterization of consumer response as “overwhelming” coincided with the loss of a market position the brand had held for decades, as measured by the industry’s own sales-tracking authority.

PepsiCo maintained publicly during this period that the Refresh Project had succeeded on its own stated terms: strengthening consumer connection and corporate reputation rather than driving short-term sales. The company reiterated its intention to continue and expand the program into 2011. However, the program was progressively scaled back and the company discontinued the Pepsi Refresh Project by early 2012, after which PepsiCo’s marketing strategy shifted toward a repositioning built around the internally articulated distinction, reported in Advertising Age, that “Coke is timeless; Pepsi is timely” a pivot toward pop-culture-driven marketing rather than cause-based crowd-sourced philanthropy.

The campaign subsequently became a documented subject of academic study: Harvard Business School published a case in 2013 titled “The Pepsi Refresh Project: A Thirst for Change,” examining the decision-making process behind the initiative.

Strategic Implications

The Pepsi Refresh Project is a useful case for examining the gap between engagement metrics and business metrics in marketing strategy, precisely because the engagement metrics were real, substantial, and well documented, while the business outcome moved in the opposite direction from what the engagement data might have predicted.

The case illustrates a structural issue in how marketing investment is sometimes evaluated. Vote counts, submission volumes, Facebook activity, and media coverage are all measures of attention and participation. They are comparatively easy to generate at scale through a well-designed digital mechanic, and they are highly visible, shareable, and favorable to report internally and externally. Market share, measured independently by a third party such as Beverage Digest, is a lagging, harder-won, and commercially consequential metric. The Pepsi case shows these two categories of metrics can diverge sharply within the same twelve-month period and under the same brand’s management.

A second implication concerns opportunity cost and channel substitution. PepsiCo did not simply add the Refresh Project to its existing marketing mix; it substituted the program for an established high-reach vehicle (Super Bowl advertising) that had previously helped defend the brand’s category position. The case suggests that when a company redirects spend away from a channel with a demonstrated, if conventional, link to category visibility and toward a channel optimized for a different kind of outcome (engagement and reputation), it should expect the metrics historically tied to the first channel to be at risk, even if the new channel performs exceptionally well on its own terms.

A third implication concerns measurement discipline. PepsiCo’s own public statements during the campaign emphasized participation figures (such as the 3.5 million votes reported in March 2010) as evidence of success, while the metric that ultimately defined the external narrative around the campaign Beverage Digest’s independent market share data was a different, and arguably more decision-relevant, measure entirely. For a marketing organization, this points to the importance of defining, in advance, which metrics will be used to judge a campaign’s success, and ensuring those metrics are tied as closely as possible to the business outcomes the campaign is meant to serve, rather than defaulting to the metrics a given channel makes easiest to report.

Finally, the case is a reminder that purpose-driven or cause-marketing initiatives can succeed in building brand sentiment and corporate reputation outcomes PepsiCo maintained the Refresh Project achieved while still coinciding with commercially unfavorable outcomes on the metrics that determine competitive position in a category. The two are not mutually exclusive, and a rigorous post-campaign evaluation needs to hold both possibilities simultaneously rather than treating strong engagement numbers as proof of commercial success.