The advertising industry, as a whole, has the poorest quality-assurance systems and turns out the most inconsistent product of any industry in the world...
In our experience, only about half of all commercials actually work; that is, have any positive effects on consumers’ purchasing behavior or brand choice. Moreover, a small share of ads actually appear to have negative effects on sales. How could these assertions possibly be true? Don’t advertising agencies want to produce great ads? Don’t clients want great advertising? Yes, yes, they do, but they face formidable barriers.
Unlike most of the business world, which is governed by numerous feedback loops, the advertising industry receives little objective, reliable feedback on its advertising. First, few ads and commercials are ever tested among consumers (less than one percent, according to some estimates). So, no one—not agency or client—knows if the advertising is any good. If no one knows when a commercial is good or bad (and why), how can the next commercial be any better? Second, once the advertising goes on air, sales response (a potential feedback loop) is a notoriously poor indicator of advertising effectiveness because there is always so much “noise” in sales data such as competitive activity, out-of-stocks, weather, economic trends, promotional influences, pricing variation, etc. Third, some of the feedback on advertising is confusing and misleading: agency and client preferences and biases, the opinions of the client’s wife, feedback from dealers and franchisees, complaints from the lunatic fringe, and so on.