followthemedia.com - a knowledge base for media professionals
The Numbers
KNOWLEDGE

Digital Radio - Paradigm and Shift ftm Knowledge file

Digital media is slowly finding its way. Broadcasters are challenged by shifts in business models, audience expectations and regulation limbo. this ftm Knowledge file details the promise of digital broadcasting and the paradigm shifts. 65 pages PDF (February 2008)

Free to ftm members, others from €39
Order

Media Measurement Moves Forward and Everywhere ftm Knowledge file update

Includes: mobile and internet metrics, electronic measurement systems and device descriptions, PPM (US) debate, Cox Radio President Bob Neil interview, RAJAR (UK) debate, with comments. 68 pages PDF (February 2008)

Free to ftm members, others from €39
Order

Africa - Media made to order ftm Knowledge file

Africa's media touches its 57 countries and the rest of the world with every possible challenge. From the abuse of dictators to amazing development and the rise of new media African media has its own texture and context. Contains 20 articles and ftm Resources. 62 pages PDF (January 2008)

Free to ftm Members, others from €39
Order

More ftm Knowledge files

AGENDA

All Things Digital
This digital environment

Big Business
Media companies and their world

Brands
Brands and branding, modern and post

The Commonweal
Media associations and institutes

Conflict Zones
Media making a difference

Fit To Print
The Printed Word and the Publishing World

Lingua Franca
Culture and language

Media Rules and Rulers
Media politics

The Numbers
Watching, listening and reading

The Public Service
Public Service Broadcasting

Show Business
Entertainment and entertainers

Sports and Media
Rights, cameras and action

Spots and Space
The Advertising Business

Write On
Journalism with a big J

Send ftm Your News!!
news@followthemedia.com

New Arbitron goof: rats ate the PPM data

A new problem surfaced this week for US media measurement agency Arbitron in their roll-out of radio audience surveys collected with the Personal People Meter (PPM). A big chunk of data from the Houston, Texas survey disappeared. Arbitron calls it an “error.” Broadcasters call it a crisis.
followup(1);comment(0)

Swiss ratArbitron supplies radio survey clients week-to-week sampling data, exact totals by age, gender and race of survey respondents. US broadcasters have been critical of sampling methods, compliance and results for many years and Arbitron responded by providing weekly figures. Difficulties meeting survey sample goals for diary-based surveys – apparent in the 1990’s - was one of several reasons Arbitron invested in passive electronic measurement systems.

Late Monday (August 20) data provided by Arbitron to broadcaster clients showed a one-third loss in carry-rate, the new PPM-speak term for compliance, for one week in the Houston survey. Philadelphia and Houston are the first US markets surveyed using the electronic device, officially from mid-July after two years of testing, squabbling and more testing. When questioned about the drop in “carry-rate,” one Arbitron official wrote to a curious broadcaster in an email Tuesday morning (obtained by ftm), “I’ll look into this and have someone get back to you today. It certainly seems possible that summer schedules and vacations could impact the number of people who qualified for 6 out of 7 days in August week 1, but we need to verify that's the cause.”

ftm background

On measurement and monopoly
Across the globe and across all media measurement is the be-all and end-all to commercial success. As media buyers and ad agencies demand changes and enhancements to measurement systems, from cross-media, passive monitoring to ‘granular’ data, broadcasters either acquiesce or endure the financial consequences. Cox Radio CEO Bob Neil took questions from ftm on radio measurement and monopoly.

New Headache For Arbitron. PPM Not Certified in US
Not that long ago US audience measurement company Arbitron was poised to revolutionize the system. That was then. Today that revolution just got delayed…again.

Ipsos Cellphone Radio Measuring Thing Maybe Included in RAJAR Tests
Bells are ringing at RAJAR headquarters as Ipsos reported its new electronic measurement device for radio passed the functionality test, the same test passed by ARBITRON’s PPM and Eurisko’s Media Monitor early last year.

Arbitron Reports PPM Trial Results, Prepares Broadcasters for “Currency Change.”
The US media research company shared results from the extensive Houston, Texas trials. Measured with the Personal People Meter (PPM) people “tune into more stations more frequently but they listen for shorter periods of time,” said Arbitron/PPM President Pierre Bouvard. This was no real surprise as earlier Arbitron test results were similar. And, if broadcasters bothered to ask, electronic measurement for radio in Switzerland, now in its fifth year, has shown the same patterns.

"What Gets Measured Gets Done"
What and how we measure media is likely to change what media does.

That would suggest one-third of the Houston population went on holiday during the first week of August. American holidays and vacations have disappeared in the Wal-Mart/Enron era. Another possibility is a quality control problem.

Yet another possibility for the “carry-rate” drop was mentioned a week earlier in an Arbitron conference call with key broadcasters. Compliance – the old term – had reared its head in both Philadelphia and Houston. Some folks in the survey panels just weren’t paying attention, not undocking the PPM and otherwise upsetting the sample. It seems survey panel participants grow less attentive to the PPM device with the passage of time. Of course, the primary purpose of passive measurement is elimination of that human touch. Arbitron started cutting the non-participants and recruiting new ones.

The importance of sampling in the PPM surveys cannot be understated as the results – that number media buyers demand and broadcasters pay for – are determined from two parallel samples: one to measure ‘cume’ (reach) and one to measure ‘average quarter hours’ (time spent listening). These numbers are then combined in a computer model to create a rating. Arbitron has also patented a confidential method of insuring compliance.

By early yesterday afternoon (Tuesday, August 21) one Arbitron official suggested a data processing error with one of the samples and, later, that the reported sample size was incorrect. In mid-afternoon, New York time, Arbitron officials turned the entire flap – fueled by the skeptical side of the US radio trade press – over to their public relations specialists. The official Arbitron response said, “The file used to process the weekly cume estimates…was incompletely loaded from the data warehouse to the production system.” In other words: rats ate the data file.

Said one broadcaster (email obtained by ftm): “Which is worse, a 30% drop in sample ... or an error of this scope that no one at Arbitron caught?”

All of this is more than vaguely, but materially similar to 2004 episode in the life of RadioControl – another electronic measurement system – in Switzerland. Changing sample provider in the midst of one survey period caused numerous changes in the results, including the ‘disappearance’ of several stations. Neither Radiocontrol nor PublicaData, its marketing service, informed clients of the change in advance and waited until one station owner – also a prominent Swiss political figure – threw what could only be described as a fit. The result, three years later, was a complete reorganization of the radio audience measurement system in Switzerland. Sampling, apparently, is even more volatile with electronic measurement systems.

Arbitron said yesterday – and last week, last month and last year – that sampling problems with PPM surveys would be corrected. Media measurement services operate like public utilities, mediating – like accounting – a relationship between broadcasters and media buyers. Confidence, on both sides, is built on transparency. Where transparency is weak, quality control weaker and the science reminiscent of Enron derivatives broadcasters and advertisers need to re-think whether or not they are getting what they’re paying for.


ftm Follow Up & Comments

Wake up and smell the coffee, Steve - November 15, 2007
This could be one of those days when Arbitron CEO Steve Morris wakes up asking himself why he ever left that good job running the Maxwell House coffee business for General Foods. Yesterday (Wednesday November 14) four of his biggest clients – Clear Channel Radio, Cox Radio, Cumulus Media and Radio One – fired off a letter, provided to ftm, that began, 'It is with the utmost urgency and objection that we, your customers, send you this letter.'...MORE

copyright ©2004-2007 ftm partners, unless otherwise noted Contact UsSponsor ftm