Sam Weaver is a radio talent coach, www.radiocoach.biz and veteran programmer who has worked in Dallas, Chicago, San Francisco, Kansas City, Pittsburgh, and Charlotte, among other markets. In his new career, Sam is a personal trainer for personalities looking to improve or maintain their air work. Here, he breaks down the new ratings data service, the Portable People Meter, so that anyone can understand what it is and how it works.

Here is part two of his overview:

Uploading and Editing

Sometime between the docking of the PPM, and the household hub collection of daily data, there is an upload to a central computer at Arbitron. The uploading can occur anytime up until 4 AM. Once the information reaches Arbitron, there is an editing process of coded audio, to properly assign credit to individual radio stations. Remember, stations only get listening credit from an individual panelist if the person meets the minimum motion requirement: a panelist aged six to seventeen has to carry the meter at least five hours a day; eighteen and over, it’s eight hours a day.

Morning Radio

There has been some confusion about morning radio measurement; many have said that much of the listening is not being reflected in ratings. Here is an example to clarify how it actually works. The alarm clock radio goes off at 6 AM and the meter, still docked, begins to record the coded audio. Though the panelist does not indicate motion until 7:30 AM, all the recorded exposure prior to motion will count for ratings, as long as the panelist meets the minimum exposure requirements for the Arbitron broadcast day of 4 AM to 4 AM.

Panel Expectations

For a family to remain a Portable People Meter survey household, participants must maintain a solid record of compliance with the rules. If successful, a household could conceivably serve the two-year panel maximum. However, if any one member of a family does not regularly carry the meter, the entire household will be dropped from the panel and replaced.

Causes for Panel Removal

There are numerous reasons for a household to be removed as panelists from the PPM survey. Reasons include a family’s request for removal, a move out of the metro area, constant disconnection’s of the home phone (or cell phone, in a cell phone only family) by the phone company, a radio station employing a member of the household, and others that may yet be determined. Panel relation’s specialists stay in communication with survey households to encourage proper usage and answer any questions.

Accreditation

Arbitron’s guinea pig markets for test marketing Portable People Meters have been Philadelphia and Houston, the latter was the only city accredited by the Media Ratings Council (MRC) until the recent accreditation given to the Riverside-San Bernardino market. Many credit the Houston nod to the recruitment process combining telephone solicitation, addressed based, and the option of visiting homes. With the exception of Philadelphia, Houston, and New York, telephone recruitment, referred to as “Radio First,” is used to select panels in all other PPM markets. About one third of Houston panelists are recruited in person at home..

Broadcast Industry Concerns

In June 2008, stating they “speak for the vast majority of the industry”, six major broadcast companies, Clear Channel, Cumulus, Cox, Inner City Broadcasting, Radio One, and Saga, sent a letter to Arbitron asking for improvements, reassurances, and an action plan concerning four issues.

1. During the debut month of PPM in a market, 100% 18-54-year old age sample guarantees. If the 100% is not met, the companies wanted a financial rebate.

2. Ages 18-34, 100% sample guarantee with financial rebates if the goal is not met.

3. Abandon the measurement of ages 6-11. Existing panelists in this demographic should be phased out.

4. Do not implement Portable People Meter (PPM) in any more markets until the Media Rating Council has given accreditation. Also, at no additional cost to broadcasters, the “best practices” methodology in Houston is applied to all PPM cities. Many feel Houston received accreditation due to the successful combination of door to door canvassing and phone solicitation.

Arbitron’s Response

The cell phone only selection process is being revamped, and beginning with spring 2009, the improvements will be implemented in PPM and diary markets, 151 cities all totaled. This plan depends on the company completing the software development.

A new study from Nielsen Mobile found that more than 20 million U.S. telephone households (17 percent) are wireless homes without landlines. The new research also suggested that one in five U.S. households could be cell phone only by the end of this year.

The Arbitron Radio Advisory Council has also guaranteed a ten-percent sample increase for ages 12+ and ages 18-54. These enhancements will be phased in until completion by the end of 2010. Theoretically, a larger sample increases the possibilities for a clearer ratings picture in a market.

Political Pressure

Last year, Senators Daniel Inouye, Hawaii, Patrick Leahy, Vermont, Dick Durbin, Illinois, and President-Elect Barack Obama sent letters to Arbitron, stating displeasure with PPM. All four want assurances the new system will not adversely affect any radio station.

New York City Council voted unanimously to request that the Federal Communications Commission investigate PPM and the potential effects on the diversity of radio. In addition, the PPM Coalition, consisting of the Spanish Radio Association and the National Association of Black-Owned Broadcasters, filed a complaint with the FCC. Their concerns include panel selection methodology, non-Media Radio Council accreditation, media diversity issues, and possible financial effects on minority owned or operated stations.

Legal Issues

New York State Attorney General Andrew Cuomo sued Arbitron over “alleged false advertising and deceptive business practices, implementing a Portable Meter system threatens to drive minority broadcasters out of business.” Cuomo attempted to discourage radio groups and advertisers from using the system due to flaws.

Meanwhile, New Jersey Attorney General Anne Milgram also sued Arbitron over the Portable People Meter, charging violation of state laws on consumer fraud, advertising and discrimination.

Despite political pressure, more markets implemented the Portable People Meter: Chicago, Los Angeles, Riverside-San Bernardino, New York City, Nassau-Suffolk, San Francisco, Middlesex-Somerset-Union, Dallas-Fort Worth, and San Jose. Remaining markets are scheduled for operation by the end of 2010. For a complete listing of current and future PPM markets,visit the Arbitron website.

Denial and Rejection

Arbitron denied all allegations and counter sued in both cases, asking for declaratory judgment and injunctive relief. However, in the New York case, the U.S. District Court, dismissed Arbitron’s counter claim. There is some good news; the decision has not affected the right to release PPM rating estimates during the investigation.

Legal Settlements

Arbitron recently agreed to settlements with the states of New York and New Jersey. Both agreements included cash, adjustments in panelist selection recruitment, increases in cell phone only household selection, and promises of increased efforts for accurate measurement. In regards to New York, Attorney General Cuomo reserved the right to rescind the order and reinstate the civil action, if Arbitron does not get accreditation by October 15th of this year. By July 2010, fifteen percent of New York City panels will be chosen by the same address based sample method applied in Houston. However, the in-person at home recruitment portion used in Houston will not be applied. Other assurances include increased sample targets for cell phone only households, and an increase in reaching sample targets. An interesting catch, a study will be completed by July 15th in New York City, to determine non-response measurable bias. If problems are indicated, Arbitron has obligated itself to find answers within six months. Highlights of New Jersey’s agreement included doubling the number of cell phone only households sampled and a certain percentage of panelists will be recruited using the Houston address based method. Philadelphia will also benefit from the agreement because a significant portion of their market encompasses southern New Jersey.

Definition of Addressed Based

Street addresses are selected and attempts are made to match them to numbers listed by the Phone Company or by other sources. If there is no match, mail is sent to the addresses to obtain a landline number and cell phone status. Once all the information is gathered, a cell phone only database is created and random calls are made for PPM panel recruitment.

Addresses are sampled based on their distribution in a market. Samples are essentially at the county level. Depending on the market, there are county splits as well as high density Hispanic and Black areas, which are a collection of zip codes, based on the proportion of Hispanics/Blacks within.

Inside Trader Allegations

More scrutiny, as New York State Attorney General Cuomo also subpoenaed seven high ranking Arbitron executives to examine alleged possibilities of insider stock trading. Apparently, just prior to a Portable People Meter delay in November 2007, there was about an eight million-dollar sell off of company shares from within the company.

The Upside

PPM is potentially a more efficient way to measure media exposure/listening; it doesn’t rely on the memory of a survey participant documenting daily listening in a diary. Results from test markets Philadelphia and Houston have shown that audiences for individual stations are twice or sometimes three times larger than previously reported with diaries. There are weekly trend reports, monthly reports, and one special holiday report. More frequent data should provide increased insight into listening habits. Most important, there should be less fluctuation from report to report, and therefore additional sales opportunities. Electronic measurement will also provide broadcasters the ability to measure the new digital audio platforms, HD radio, satellite, Internet radio, and podcasting.

A Possible Problem

At-home night listening, from 7pm until midnight, presents a possible problem. When the PPM meter is docked for the night, only one more hour of listening is credited, regardless of the docking time. Although Arbitron panel relation specialists probably try to discourage docking until bedtime, the rules present the potential for a lot of non-measured listening. Remember, even docked, the microphone on the meter is always recording. Over the years Arbitron has made several adjustments to the diary measurement system; hopefully the same will hold true for Portable People Meters.

My Opinion

It is human nature to attempt conquering the unknown. When it comes to man, machines, and computers, there is no such thing as foolproof. As the Portable People Meter debuts in more markets, some programmers will discover how to manipulate the measurements.

Arbitron will address flaws in panel selection methodology and length of service by household panelists, as more cities are incorporated into the PPM process. Most likely, the least expensive and first flaw to be fixed will be panel turnover. With the diary method, there is a new group of survey participants every week, allowing more people to participate in measurement. Portable People Meter panelists can serve six months to two years, resulting in little turnover. Other than shipping equipment to new PPM panelists, there would be no other additional financial obligations. Since it is currently impossible to estimate how many persons would be eliminated due to non-compliance in a survey period, Arbitron has probably already factored in extra shipping costs.

However, a change to include a portion of Houston’s in-person at home recruitment would be a huge extra expense Arbitron would like to avoid for as long as possible. The company’s official stand on the subject is “With the accreditation of Riverside-San Bernardino, we’ve demonstrated that our ‘Radio First” methodology, which uses a telephone-based sample frame and telephone recruitment, can deliver audience estimates that meet the standards of the Media Rating Council. There is no reason to use a method that would cost radio so much more when what we are using can measure up to a very demanding group — the MRC.”

A positive effect of the PPM is the renewed interest of broadcasters in the sound of radio. Once again, there is an emphasis on concise, entertaining DJ’s, improved research interpretation, an effort to improve music rotations, attempts at more effective branding methods, the use of the Internet, social networks, text messaging, and anything else that might increase ratings and revenue. Radio is actually thinking about what consumers want to listen to. Hopefully, the glut of weekly minute-by-minute PPM statistics will not cause too many broadcaster knee-jerk reactions. Regardless of what some advocate, no one is a Portable People Meter expert yet.

Consider this: for years, in youth-targeted music radio, pundits insisted up-tempo songs be played at the top of each hour. This theory continued to hold sway until the industry realized that the top of the hour for listeners is whenever they decide to listen, regardless of time. So much for “Radio Experts”.

A Final Thought

People are afraid of the new, but things are forever changing, and once the dust clears, everything always settles down. Radio has survived every challenge it has faced; the Portable People Meter will be no different.