Showing posts with label PPM. Show all posts
Showing posts with label PPM. Show all posts

Thursday, December 11, 2014

“Woof, Woof, Woof. Bow, Wow, Wow. Arf, Bark, Arf, Bark, Woof!”


Ever since dogs started barking “Jingle Bells” and “Santa Got Run Over By A Reindeer,” Christmas music has given country (and rock) format programmers and personalities a big headache.  

Thanks to PPM panel measurement which can follow the same group of people’s radio usage for many months and years, we now know some things about what drives the country format’s annual fall swoon at the expense of Adult Contemporary and Christian stations going “all Christmas music.”

1.  As Mike O’Malley told Inside Radio last week, studies of country listeners going back more than a decade consistently find that less than 20% of country P-1 listeners say they’d be very interested in having their country station play all Christmas music while half tell researchers they wouldn’t be interested at all, making going solid Christmas tunes a very risky tactic in a competitive country battle unless your company owns two country stations.  In that case, it can benefit them both, one gaining 35+ female tuning and the other one acting as an alternative for younger and male country music fans.  The more new music intensive you are, the more dangerous it can be to go more than a month without exposing and familiarizing the core with fresh music.  When you go back to playing the country hits you need to refamiliarize your core with it, which can hurt familiarity scores that drive TSL and passion as the new year - and a new PPM month - begins.

2.  In diary markets it has always appeared that all-Christmas helps the upper-demo contemporary get a cume boost in the first month of two of the Winter survey.  Now, thanks to PPM, we know that’s more a result of top-of-mindness impacting what people write in diaries than it is real usage.  Once, all-Christmas was seen as a strategy.  Now, we know it’s just a tactic.  In PPM, normal listening patterns resume on December 26 and don’t have any residual impact in January or February.  Thus, in a PPM market any station contemplating solid Holiday music in November and December needs to pre-sell the event in advance.  Diary measurement may make it appear that buying those great Christmas season ratings in January and February is a bargain, but PPM proves that would be overpaying.

3.  PPM permits a microscopic view of usage patterns not possible in diary surveys as long as the sample is large enough to be reliable.  As a result, aggregating multiple markets, it’s possible to uncover precisely what drives month-to-month changes in cume and average quarter hour.  Most months, any sudden changes are likely driven by sample weighting alterations or households coming into or leaving the panel.  As Christmas music starts to dominate one or two stations in a market, it’s now possible to dig into it directly and see exactly how each station in town’s average monthly users react.  What we see appears to be more than a sample wobble.  It looks “real.”

4.  A&O&B has been carefully studying PPM, thanks to the help of direct marketing and rating analysis vendors, from the very first month of PPM measurement going all the way back to the first tests of the technology in Wilmington and Philadelphia many years ago.  Here’s what we’ve observed, thanks to help from Arbitron and Nielsen analysts:  the normal pattern of daypart and day-to-day recycling tends to continue as usual for a healthy country radio station.  However, non-stop Christmas music on a station that always shares 25-30% of the country station’s audience month after month does something astounding during the Holidays.  It creates NEW DAYPARTS for itself, times of the day and days of the week from that group of panelists when the country station’s average listener wasn’t even using radio in most months!

5.  PPM “time spend exposed” (TSE/AMA) per hour for that country station when under attack from a 100% Christmas music competitor remains steady.  Morning show, at work and weekend usage are generally more or less unchanged.  Except for one group of listeners, the ones who seem to want to get into the Holiday spirit as they prepare for Christmas.  They go Christmas shopping, wrap presents, decorate the house, the workplace.  They host and attend parties.  They plan for the family event.  They continue to listen to their usual morning show, don’t listen much less than normal to their favorite 24/7365 country station, but they also find themselves using the solid Christmas music station a lot - as much as an extra day a week of their total time with radio - at lunchtime when they go out to shop, in the evening and over every weekend at home when they wrap presents, decorate the tree, write Christmas cards and organize their wardrobe for a busy Season Of Giving.

To deflect such a tactic when half the audience really doesn’t desire all-Christmas is next-to-impossible, though you can, we’ve found, at least minimize the damage — by creating your own extra special, lifestyle-driven extraordinary depart usage drivers. 


The challenge, of course, is that playing 500 popular Christmas songs over and over for six weeks is relatively easy when compared to the creativity, innovation and hard work it takes to build enough of the kind of content that can compete with it in listeners’ minds for six to eight weeks every year.

Attempting to cure your first headache can make for a pretty big second one too.

Wednesday, May 14, 2014

Making "Bad" 6% Less So

Not to seem ungrateful that we're now just a few more months away from seeing the 6% increase in PPM samples which Nielsen promised for 2014 last November, but - as my post "The Canary Has A Name" suggests - that won't come even close to realizing the dream of true PPM-based cross media measurement with reliable estimates a reality.

As Paragon Research's Larry Johnson recalls "when Nielsen and Arbitron were first collaborating in the early 1990s about rolling out radio PPM jointly, the sample size was to be roughly three times what Arbitron has been offering.  The sample size becomes even more crucial if Nielsen is going to measure multiple platforms with a PPM device.  If you’re going to accurately measure outlets with small, niche audiences, the sample size must increase dramatically.  For example, cable television gets cut up into very small pieces given the huge number of cable channels available.  It’s interesting that Nielsen uses a mixed methodology utilizing both diaries and meters in many of the television markets they rate."

Researcher Mark Ramsey offers a brief statistics course in a two year old article to underscore why it's important that Nielsen make the most of their abilities now that that they own PPM: 

Small samples yield extreme results more than large samples do. Every broadcaster knows this, of course, but the impact is far worse than you think.

Daniel Kahneman discusses this issue in some depth in his book Thinking, Fast and Slow:

Imagine a large urn filled with marbles. Half the marbles are red, half are white. Jack draws 4 marbles on each trial, Jill draws 7. They both record each time they observe a homogeneous sample—all white or all red. If they go on long enough, Jack will observe such extreme outcomes more often than Jill—by a factor of 8.

By a factor of 8!  Extreme (and erroneous) results are 8 times more likely with 4 rather than 7.
And how many meters are tuned to your station right now?

Ramsey asks:   "What does it say about the veracity of our message and our messengers when we’re using numbers we know to be flat-out false?"

Another researcher, Kurt Hanson recalls his attempts several decades ago to sell radio on a better sample size in a service called Accu-Ratings, and puts it this way: "introduction of Portable People Meters (PPMs) solved the wrong problem:  Diaries weren’t being filled out precisely to the minute (in fact, lots of respondents filled out their diaries in one sitting at the end of the week), and PPMs “fixed” this problem, but because meters were so much more expensive than paper diaries (hundreds of dollars vs. maybe a dime), Arbitron used far fewer of them per market.  So the sample size issue got *worse,* not better!"

If today's multi-media ratings firms are serious about credibly measuring the increasingly-fragmented pie, they have to see the potential of signing many, many new clients which hopefully will rapidly grow their revenues, while keeping radio and television's rates stable at current levels.

I hope they also understand that to achieve that lofty goal sample sizes must be at least tripled or quadrupled, not merely increased in small increments.

The Canary Has A Name

The canary in radio ratings' coal mine's name is Sean Hannity.
In a cover story interview this week, the syndicated talker tells Radio Ink "one of the problems with radio in general, and this impacts all formats, is that in the last 10 years, our lives, in terms of technology, have changed dramatically. Radio needs to wake up to this fact. It’s the single biggest threat to the radio business today — that is, the measurement system is flawed in a dramatic way."

Hannity believes he has millions of digital listeners he is not able to get credit for.  "For example, in New York, if you’re listening to The Sean Hannity Radio Show on the WOR website, even if you have a Portable People Meter, I can’t get credit for that. We know that WABC, at times, had well over 1.4 million people listening online. If we can’t get credit for that, then all the data that’s being put out there is just inaccurate. Then you add to that those people who listen to me on satellite. That’s unmeasured. If people listen on my website, that’s not measured. I’m a big proponent of iHeart-Radio, but that’s also unmeasured. What we have is a situation where, especially in big cities, it’s almost impossible to get an AM signal, and for the people listening to my show, and they are, there is no way that we can get credit."  Hannity says. he knows for a fact he has millions of online listeners. "I have never seen it below a couple of million people. Ever. This is not a small issue. This is a massive issue."

Sean was an early believer and user of PPM and spoke in 2007 to the annual consultants' fly-in about how he was using the Media Monitors and custom audience flow reports tracking of his show to hone content, so I can testify that he's an extremelty knowledgeable voice on the subject who has been digging deep into PPM data from the beginning.


Also, the responses to his views on Radio Ink's website are generally chirping in agreement:

The current reporting method stations are using for on-line listening is difficult to work with or believe at best. This problem requires a good solution from Nielsen...now.
- Dick Kalt


I say again -- add PPM encoder to your internet streams. This is not shocking revelation.  Parsing streaming server logs is also a trivial matter, albeit you don't get the same demographic data as PPM.
- Joe Cassara

This is an "Elephant in the room" issue for radio. What exactly is being done about it? Nothing yet.
- Iconoclast


For the first time in my life, Hannity and I agree on something. To the earlier comment, server logs are flawed too and subject to manipulation. - Fred Lundgren

I have written about this shortcoming, citing what Canada's BBM is doing for genuine cross-media measurement.  When ARB was radio and Nielsen was TV, using server logs was the only option open to Arbitron.

Now that Nielsen measures both TV and radio with PPM, they can do much better than 6%, as Sean Hannity clearly understands.

Tuesday, April 08, 2014

You Go First

Sean Ross (Why The Audience Now Wants Shorter Breaks) initiated not just a great conversation last week but the savvy and experienced folks adding comments since that time simply can't be ignored!

However, I'm not yet convinced.

Back when John Hayes ran Corus and Canada was just starting with PPM, with the help of the brilliant Bob Michaels (I STILL miss him so much - a smart researcher and a wonderful communicator!), all Corus stations were mandated to do six two minute breaks and promote that they go back to the music faster than anyone else.

Finally, after more than a year of disappointing ratings all of the Corus music stations went to two six minute breaks per hour and the ratings improved almost immediately across the board.

In Canada, BBM doesn't use "five minutes equals a quarter hour" as Nielsen Audio does, so it's absolutely a "most minutes" wins game and all of the Canadian country stations we work with are doing exceedingly well right now sticking with the "hour glass" or "bow tie" approach, so I'm welcoming anyone else who wants to take the Edison Researcher's advice and "go first."

My sense is that this is a case of perception vs actual habits.

TV commercials are all run at the same times so that viewers then are forced to choose their favorite shows based on the content not the commercial load and I believe that the same is true with radio when the measurement is PPM.

The major consolidated US group owners have shown me by their actions in PPM that it's possible for one station to play at least one minute more commercial time than a direct competitor and still win by carefully placing their clusters to maximize the time measured by the PPM, which like your cell phone "knows what time it is," so a few seconds can be the same as a minute depending where a tune-in or tune-out happens.  Thanks to Nielsen Audio's editing rules, that minute in the right place can be credited as a full quarter hour (or also cost you one if it's improperly placed).

Perception still drives expectations, which does make listeners go to one station "first" over another, but when at that station "time matters" much more than perceptions, I maintain.  Great content drives usage in the moment much more than the image that if I am patient I'll hear more of what I want in the long term.

Each "stop" causes a huge loss in the "switcher" audience and the more times per hour that happens the stronger that image of "it's worth waiting for something terrific" must be, my current experience still indicates.

How about you?  Ready to go first?

Monday, April 07, 2014

Becoming More Memorable

Increasing top-of-mindness:

1.  Find out which of your personalities your listeners know on an unaided basis.
2.  Test your programming features and stress the "benchmarks" among them.  Which ones can listeners name as a reason they listen to you?
3.  Find out of the core artists you play most bring your brand to mind for target listeners more than any other radio station.
4.  Proudly stand for values and attitudes your audience relates to.

Be certain that these 'benefits' can be described (as Lovemarks) on an unaided basis by as many members of your potential coalition as possible when compared to other radio stations they also use.

Friday, April 04, 2014

If You Can't Measure It, You Can't Change It

If your goal is to lower your levels of phantom cume and you're not a PPM market, how do you find out how much lost listening you have now?

1.  Conduct a phone survey that includes an open-ended question asking "what's your favorite radio station?"

2.  Then, later in the same survey, ask all of the target listeners to choose their favorite radio station from an aided-recall list of all the stations you compete with.

3.  The difference between the percentage of the sample to name your radio station on an unaided basis and the ones who choose you from the aided list is a good indication of your phantom cume.

Once you have that number you can test various ways to improve your "top of mind memorability" and redo the same survey several times annually to see what works.

Improve your unaided recall and you will increase your ratings.

Wednesday, April 02, 2014

Low Hanging Fruit

Phantom cume is real.  PPM proves it.

As noted here last week, the average radio station's cume almost doubles under PPM measurement.

If your radio station is measured by diaries, it seems that roughly half your audience simply forgets (or doesn't care enough about what they hear) to write down listening they actually did to you.

Ponder this:

If you could help them remember all of the usage they actually do, you could double your cume audience without spending a dime in marketing!

Friday, March 28, 2014

It's The Panel

After more than a half century of radio ratings diary measurement, we have all become accustomed to certain metrics.  The arrival of PPM over the last decade has changed the math completely.

For the average country station still being rated by diaries this ratio remains quite constant:  a little more than one third of diarykeepers account for almost three quarters of average quarter hour audience. 

For that reason, radio's research companies have learned that a random probability sample composed of about 60% of a station's "core" (P1/heaviest users) and some 40% of that station's cume as found at random in a metro population provides a reliable indication of how that broadcaster is going to do in the next diary survey.

When PPM started to roll out in the top 50 U.S. and Canada's major markets over the last decade that formula no longer "worked."  Many radio stations back when their first PPM ratings were released were unpleasantly surprised to find out that performing extremely well in a traditional perceptual research project fielded with the time-honored sample parameters was no predictor of PPM scores!

Six years ago at the annual December programming "fly-in," Nielsen Audio's clever research crunchers revealed new insights into emerging major market panel samples that still help explain why that may have been happening:











  • Unlike in diary measurement where lighter users often fail to report their usage, PPM captures it all, so instead of the vast majority of AQH audience coming from heavy users, it's more of a 50/50 proposition.  
  • Roughly half of all radio average quarter hour ratings now reflect extremely light, "drive by," perhaps even unintentional use.  Those people listen an average of under three minutes per occasion, bringing average "time spent exposed" when down when compared to diary driven data.
  • Heavy users (P-1's) are still in the sample, accounting for about half the usage of the average radio station's shares.  Their average occasion is ten+ times as long as the other half of the sample, typically something like 35 minutes.
  • PPM also shows that those heavy users listen to about twice as many radio stations in an average week that they would have written down, on average, when they filled out a listening diary.
  • Savvy programmers and researchers have now had more than six years to fully understand these new dynamics and our ability to project results has been improving, but there is still much to learn, but it's important to keep in mind that actual listening has not changed.  
  • You can get the about the same number of quarter hours by targeting either group or many more than you did in diaries if you can find a way to bridge the gaps and constantly satisfy both of them.
  • Listeners still perceive and make use of radio in the same ways they always have.  It's the measurement techniques and the sample that changed, requiring new usage tactics and perceptual-driven strategies.

Wednesday, March 26, 2014

Do Perceptions Drive Usage?

The company now known as Nielsen Audio has been using diaries to measure radio and television audiences for 55 years now and it's unquestionable that the memorability, partisanship and top-of-mindness which make a person remember a listening occasion long enough to write down when it started and when it stopped as well as the station's "call letters, dial setting or name" can be predicted accurately by measuring listener perceptions.  However, this is prone to mistakes and forgetfulness, as well as subjectivity.

So, along came PPM, with its promise of more granular actual usage data of a panel that remains fairly consistent for several years.

A compelling case for moving to PPM has been driven by many factors - beyond the mere fact that today's audiences are increasingly unwilling to take time to fill out and send back printed diaries - not the least of which is that almost every single radio station's weekly cume audience almost doubles when actual usage is the measure rather than just the ability to be remembered.

PPM proves a long-held belief that Phantom Cume exists.  Roughly half of radio usage is simply not measured by diaries because either the sample doesn't think that their usage was significant enough to take time to report or because they just didn't recall doing it.

Diary success is driven by something one major radio researcher terms "The Image Pyramid."  The stronger the most important images, the better you do.

PPM panel success requires an even higher stakes game.  Not only must you strongly hold all of the key brand images compared to the other radio stations and media choices available to your potential audience, you also have to execute in a granular level down to the minute. 

You may be a person's favorite radio station, personality or program, but if at this very minute you tune them out and another station starts doing something they love, you lose.

Everything that was important yesterday is still crucial, but now minute-by-minute usage has increased the stakes.

Thursday, August 15, 2013

What's Good For Public Radio, Is Good For You Too

"Essentially, we're raising the number of segments per hour," Arvid Hokanson, deputy program manager for KUOW tells Morning Fizz, in an attempt to keep up with the way audience surveys say people listen to radio—in short bursts, while they're making breakfast or in the car. "Our frequent listeners now are people who listen more times per day."

KUOW will effectively condense four hours of daily local programming into two.

Do the math.  If you want to keep up with a top-rated public radio station in PPM, it's time to say the same things in HALF the time!

Wednesday, December 05, 2012

Radio Success Is Easy Compared To Social Media

ARB's Jacquelyn Bullerman on Social Media at Arbitron Client Conference:

Success is easy to measure.  Audience growth.

Figure out what's broken and fix it.

In social, it's not that easy.  No goal can mean random acts of digital.  There is no "experienced social media expert."  Everyone is learning.

Strategy = why are we posting?

Are connections and relationships developing as you post?

Success is the pieces becoming a "whole."

Data is not a report card on your actions.  It's a compass on what's valued by your community.

President Obama hugging Michele, biggest on social was use of social media at it's finest - Data + Content + Goal.

Look beyond Facebook insights categories go look at what types of pictures or videos you posted or status the type of pic matters

New hires aren't groomed in overnights anymore. Most radio hiring is in digital department.

If your content isn't strong, it won't matter.

A great spoken word pitch that sounds like a live read must be reframed to take advantage of the internet.  Trim "keep listening for your chance to call to call in an win" BS.

Repackage content provider syndicated content to create engagement and insert yourself into that content.  You're not an RSS feed.  You want a personal relationship with your listener via your social media which drives broadcast radio, streaming or your website usage.

Figure out a way to be smoother than just always doing ads in social tactics.

Post in a way that says I care about you.  Share this with everyone you know, because I care about your community.

Invest money in your goals.  Too few radio companies are doing this.

What Share Will Move You Up To The Next Tenth Of A Rating Point?

ROI Media's Mark O'Neill at Arbitron Client Conference in Annapolis:

How much is a tenth of a rating point worth?

Track "Persons Using Measured Media" (PUMM) vs Your Audience Flow

Example:  clean up a station's 11:45 quarter hour by eliminating a stop set and moving those units into other breaks resulted in rating point growth from a .5 to a .6.  Just doing this at a time when total radio audience (cume) is going up, got the station up to a .8 after several months of having done this.

Example #2:  5:15 pm.  Took commercials out of the 5:15 break and doubled the units in the 5:45 break.  Stopped only once that hour and within two months that quarter hour had almost doubled and the long stopset at 5:45 took down the rest of the daypart.  However, since the market's PUMM was also going down at that time as opposed to earlier in the 5 pm hour, they went from a .3 to a .6 in the daypart with just that one stopset change.

A little inside baseball from JA:  A&O&B "Post-survey Box Scores" reports routinely contain this info for both all our PPM and diary markets for this reason.  Clean out the highest/growing market audience quarter hours and place clutter into quarter hours with dwindling market audience to improve the entire daypart.
The goal:  even out the station's audience flow quarter hour by quarter hour and avoid extreme "up" and "down" quarter hours.

Revenue goes down almost immediately when PPM rating points drop, but can often take several months for the revenue to catch up with audience increases. 

Lesson:  it's worth money to do what it takes to stabilize and grow rating points. Look for opportunities within your cluster where a nominal increase in AQH would yield a move up to the next tenth of a  rating point to optimize rating point-driven revenue.  That's when the programmer and sales are on the same page.

Urban PD panel (Skip Dillard, WBLS; Jason Kidd, WPGC and Jay Stevens, Radio One) Music Insights:

More from today's Arbitron Client Conference in Annapolis:
  • PPM = less "favors" for record promotion people.  There is no margin for error now.
  • Songs last much longer than 12 weeks and off
  • Fewer titles manage to cut through
  • Some titles hold up and grow even with 2,000+ spins on them
  • MScore, callout and online testing's larger samples can be apples and oranges.  As a result, sometimes MScore can offer opportunity for new things, but can also doom a song much more quickly than online testing methodology

PPM Five Years Later... What We've Learned

At the Arbitron Client Conference in Annapolis:

Doc Wynter, Urban Format Captain, Clear Channel:

Diary had us believing that they spent a lot of time with just us.  PPM provided a wake up call.  Now, we know they have been "unfaithful." 

We have to earn and deserve their time with us.

Today's audience is a lot different than when we were growing up and we need to not just understand them, but be compelling and interesting enough to engage them, involve them.  Talent's natural tendency is to use what they learned as a point of reference.  That methodolgy and content are often dated.  PPM underscores that listeners only use what's relevant to them, not relevant to you.

Due to emerging technology it has been much more difficult to get a message across than in the past.  Competition for attention is greater than ever.

Time spent per occasion, we now know, is 8-10 minutes.  Remember when we used to believe that they listened for 8-10 hours a week?

Experiment.  Challenge the established rules.  Maybe it's five powers an hour, not four.  Measure the effects of the changes.  Be strategic when you experiment.

If you get positive ratings results, know how your got there.

Bill Rose, VP/Arbitron:

Diaries:  you need to cut through perceptually and ultimate translate that changed perception into ratings.  It would take months and months.

Now, with PPM:  it's still driven by perception, the bigger picture.  What motivates them t tune in.  You have to win "the off" before you win "the on."

What cuts through?  "Positioning The Battle For Your Mind" and "22 Immutable Laws Of Marketing."  Two must have books, from Ries and Trout.

You must know:

What is your station known for?  Can listeners identify that?
Does the station have a leadership position in that category?
Do listeners know who the station is for?

Position = what your station is known for.  (75% of your ratings)
Execution = the sum of the little things does right (25% of your share)

Be 60% of "something."  FOCUS.  Don't become too narrow focused unless your sure that the "hole" is large enough to drive the cume you need.

Weekly reports have the same sample size as monthlies, so change comes FAST.  Just like reality.

And, just like with reality, you need to be prepared to react equally quickly.

Make a mistake in one week in diaries, it's 1/12th of the survey.  Every minute counts in PPM.  The good stuff shows us.  So does the bad stuff.  And, either way, it will show up in the ratings right away.

Balance selectivity vs stationality.  That's what programming judgement is about today.

When PPM first started, midday was the highest-rated daypart.  Now, five years later, it's afternoon drive.  Peaks at 7-8 am and 3-5 in the afternoon.

PPM rating generators:  61% of full time working (down from 69% five years ago)

P-1 listeners are still crucial:  42% of daily cume generates 59% of the AQH in PPM for the  country format.

PPM secret from the Urban PD's panel, which followed Doc and Bill's presentations:  "today, it's all about 'now and next,' what's happening now and what's going to happen next."