Measuring success both externally and internally
1 / 41

Measuring Success: - PowerPoint PPT Presentation

  • Updated On :

Measuring Success: Both externally and internally . March 2003. SEARS, ROEBUCK AND CO. Agenda. Measuring external communication Linking public relations to sales Focusing on ROI Measuring internal change management communication Scope of the Conversion

I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
Download Presentation

PowerPoint Slideshow about 'Measuring Success:' - Pat_Xavi

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Measuring success both externally and internally l.jpg

Measuring Success:Both externally and internally

March 2003


Agenda l.jpg

Measuring external communication

  • Linking public relations to sales

  • Focusing on ROI

    Measuring internal change management communication

  • Scope of the Conversion

  • Measuring associate understanding and attitudes

  • Customer and financial measures

  • Conclusions

Keep it simple l.jpg
Keep it simple

Revenue - Costs = Profit

Simplifying further l.jpg
Simplifying further...

Marketing Communication

Media Relations

Events, Publicity, etc.

Revenue Increases

Crisis Communication

Investor Relations


Cost Control

Typically measurement l.jpg
Typically measurement...

  • Stops at awareness

    • Often stops short of awareness

  • Measures output. Not impact.

  • Is often compared to advertising

    • Ad equivalencies are the wrong measure

    • No measurement of impact, change in attitude or behavior

Do they believe l.jpg
Do they believe?

  • Businesses want to measure behavior change -- Are they buying?

  • Are customers buying your products and services?

  • Are employees buying your messages?

Clipping and message analysis l.jpg
Clipping and Message Analysis

  • Can be a useful management tool

  • Measures activity and output of PR group

  • Measures whether key messages are being seen

  • Helpful in gauging whether coverage is negative or positive

  • Identifies positive and negative bias of media

  • Can calculate cost per impression

  • But, it is not a measure of ROI or behavior change

Taking clippings further l.jpg
Taking clippings further...

  • Link to changes in awareness, preference or behavior (purchase)

  • What is the impact on revenue?

  • What is impact on cost control, associate attitudes or other intermediate measures?

Slide9 l.jpg

Effort that never

gets printed, broadcast

(0 impact)

Most people never

see the article or

hear the broadcast

(0 impact)

Budget funds PR



Those not in target

audience -

not likely to


(minimal impact)

Percent of wasted effort



and measurable)

Measure is circulation

or viewers


News Releases


Media calls, etc


(Difficult to measure)

Percentage of effort results in publicity

Target Audience

Consumers who see or hear the publicity and are

part of the intended audience for message

(difficult to measure, but assumed to be

a fraction of the circulation number)

Businesses keep score with $

What is the relationship between a $ invested in PR and

company revenue or profit?

No impact on


“I still won’t


Customers make purchase

Measure is revenue $

(SPRS report)

Consumers who take

action as a result, and

visit a store with intent

to purchase

(Traffic - no current

measurement device)

Consumers who have an

attitudinal shift --

“I will shop as a

result of that story”

(measurable-- Oprah and


Those who read

the article, intend to

shop, but never

follow through

Those who don’t

find what they

need or want

and make no


Subtract customers

who purchased without

benefit of the publicity

(test market vs. control

or incremental above

baseline) (AdEffect)

Subract cost of all investments,

leaving profit $ tied to PR program.

ROI is how much of this is generated

for every dollar invested at beginning

Measures existing

Does it work l.jpg
Does it work?

  • Can you identify changes along the path?

  • Is there a link between public relations events and revenue?

  • Two examples of how changes have been measured at Sears and how you can design a model for your business.

Background l.jpg

  • One placement on the Oprah show involved providing Christmas gifts for foster children in a small Texas community.

  • Sears provided all the gifts for 100 children

  • Oprah exclaimed “We love Sears!”

  • Can this be measured?

Sears is high quality company l.jpg
Sears is high quality company

  • Slight positive shift following the broadcast

  • 65% agree vs. 58%

  • Shift came from all rating levels

Sears does good things for community l.jpg
Sears does good things for community

  • Following broadcast saw a huge shift to positive on this question

  • Almost a five-fold increase in number of those agreeing completely

Plan to shop sears for holiday l.jpg
Plan to shop Sears for Holiday

  • The show provided the incentive to move viewers from neutral to positive intent

  • Increased to 70% vs. 59% before show

I plan to shop at sears for the holidays l.jpg
“I plan to shop at Sears for the holidays.”

  • The Oprah PR placement provided the additional incentive needed to move some viewers from a neutral position to a positive intent to shop at Sears.

    • Neutrals dropped from 73 respondents to 52, and somewhat negatives dropped from 29 to 18.

      • The strongest negatives remained the same.

    • The positive side of the intent to shop increased from 178 to 210 respondents.


Estimate what you ll spend at sears during this holiday season l.jpg
…estimate what you’ll spend at Sears during this holiday season.

  • We saw earlier there was a positive shift in the number of people saying they planned on shopping at Sears.

    • About 10% increase in positive intent.

  • If we assume the mid-point for each range, and $600 for the over $500 data, then these 300 respondents represent an average of $195 per respondent after seeing Oprah, versus $140 before.

    • An increase of +39% per shopper in the amount they estimate they’ll spend at Sears.

Percentage of Respondents

What was the impact l.jpg
What was the impact? season.

  • Shift in attitude led to planned spending increase of $40-million

  • Discounted by 2/3 to account for intentions that never come to fruition, the actual spending increase may be about $13-million

  • Subtract costs and calculate ROI

Fashion footwear and nyt l.jpg
Fashion Footwear and NYT season.

  • January feature placement in New York Times -- New York/New Jersey edition

  • What was the impact in that market vs. a control market and vs. national?

Fashion footwear results l.jpg
Fashion Footwear Results season.

  • Week following placement NY and NJ markets were up vs. year ago.

  • Chicago down

  • National down

Footwear conclusions l.jpg
Footwear Conclusions season.

  • A single placement in a credible publication made a dramatic difference in sales compared to both national and comparable market

  • The only variable that changed that week was the New York Times placement

  • Translated into measurable dollars

  • Cost of placement vs. incremental revenue increase gives ROI

Connecting the dots l.jpg
Connecting the dots... season.

  • Two examples measure the impact of single “communication events” -- not the cumulative impact of entire program

  • The right events can have a significant positive impact

    • Activities and events which do not have positive impact are suspect

  • Impact can be either a shift in attitudes or actions

Measuring internally l.jpg
Measuring internally season.

  • Can the same principles be applied to an internal audience?

  • How do you define success in a large change management communication program?

Background24 l.jpg
Background season.

  • In late 2001 in Full Line Stores…

    • Announced 4,000 layoffs

    • Announced Productivity Improvements

    • Sears. Where Else? introduced

    • Morale is not at an all time high

Conversion objectives l.jpg
Conversion Objectives season.

  • Improved customer satisfaction

  • Easier to shop

  • Easier to operate and easier to support store model

    • Clear lines of accountability throughout the organization

    • Improved execution on in-stock, in-store marketing, customer service

    • Improved profitability

Communication principles l.jpg
Communication Principles season.

  • Open and honest

  • Share information as soon as it’s available

  • Focus on key audiences, while making information available very broadly

  • Credibility is key

    • No sugarcoating

    • No promises we can’t keep

    • Focus on the end result and how to get it

  • Use existing communication channels where possible; emphasize personal communication

Communication objectives l.jpg
Communication Objectives season.

  • Gain alignment among senior management for the changes that will be necessary

  • Create high awareness and understanding for:

    • Why change is needed

    • What changes will be made and why

  • Win support for the dramatic changes, despite announcements of layoffs and new job descriptions and accountabilities

  • Focus on new model: easier to shop, easier to operate

Communication tactics l.jpg
Communication Tactics season.

  • Identify and leverage credible channels

  • Senior leadership meetings - FLST initiated

  • One-on-one meetings with leadership

  • Town Hall meetings (existing and new)

  • PMO Website

  • Regular features in S Journal, S Update

  • Training meetings and support materials

  • Detailed conversion manuals

  • Communication materials provided to DGMs for cascading through stores organization

Communication tactics cont d l.jpg
Communication Tactics (cont’d) season.

  • Issues and questions fielded in multiple ways, with response ASAP

  • Video Updates to field midway through conversion

  • In-store meeting materials for consistent messaging

  • Input into training materials to reinforce new store model of excellent customer service

  • Ongoing communication through newly defined MAP and Weekly Updates

Measurement l.jpg
Measurement season.

  • Baseline MOC results reviewed

  • Key questions pulled for ongoing pulse surveys

  • Surveys following major communication events

  • Weekly review of Q&A and Issues raised to identify gaps in communication program

  • Informal discussions within stores organization

    • Didn’t overreact to anecdotal information

    • Checked feedback against data

Performance improvement program l.jpg
Performance Improvement Program season.

Projects that have a direct impact on the store were grouped together into a synchronized field “Conversion” calendar


Supply Chain


Store & Field


  • Ad Production

  • PromotionalProfitability

  • Flow Optimization

  • Integrated Order Management

  • Liability Inventory

  • Lands’ End Initiative

  • Covington Roll out

  • Center Core

  • Home Fashions

  • Footwear

  • Appliances

  • Store & Field Organization

  • Store Activity

  • In Store Marketing

  • Labor Management

  • Sign Creation

  • e-Learning

  • e-Recruiting

  • Associate Services

Conversion scope l.jpg

Store Structure season.

District Structure

Region Structure

Number of Stores

Center Aisle Cashwraps ALL

Signage and Fixturing ALL

Four Zone Merchandising ALL

Appliances 101

Center Core 543

Home Accents 557

Mattresses 32

Men’s Big and Tall 349

Open Sell Shoes 216

Tool Territory 149

Merchandise and Customer Assist

Consultative Selling

Center Aisle Cashiering

POS Signing

Ad Setup/Take-down



Liability Merchandise

Labor Management



Conversion Scope

Field Organization

Service Levels

Activities and Processes

Store Environment

Note: initiatives will be implemented in all stores except where a specific number is given

Communication output l.jpg
Communication Output season.

  • PMO website has had more than 2-million hits during conversion; Of the 24,000 visitors 23,000 are from the field.

  • PMO base conversion has been successfully implemented, and has been widely supported

  • Articles every month in corporate publications

  • Communication is becoming embedded as a core leadership responsibility in the stores organization

  • Web site is becoming an operational tool more than information only tool

Communication results associates l.jpg
Communication Results - Associates season.

  • Associate attitudes (all store associates) are more positive than they have been since 1998.

  • Understanding of strategy is higher than it has ever been.

Store management is even more positive l.jpg
Store management is even more positive ... season.

  • Assistant Store Managers and hourly leads feel good about the future, believe we are making the changes necessary to compete, and understand our strategy.

Customer feedback is also encouraging l.jpg
Customer feedback is also encouraging season.

  • Customers reacted favorably to the new store environment

  • Store revenues were on target for Holiday

Slide38 l.jpg

Financial Benefits are on track season.

  • Conversion costs stayed on budget

  • Field operating costs met planned savings

  • Capital expenditures within budget

  • Communication had no incremental budget increase

  • Full Line Store profitability is up more than 30%

  • Sears posted record earnings in 2002

Productivity l.jpg
Productivity season.

  • Objective is to create a culture of continuous productivity improvement

  • Ongoing process of continuous improvement in efficiency and effectiveness

  • Ultimately, time will tell

    • Can we continue to improve both customer satisfaction and productivity?

Conclusions l.jpg
Conclusions season.

  • Looking at measurement from the perspective of the CEO will help clarify what’s important

  • Establishing a logic model for communications and measurement of results is good start

  • Building evidence over time will help improve ability to make fact-based decisions about public relations and communication investments

  • In some areas (such as marketing public relations) we can remove the mystery of the craft and earn respect of management team on their terms

  • There is still much to do

Slide41 l.jpg

Questions? season.

Tom Nicholson

Sears, Roebuck and Co.

[email protected]