« Implications of Strategic Partnerships: mFoundry & Firethorn Team with Big Players | Main | FINOVATE 2007 Conference to Showcase the Future of Online Personal Finance, Banking and Lending in Fast-paced Demo Format »

Measuring Success for Social Media Projects (part 2)

By William Azaroff on August 14, 2007 3:45 PM | Comments (8)

Note: Part one of this series can be found here.

On blogs I visit discussing social media, one ongoing debate concerns metrics. Some claim that metrics for social media projects are not meaningful; some claim that new metrics must be developed to gauge social behaviour. Some even claim that metrics aren't needed.

I believe that it is essential to have meaningful key-performance indicators in place for a social media project, as you would for any other project. You must know what success will look like to know if the project is worth repeating or not. Some of these metrics are familiar Web metrics, some are more similar to offline advertising, some are similar to PR metrics, and some are indeed brand new and hard to measure.

For ChangeEverything.ca we measure a few things that are familiar to anyone who runs a website:

  • Unique visitors
  • Time on site
  • Referring URLs
  • Natural search results
  • Number of registered users
  • Number of active users (need to define for yourself)

We also measure "Web 2.0" stuff:

  • Our Technorati authority ranking
  • The number of RSS subscribers
  • Conversions of visitors to contributors (people who make it through the registration or content-creation funnels)

Like offline media, we measure how many people in our geographic region are aware of the site, just like we track awareness of our television campaigns. We also measure how many can link it back to our brand.

Like our PR, we try to measure the earned media the site has garnered for us, which has been significant, with lots of positive coverage on TV, radio and newspapers. We also keep track of what bloggers say about us. We consider a blogger writing positively about ChangeEverything.ca to be an unsolicited third-party endorsement. Happily, almost all blog posts so far have been positive, as have our earned media. It's difficult to criticize this project since most press coverage is about how the site has helped the community in some way. And that leads us to the most interesting metric by far.

Where we need new metrics is on the issue of real-world impact. This was not a metric we had in place prior to launchhonestly, it never occurred to us. But it became necessary because of activities happening in the real world (remember that?) due to the influence of the site. The first time this became obvious was after a bad snowstorm Vancouver in November 2006. The site's amazing community moderator Kate created a post called Got Hats? and asked for people to donate warm clothing and blankets to the homeless. This initiative took off and over the next few days, we estimate that more than 4,000 pieces of clothing, blankets, pillows, and, yes, hats were donated to local shelters, all via communication and organization on the site. The change occurred while snow was still on the ground, while the need was still very real, and even a matter of life and death. It was the first clue that we were onto something truly important.

 

There are many positive traits the site lends to the Vancity brand. ChangeEverything.ca is more than a bunch of people discussing local issues they want to change. The site has created real impact in the communities Vancity serves. Since the Got Hats? episode, we have seen the impact of the tremendous exposure a woman on the site has received for blogging in depth about her valiant attempt to give up plastics in 2007, the successful implementation of a bike share experiment in Vancouver and now a contest where people can win $1,000 to give to an organization making change for the good (appropriately called ChangeSomething).

Traditional Web metrics can't measure the human terms of this impact, and that's the beauty of social media. It spills over into people's lives, because people are in the driver's seat. We need to expand our view of key performance indicators for social media so they reflect the project's success, which now includes the true impact of these projects on our communities.

I think that explains why those of us who advocate for the appropriate use of social media are so passionate about our work.

William Azaroff is the interactive marketing & channel manager at Vancity where he develops interactive marketing initiatives, and pioneered ChangeEverything.ca, the groundbreaking change-themed online community. William also plans strategy for the online channel, with a view to its potential to help Vancity, its members and the community. William brings nine years of experience in Vancouver, Seattle and Los Angeles producing Web projects for such clients as Honda, Disney, Intuit Canada and Nike Jordan. He writes about the intersection of online branding, social media and the world of banking on his blog at azaroff.com/blog

 

Comments (8)

Most Recent Posts:

TrackBack

TrackBack URL for this entry:
http://www.netbanker.com/cgi-bin/mt/mt-t.cgi/1448

8 Comments

Great post, William. We take a similar approach at Wells Fargo with our own "engagement index", which we measure as a ratio of the posts we publish and the activity we see, as measured by comments posted bt readers, back-channel email, visits, mentions on other blogs and press.

I love your "real world" examples of success.

Thanks Ed. It's great to get a sense of how others are measuring success. There's so much talk about measuring ROI, but for some of these projects the success measures are different from traditional ROI.

Great post William.

This is the exact problem faced by many social organizations - how to measure social impact.

This is what we're working on at the Demonstrating Value project over at the Vancity Community Foundation. How do you measure social change and demonstrate social value? It is an incredibly nebulous undertaking, and one that is also, sadly, very resource intensive.

I've been looking at some of the popular tools out there, which may or may not be of value to you:

Social Return on Investment is a popular method of monetizing the social impact of activities, and is an effective way (if you have the resources) to not only monetize the societal benefits of activities, but to construct a transparent narrative of your activities that helps you communicate to investors (perhaps in your case managers who provide budget), and stakeholders the value of your mission.

Logic modeling is another good way to evaluate the effectiveness of particular programs.

And I've seen Balanced Scorecard used at the Enterprise level alot, though perhaps not as applicable to ChangeEverything.

You may be familiar with all of those already - if so, please disregard this :)

Jeremy

Thanks Jeremy. Can you tell me more about Social Return on Investment? I haven't heard about that. I always appreciate your comments.

Hi William - I sent you some stuff via email. Let me know if you find it useful. Cheers.

Thank you William- very interesting. I'd like to receive the information Jeremy sent you if possible. Looking forward part 3!

Hi Caroline. I've been meaning to go through these links and write about them, but I haven't had a chance. Here are the links Jeremy sent me:

http://www.redf.org/publications-sroi.htm
http://www.proveandimprove.org/new/tools/sroi.php
http://www.sel.org.uk/journal.html

I'd like to know what people think of these.

Thanks William! I'll send you feedback once read ;)

Leave a comment

Sponsors

WorkLight Yodlee IntelliResponse Wesabe


Sponsored Links

Events

  • FinovateSpring 2010 -- Dozens of handpicked fintech companies demoing their newest innovations in the entrepreneurial hotbed of San Francisco. 7 minutes each on stage to demo. No slides. A single value-packed day on 5/11/2010. Get your early-bird ticket today!

  • FinovateFall 2010 -- Dozens of handpicked fintech companies showcasing their latest & greatest in the financial capital of the world -- NYC. 7 minutes each on stage to demo. No slides. A single value-packed day on 10/05/2010. Get your early-bird ticket today!

Research

  • NEW! Making the Case for Person-to-Person Payments: Does mobility provide the tipping point for bank-branded P2P? - Find out more
  • NEW! Attracting Small Businesses with Online & Mobile Banking: Underserved segment is prime candidate for alt-delivery - Find out more
  • 2010 Guide to Online & Mobile Banking Products, Pricing & Strategy: Your roadmap for business planning - Find out more
  • Improving Online Account Opening ROI: Ten strategies to increase online application conversion rates - Find out more
  • Connecting to Customers with Twitter: The comprehensive guide to Twitter for financial institutions - Find out more
  • Selling behind the Password: Leveraging the marketing potential within online banking - Find out more
  • New Techniques in Secure Online Finance: Sandboxing, keyboard encryption, and real-time mobile integration could lock in more online customers- Find out more

Products & Services

  • Online Banking Services: Compare online banking services and savings rates from the leading financial institutions at Credit.com.

 

   

RSS Subscribe via RSS
RSS Subscribe to Comments



Email:


@NetBanker Twitter Feed



See all @NetBanker tweets

Most Recent Comments


anonymous commented on Launching: HelloWallet is First New PFM of 2010

Hildebrand, The Insurance Warden commented on Mobile Firsts: State Farm Offers Auto Insurance Discounts to Graduates of its Steer Clear iPhone App

David commented on USAA Makes Mobile Banking Better than Online Banking

Suman commented on PNC Bank Takes on Mint & Quicken with PNC Virtual Wallet

Kevin Lynch commented on Twittering Vantage Credit Union Taps Geezeo for Online PFM

Amad Ebrahimi commented on Great Recoveries: Major Banks Respond to Negative Blog Items Immediately