Note: Part one of this series can be found here.
On blogs I visit discussing social media, one ongoing debate concerns metrics. Some claim that metrics for social media projects are not meaningful; some claim that new metrics must be developed to gauge social behaviour. Some even claim that metrics aren't needed.
I believe that it is essential to have meaningful key-performance indicators in place for a social media project, as you would for any other project. You must know what success will look like to know if the project is worth repeating or not. Some of these metrics are familiar Web metrics, some are more similar to offline advertising, some are similar to PR metrics, and some are indeed brand new and hard to measure.
For ChangeEverything.ca we measure a few things that are familiar to anyone who runs a website:
- Unique visitors
- Time on site
- Referring URLs
- Natural search results
- Number of registered users
- Number of active users (need to define for yourself)
We also measure "Web 2.0" stuff:
- Our Technorati authority ranking
- The number of RSS subscribers
- Conversions of visitors to contributors (people who make it through the registration or content-creation funnels)
Like offline media, we measure how many people in our geographic region are aware of the site, just like we track awareness of our television campaigns. We also measure how many can link it back to our brand.
Like our PR, we try to measure the earned media the site has garnered for us, which has been significant, with lots of positive coverage on TV, radio and newspapers. We also keep track of what bloggers say about us. We consider a blogger writing positively about ChangeEverything.ca to be an unsolicited third-party endorsement. Happily, almost all blog posts so far have been positive, as have our earned media. It's difficult to criticize this project since most press coverage is about how the site has helped the community in some way. And that leads us to the most interesting metric by far.
Where we need new metrics is on the issue of real-world impact. This was not a metric we had in place prior to launch—honestly, it never occurred to us. But it became necessary because of activities happening in the real world (remember that?) due to the influence of the site. The first time this became obvious was after a bad snowstorm Vancouver in November 2006. The site's amazing community moderator Kate created a post called Got Hats? and asked for people to donate warm clothing and blankets to the homeless. This initiative took off and over the next few days, we estimate that more than 4,000 pieces of clothing, blankets, pillows, and, yes, hats were donated to local shelters, all via communication and organization on the site. The change occurred while snow was still on the ground, while the need was still very real, and even a matter of life and death. It was the first clue that we were onto something truly important.
There are many positive traits the site lends to the Vancity brand. ChangeEverything.ca is more than a bunch of people discussing local issues they want to change. The site has created real impact in the communities Vancity serves. Since the Got Hats? episode, we have seen the impact of the tremendous exposure a woman on the site has received for blogging in depth about her valiant attempt to give up plastics in 2007, the successful implementation of a bike share experiment in Vancouver and now a contest where people can win $1,000 to give to an organization making change for the good (appropriately called ChangeSomething).
Traditional Web metrics can't measure the human terms of this impact, and that's the beauty of social media. It spills over into people's lives, because people are in the driver's seat. We need to expand our view of key performance indicators for social media so they reflect the project's success, which now includes the true impact of these projects on our communities.
I think that explains why those of us who advocate for the appropriate use of social media are so passionate about our work.
William Azaroff is the interactive marketing & channel manager at Vancity where he develops interactive marketing initiatives, and pioneered ChangeEverything.ca, the groundbreaking change-themed online community. William also plans strategy for the online channel, with a view to its potential to help Vancity, its members and the community. William brings nine years of experience in Vancouver, Seattle and Los Angeles producing Web projects for such clients as Honda, Disney, Intuit Canada and Nike Jordan. He writes about the intersection of online branding, social media and the world of banking on his blog at azaroff.com/blog
Most Recent Posts:
- Press/Blogger Coverage of Finovate Startup - May 02, 2008
- FinovateStartup Best of Show Winners Announced - Apr 30, 2008

Comments (8)
Great post, William. We take a similar approach at Wells Fargo with our own "engagement index", which we measure as a ratio of the posts we publish and the activity we see, as measured by comments posted bt readers, back-channel email, visits, mentions on other blogs and press.
I love your "real world" examples of success.
Posted by Ed Terpening | August 15, 2007 8:07 AM
Posted on August 15, 2007 08:07
Thanks Ed. It's great to get a sense of how others are measuring success. There's so much talk about measuring ROI, but for some of these projects the success measures are different from traditional ROI.
Posted by William Azaroff | August 15, 2007 8:27 AM
Posted on August 15, 2007 08:27
Great post William.
This is the exact problem faced by many social organizations - how to measure social impact.
This is what we're working on at the Demonstrating Value project over at the Vancity Community Foundation. How do you measure social change and demonstrate social value? It is an incredibly nebulous undertaking, and one that is also, sadly, very resource intensive.
I've been looking at some of the popular tools out there, which may or may not be of value to you:
Social Return on Investment is a popular method of monetizing the social impact of activities, and is an effective way (if you have the resources) to not only monetize the societal benefits of activities, but to construct a transparent narrative of your activities that helps you communicate to investors (perhaps in your case managers who provide budget), and stakeholders the value of your mission.
Logic modeling is another good way to evaluate the effectiveness of particular programs.
And I've seen Balanced Scorecard used at the Enterprise level alot, though perhaps not as applicable to ChangeEverything.
You may be familiar with all of those already - if so, please disregard this :)
Jeremy
Posted by Jeremy | August 15, 2007 9:44 AM
Posted on August 15, 2007 09:44
Thanks Jeremy. Can you tell me more about Social Return on Investment? I haven't heard about that. I always appreciate your comments.
Posted by William Azaroff | August 15, 2007 9:58 AM
Posted on August 15, 2007 09:58
Hi William - I sent you some stuff via email. Let me know if you find it useful. Cheers.
Posted by Jeremy | August 16, 2007 1:15 PM
Posted on August 16, 2007 13:15
Thank you William- very interesting. I'd like to receive the information Jeremy sent you if possible. Looking forward part 3!
Posted by Caroline Maerten | August 27, 2007 7:11 AM
Posted on August 27, 2007 07:11
Hi Caroline. I've been meaning to go through these links and write about them, but I haven't had a chance. Here are the links Jeremy sent me:
http://www.redf.org/publications-sroi.htm
http://www.proveandimprove.org/new/tools/sroi.php
http://www.sel.org.uk/journal.html
I'd like to know what people think of these.
Posted by William Azaroff | August 27, 2007 12:52 PM
Posted on August 27, 2007 12:52
Thanks William! I'll send you feedback once read ;)
Posted by Caroline Maerten | September 4, 2007 11:04 PM
Posted on September 4, 2007 23:04