Posts Tagged ‘metrics’

News Roundup: Kashf, Awards, J-PAL and the G20 SME Challenge

Friday, July 9th, 2010

Celebrating Social Metrics – Happy World Metrics Day!

Tuesday, June 15th, 2010

Pulse Measurement ToolIt’s that time of year again – time to celebrate World Metrics Day! Wednesday, June 16, marks the second annual celebration of social impact metrics! Learn more about the history of WMD.

Since the launch of WMD last June, Acumen has been in a perpetual state of celebration around impact measurement. It’s been an exciting year: the official launch of Pulse, the partnership with the App-X cloud computing experts, and even some early adopters to the system.

With generous support from a variety of foundations and Google engineers, Acumen built the web-based tool, Pulse, allowing portfolio managers to apply standardized pre-configured IRIS metrics or to create customized metrics to their investment analyses.

And last week, at the ANDE “Metrics from the Ground Up” conference in Washington, Acumen and Application Experts (App-X) formalized our relationship, making App-X the exclusive Pulse Manager. This means that our journey – which began in 2006 with our Chief Investment Officer and members of the Portfolio team lamenting the lack of a standardized tool to measure social impact, and white-boarding what an ideal tool would look like – has reached a significant milestone. Pulse is officially launched and available for broad use!

The excitement in Washington was palpable. Six pilot users have tested Pulse, and App-X has already signed on several new customers. With dozens more exploring how Pulse can be applied to their work, the momentum behind the tool seems to be capturing the field’s desire to improve how we collectively assess social impact.

In honor of World Metrics Day, we leave you with the catchy WMD slogan that surely is now catching on—Count something, and make it count!

Visit the following links to get involved and learn more about Acumen’s commitment to metrics.

App-X training on how to use Pulse:

  • Wed, Jun 16, 11:00am EDT
  • Wed, Jun 16, 3:00pm EDT

Acumen blog posts on the significance of metrics:

More information on GIIN and IRIS:

Lost in Translation: Tweets and Caring About Metrics

Tuesday, September 15th, 2009

At SoCap09 two weeks ago, I spoke on a moderated panel called “True Tales of Amazement and Horror from the Fundraising Circuit” with Don Shaffer, Shari Berenbach, Penelope Douglas and moderator Stuart Davidson. It was a great group – one I was honored to be a part of – and it was a successful panel in no small part thanks to Stuart’s questions.

One of those questions was directed at me; Stuart asked, “Do metrics sell on the fundraising circuit?” Must have been an ear-perking question, because my answer has been tweeted and re-tweeted a dozen times. Here’s how it came out, at least to the Twitter-verse:

@elizabethu: Brian Trelstad, Acumen Fund: our donors care more that we care about metrics than they care about the metrics themselves #socap09

As other tweeple picked up on this response, I’ve been mulling over the limits of 140-character messages; frankly, some important context got lost in translation. In retrospect, here’s what I was trying to get at, more or less:

I remember my corporate finance professor saying that valuing a public company was a combination of cash and hope. Cash flows from current businesses and hope for the future. Cash plus hope = corporate valuation. Start-ups and social enterprises are a little heavier on the hope than the cash in their early stages, but this is how you measure value in any enterprise. In our fundraising, in the early stages of our business and in the early stages of our field, we have also relied more on hope than cash in that these are early stage businesses with more promise than current performance. And when we go out to fundraise, our metrics are not really the selling point. So at this point, I think that our donors care more that we care about metrics than they care about the metrics themselves. But as competition increases and the field matures, I believe this will change and we need to be ready for some tough questions as a fund and as a field about the impact of our work and the social metrics.

This is also a riff on an article in the Stanford Social Innovation Review from back in 2004. In it, the authors cite research on high net worth individuals in venture philanthropy, concluding that the obsession with performance metrics is actually somewhat overblown, and metrics are not a gating factor for contribution decisions.

Hopefully that clarifies. Thanks for all the tweets, folks – and for caring enough about metrics to send 140-character musings out to the ‘verse. And as much as I can – which is not often – I tweet at @trelstad

Summer Spotlight: A Tale of Three “Summers”

Wednesday, August 12th, 2009

Mike McCreless is currently serving as a summer associate on the Portfolio team.  He is a joint-degree student at Harvard Business School and Harvard Kennedy School’s MPA-ID program. He has worked as a consultant for Monitor Company in New York, Madrid, Paris and Morocco, and as a Research Associate for Professor Michael Porter at Harvard Business School, where he wrote case studies and research notes about economic development in Rwanda, foreign aid and other topics.

A couple of years ago, Larry Summers gave a guest lecture at a class I was taking on international development. He delivered a fascinating 20-minute lecture as if reading it from a transcript in his mind’s eye, and then took questions for an hour. I asked him why foreign aid had delivered so much less ‘development,’ by any definition, than expected, and what should we be doing with our time and money instead?

He took a long pause, staring into space, and then said slowly that that was perhaps the most profound question in economics, causing me simultaneously to swell with pride and recoil at my own pretentiousness. He listed several of the standard arguments for aid’s ineffectiveness, but what really stuck with me was his contention that advances in technology, not foreign aid, would do most to eradicate poverty in the long run.

Well, that made sense, but I wasn’t sure what to do about it. It was not as if I had a stockpile of socially valuable technological innovations saved up for just such an occasion. I was a white twenty-something from the American ‘burbs, with no technological expertise and limited experience in Africa, but enough experience with the foreign aid system to give me misgivings about a career with the big multilaterals.

I didn’t have any technological innovations, but I did have ideas about how to make the foreign aid system more effective. Before enrolling in grad school, I spent time in Rwanda, researching economic development and in particular, the efforts of aid agencies on the ground. As I traveled around the country and met its people, I was astonished at the level of deprivation that they endured despite the vast inflows of aid. It appeared that aid had delivered surprisingly little ‘development,’ though of course the counterfactual might have been much worse. Moreover, the academic and popular press was awash with possibilities to improve the management practices of aid agencies. I hoped that better measurement of project outcomes, and alignment of organizational structures and staff incentives with those outcomes, would help donors and recipients alike get more out of the $100 billion spent on aid every year.

I am in a three-year program in which students work in internship programs during the two intervening summers. Last summer, I had the opportunity to test some of these ideas during an internship at a large aid institution. My role was to help design the next version of an internal system to track project outcomes. I worked with project managers to understand how they select projects, manage them over time, and measure their impact. I tried to assess the potential for better management practices at U.S. headquarters to improve results on the ground in Africa.

I also tried to understand the culture of the organization and how I might fit in. I tried to understand managers’ jobs, how they spent their time day-to-day, and more importantly, how they felt about their jobs. What did their work mean to them? Did they feel like they were making a difference? Did they believe that somewhere out there, in some forgotten urban slum or rural village, someone’s life was improved, their burdens eased by the work we did behind our desks in the U.S.?

During these conversations, I was often reminded of a quote from Liar’s Poker, Michael Lewis’ memoir of his time on Wall Street during the 1980s: “Goodness was not taken into account on the trading floor. It was neither rewarded nor punished. It just was. Or it wasn’t.” On a trading floor, this is as it should be, but I did not expect it to be as true of aid institutions in 2008 as it was of Salomon Brothers in 1987.

Many of the managers I spoke to care deeply about development, and think critically and often about whether their work actually helps anyone. Others wish they worked at a purely commercial enterprise, where they would not have to be bothered by concerns about social impact. To some, a job in the foreign aid system simply meant a comfortable life in the U.S. and enhanced status in the socio-political elite of their home country. Most staff simply assume that what they do helps people, without really checking to make sure. Their hearts are in the right place, and they have faith in the system to direct their efforts toward socially valuable ends. In fairness, it is extraordinarily difficult to know whether one’s activities in U.S. headquarters actually help anybody on the ground. I was nevertheless taken aback at how little people cared to find out.

I realized that my ideas about reforming management practices at aid agencies were a technocratic solution to a cultural problem. Managerial fixes such as systems to track results and incentive plans aligned with results help on the margins, but do not directly address the fundamental cultural issues that constrain the effectiveness of foreign aid.

For my second summer internship, I focused on smaller organizations that I believed shared my values, and my interest in experimenting with new modes of foreign assistance. To make a long story short, this June I found myself at Acumen Fund. The fourth day of my internship was “World Metrics Day,” declared as such by Acumen Fund and its partners to celebrate the progress they have made in measuring the social impacts of their investments. As we sat down to a World Metrics Day teleconference, Acumen Fund Chief Investment Officer Brian Trelstad turned to me. “World Metrics Day! What better way to inaugurate your first week!” He stared at me expectantly. I wasn’t used to this level of excitement about measuring social impact. I stared dumbly back, trying to figure out if he was joking or not, if I should laugh or nod. He has a wry sense of humor, but he wasn’t joking. The man really cares to know whether what he does actually helps anybody. It was going to be a different kind of summer.

I have spent half of my time working on a deal to use innovative biomass technology to electrify rural off-grid villages in India, and half of my time thinking about how to integrate the many approaches Acumen takes to measuring the social impacts of its investment. The biomass project has vividly demonstrated the potential for innovation to create tremendous social impact. This social impact may be difficult to measure, but Acumen Fund’s investment in impact measurement also demonstrates that an organization that truly wants to measure its impact can find a way to do so.

In the end, Larry Summers was right. My quest for an organization that was serious about high-efficiency social impact led me to an organization that invests in innovations—innovations not only in technology, but also in distribution and delivery of essential products and services to the poor.

On the surface it may seem like Acumen Fund, and venture philanthropy in general, seems to just be the hot new thing these days. They blog, and tweet, and use fancy words like ‘philanthro-capitalism.’ They are undoubtedly in fashion. That’s great, because it gets new people excited about the work they do. But look past all that. Acumen Fund could fall out of fashion tomorrow—no more headlines, no more keynote speeches—and what would be left is a handful of people who actually care whether what they do is valuable. Not to the blogosphere and the editors of The Economist, but to poor people in India, Pakistan, Kenya, Uganda and Tanzania. That is my experience of Acumen Fund this summer: a small group of people who are in it for the right reasons, a handful of villages in India that have access to clean electricity for the first time (and the prospect of bringing electricity to many more), and all for much less than it would have cost my former employer to accomplish the same. The fashion may fade, but the impact will remain.

Acumen Fund Launches WMD

Monday, June 15th, 2009

World Watches in Shock and Awe

Mark your calendars: June 16 (tomorrow) is World Metrics Day! Our declaration of an official World Metrics Day (or WMD, as we’ve been calling it) is a little (well, actually, a lot) tongue in cheek, but Acumen Fund’s commitment to metrics is absolutely serious. Figuring out how to measure social impact has long been a challenge for philanthropists, social investors, practitioners and the development sector. Our focus has been on finding ways to collect, understand and use data to (1) best support the enterprises in which we invest, (2) improve how Acumen Fund works and (3) create common measures for the sector – in that order of importance. (We’ve blogged here before about metrics, on what we like to call cost effective cost effectiveness and our best available charitable option methodology.)

If you follow our work, you know that we’ve been developing a platform called Pulse, discussed in BusinessWeek and The New York Times when it was announced last fall at the Clinton Global Initiative. Pulse helps social investors track, measure, and evaluate operational data to understand whether different approaches to solving the problems of global poverty are working. Although originally designed as a tool to help us manage our own portfolio, we’ve been working with Salesforce.com to make it available for adoption by peer organizations and to share data across the sector. We have also been collaborating with the Rockefeller Foundation, B-Lab, Deloitte and PwC to develop standard definitions of social and environmental performance that can enable comparability across portfolios (for more on this, see www.iris-standards.org). About forty organizations are currently testing Pulse, which we expect to be widely available to nonprofits later this year.

We chose June 16 as World Metrics Day for three reasons. First, last year on June 16th we convened a number of our partners and leading thinkers on the topic at the Rockefeller Foundation to map out our current strategy, and we are simply taking stock of where we have come in the year. Second, it’s Bloomsday, a day notable for its devotees’ commitment (obsession?) to a singular topic, perhaps the least linear novel ever written (Joyce’s Ulysses). Finally, it happens to be my father’s birthday (happy birthday, Dad!). My father is a pathologist and the naming of Pulse was inspired by the autopsy metaphor. Most measurement and evaluation in the social sector is like an autopsy: intrusive, inconclusive and too late to help. We wanted to build a metrics practice that could take the “pulse” of our investments, with simple but meaningful measures that can help us make course corrections real time.

So we will be spending the day thinking about and talking about and, indeed, celebrating metrics. Celebrate with us — June 16 is the first annual World Metrics Day. Remember, count something. and make it count!

Updated 6/18/2009 – thanks to Sara Olsen of SVT Consulting for her great blog post over at Social Edge on World Metrics Day. Count what counts, Sara!