Don’t take research find­ings at face value

You are always being encour­aged to know your donors, who they are and why they give. Research is a good way to learn this. But, warns Andrew Pap­worth, you should be sus­pi­cious if, like the find­ings here, full method­ol­o­gy isn’t given.

Written by
Andrew Papworth
Added
May 15, 2013

A great deal of publicity was recently given to the findings of some research carried out on behalf of a financial services company called Foresters UK by the Wriglesworth Consultancy. They produced a report called the Charitable Giving Index said to be based on an online survey of 1,100 adults.

On the face of it this seems to be a fairly robust sample but little information was given about the methodology. It turns out that they sent out 11,000 questionnaires by email to people who had agreed to participate in online surveys and got about a 10 per cent response.

For some issues this may be adequate, but Wriglesworth/Foresters chose to major on the differences in giving between over 65s and the rest of the population.

As the top chart on the right shows, their figures claim that over 65s are giving 70 per cent more than the average this year and expect to give about four per cent more next year compared with a more or less static average. They went on to express the average giving as a percentage of average incomes as reported by the Office for National Statistics, claiming that the average was 0.3 per cent but that over 65s gave 0.7 per cent (see image below).

A great deal of publicity was recently given to the findings of some research carried out on behalf of a financial services company called Foresters UK by the Wriglesworth Consultancy. They produced a report called the Charitable Giving Index said to be based on an online survey of 1,100 adults.

On the face of it this seems to be a fairly robust sample but little information was given about the methodology. It turns out that they sent out 11,000 questionnaires by email to people who had agreed to participate in online surveys and got about a 10 per cent response.

For some issues this may be adequate, but Wriglesworth/Foresters chose to major on the differences in giving between over 65s and the rest of the population.

As the top chart on the right shows, their figures claim that over 65s are giving 70 per cent more than the average this year and expect to give about four per cent more next year compared with a more or less static average. They went on to express the average giving as a percentage of average incomes as reported by the Office for National Statistics, claiming that the average was 0.3 per cent but that over 65s gave 0.7 per cent (see lower right-hand chart).

This backs up a strongly held belief of mine – the importance of ‘oldies’ to fundraisers and the dangers of relying on digital fundraising methods, which pass by many of them. So why do I think it is a piece of work that should be ignored?

The main problem with the Wriglesworth/Foresters research is that it is well established that over 65s have low access to the Internet and that even when they have access they are infrequent users using limited methods. It is inevitable, therefore, that those over 65s who participated in this survey will have been atypical of the majority of over 65s. So it is likely to be misleading to project their behaviour onto the whole age group.

Their higher than average giving is likely to be correlated with factors other than their age such as affluence, education, socio-demographic grade, etc, making nonsense of these findings.

To relate, as they do, the giving of these computer literate over 65 year olds to the incomes of all people over 65 is clearly barmy. Those 65 year olds with the technology, interest and skills to participate are by definition likely to have higher than average incomes for their age group, so their giving as a percentage of income is bound to be closer to the all-adult average.

Sadly there are too many sloppily conducted surveys in the sector. Too many companies and organisations think that an online survey is a good way to get some PR. Always be suspicious if they don’t include a full methodology – including response rate and sample profile – and a questionnaire.

About the author: Andrew Papworth

Andrew Papworth

After a long career in advertising agencies, Andrew Papworth has been freelancing as an advertising and communications planner for about two decades.

Recent Articles

Join the SOFII board - could you be our new honorary treasurer?

We are looking to recruit a new trustee with a passion for finance, who will also serve as our honorary treasurer and chair SOFII’s finance and resources committee. This vital role will help ensure our small charity is able to manage its financial resources strategically and prudently, so we can reach even more fundraisers around the world.

Read more

Direct mail clinics – Introduction and contents

Welcome to the Agents of Good (AOG) free direct mail clinics. These 11 useful video lessons offer you tried and tested tips that will make your direct mail appeals more engaging and effective. Please explore all the clinics and share them widely with your fundraising friends.

Read more

Direct mail clinic #1 – All about marketing

John Lepp kicks off his free clinics by explaining why direct mail is a phenomenal tool for fundraisers. He thinks it is the perfect way to start a conversation with your donor and raise more for good causes around the world.

Read more

Fundraising in India – Exploring why face-to-face continues to grow

As Gather Campaigns work to expand face-to-face (F2F) fundraising in India, Ryan Valasapali and Dominic Will explore the cultural similarities and differences that determine how F2F can grow in new, international markets.

Read more

Direct mail clinic #2 – Envelopes

In this direct mail clinic, John Lepp asks you to (please!) turn your attention to envelopes. They are one of the most misunderstood and often ignored parts of a fundraising appeal, but your envelope is key to ensuring a donor opens your pack and engages with what you have to say.

Read more

Also in Categories