Evaluate a project
Independent evaluation has many benefits: from understanding the impact of an economic development policy, programme or initiative and what degree of change has been delivered for intended beneficiaries or users; reviewing whether objectives and targets have been met; and assessing value for money.
Moreover, through quantitative and qualitative research techniques, a great evaluation will help to identify what aspects of a policy, programme or initiative have worked well (and reasons why) and what aspects could be improved upon or enhanced. Identifying the features of success and issues for improvement at strategic and delivery levels, can then help shape future policy making and lay the foundations for follow-on initiatives that can deliver improved positive impact for communities and businesses.
I have particular expertise in evaluating projects designed to help people into work, business support and growth schemes and community and neighbourhood regeneration. To date, I have evaluated over 60 projects and programmes for clients such as Universities, Local Authorities, Local Enterprise Partnerships, Skills and Employability Partnerships, Neighbourhood Regeneration Partnerships and Non Profit organisations. My scope of evaluation has included community-based projects of circa £1M, through to sub-regional programmes up to £50M and national programmes. Projects have typically been funded by the UK Government (City Deal, Local Growth Fund, Education Skills Funding Agency, and various neighbourhood regeneration funding programmes), The National Lottery Community Fund, European Union’s Regional Development Fund and Social Fund, Local Government, the Coalfields Regeneration Trust and others.
Some evaluation assignments have been delivered in two phases: a mid-point or interim evaluation combined with an end of programme evaluation; some have been longitudinal providing clients with a formative and summative evaluation; and others have been commissioned as an end of programme evaluation. The most beneficial approaches are when clients seek to learn and improve as they go along their implementation journey. Most programmes have involved several organisations working as a partnership and by assessing what aspects are working well at early or interim stage, I can highlight areas for improvement so that clients can adjust accordingly and maximise the impact of their efforts in the remaining lifetime of their programme. Interim evaluation work can also supplement programme monitoring by reviewing the extent to which a programme is on track to deliver its targets and meets its objectives.
My approach to evaluation assignments is to adopt a mixed methodology tailored to the needs of the client and the scope of the study. This will include quantitative and qualitative research techniques. A review of the “facts and figures” will tell us an important part of the story but some of the most insightful aspects of evaluation come from digging deeper – by gathering first-hand feedback from project beneficiaries, delivery staff and those at strategic and management levels.
Beyond the numbers:
Much of my work is about gathering opinion: from senior officials, politicians, project managers, delivery agents and business owners. It crucially involves gathering open and honest feedback from intended beneficiaries.
These often include members of the public whose community has had money spent on regeneration improvements, people who are out of work but have received specific support to help them find and secure employment, or businesses that have received a grant to help boost their growth and development.
Clients have often said how they like my strong personable approach which puts consultees at ease. I am as comfortable interviewing the Leader of a local council, a College Principal or an MP as I am interviewing community residents through "street survey" or discussion group sessions. My work has included one-to-one and group work with people recovering from alcohol or drugs addiction; people with anxiety and depression; survivors of rape and / or sexual abuse; people who have been out of work for a long time and are lacking self-esteem; and tenants wanting to voice their opinion on their housing conditions.
Our consultative work is tailor made to meet the client's needs. I can interview by video call, phone and online techniques but these tend to not to give the depth to a conversation in a way that that face to face contact brings. I always prefer to get to see who I am consulting, whenever possible!
Lessons learned are fed back to the client during the course of work - through progress updates - and in reporting. I like to identify "key features of success" and aspects that could benefit from change, with a fresh pair of expert eyes and I am clear, evidenced-based and realistic recommendations for clients move forward with the next phase of programme implementation.
The power of good case studies:
Never under-estimate the power of some good case studies to help illustrate the impact and change brought about by a programme. Not only are these helpful to “bring alive” an evaluation report, quotes from programme beneficiaries and video feedback (whether they be individuals or businesses) can be very useful in quickly enabling key decisions makers (programme funders and partnership board members for example) to see how much difference is being made “on the ground”.
Individual beneficiaries’ stories of progress can resonate clearly and powerfully with those who will make decisions on future resource allocations for similar programmes.