How to conduct evaluations that include hard-to-reach groups
Make sure your evaluations don’t exclude the most vulnerable
All too often traditional evaluation methods cannot be used in textbook fashion with people who are hard to find or reach.
These often include some of the least empowered and most vulnerable groups, such as abused children, homeless people, substance misusers, people affected by HIV/AIDS, various minority ethnic groups and a host of undocumented individuals.
You simply must get valid, accurate and honest information from these groups that bridge their individual problems, stigmas and cultural issues, otherwise your conclusions will be misleadingly biased in respect of who participated and remained involved in your study.
This workshop shows you specific techniques and case studies that you can use and adapt to your current methods to ensure they effectively evaluate your interventions affecting these hard-to-reach groups.
Topics include:
- Population issues, including defining the research population, sample size, recruitment and retention of respondents, and tracking them over time
- Research study design issues
- Project implementation, including data collection issues such as assuring and maintaining confidentiality, gaining access, interviewer training and supervision
- Analysis and reporting that takes into account the special needs of researching hard-to-reach groups
-
Cross-cutting issues including ethical issues, the need for special sensitivities and the role of consumer or service user involvement
Your trainer
Debra Rog is Senior Research Director for the Center for Mental Health Policy in the Washington DC office of the Vanderbilt Institute for Public Policy Studies. Before directing the Center’s Washington office, Debra was Associate Director of the Office of Programs for the Homeless Mentally Ill at the National Institute of Mental Health.
What delegates say about this course and trainer
"Thank you, the course was informative and the speaker very experienced."
Joanne Davies, Research Officer, Caerphilly County Borough Council
"I would recommend it to several people and will pass on details myself."
Jenny Thornton, Modernisation Development Manager for Older People’s Modernisation Team, Leeds Mental Health Teaching NHS Trust
"Very good, thanks."
Jason Hadley, Station Officer, West Midlands Fire Service
"It was informative and offered a good range of skills and practical tips to use. It was also, as all your courses are, a good opportunity to meet new people and to share experience."
Emma Millard, Tenant Liaison Officer, Hillingdon Homes
“Very interesting, informative and enjoyable. Consolidated current thoughts on evaluation and reaffirmed belief I’m on the “right track”! New ideas to try + engage data providers + service users in involvement. Refocused me! Thank you Debra for a very good day.”
Sheena Murphy, Youth Justice Board Project Co-ordinator, Connexions - West Yorkshire
"Gave me the key areas I need to think about."
Jay Modhwadia, Policy Advisor (Community Engagement), Crown Prosecution Service
"Overall everything discussed today was extremely helpful for my future projects. Specifically it gave me ideas on how to define populations, setting population samples and tracking populations. Also the need to analyse the key challenges when undertaking a study.
Diana Paver, Scrutiny Support Officer, Tameside Metropolitan Borough Council
"Very good & comprehensive introduction to evaluating. & practical examples of what works and doesn’t. - particularly the 'logic model'."
Adrian Mayers, Head of Partnerships, Hammersmith and Fulham Primary Care Trust
"Gave an opportunity to stand back from current methodologies & experience alternative ways of research. Extremely thought provoking."
Janette Pollitt, Principal Officer, Children and Families, Newport City Council
"Enjoyed the course and the subject and the different issues raised were pertinent to my work situation."
Rosemary Leek, Programme Evaluator, Fresh start North Lincolnshire Council


"Lots of ideas + techniques that can be followed up “on-the-job”. Very good theoretical contact with opportunities to apply in “practical” sessions. Still looking for a way to engage disaffected youth but have points to work with now."