by the numbers -
data to show outcome and short-term impact
data to show outcome and short-term impact
Patricia Oh, PhD, MSW
University of Maine Center on Aging
Consortium for Aging Policy, Research, and Analysis
None of us want to collect meaningless data. This chapter discusses how to collect data effectively and efficiently to tell partners, decision-makers, and residents a compelling sory of the work you are doing.
Data encompasses both quantitative and qualitative information. Quantitative data includes attendance figures, follow-up rates on resources, and self-reported confidence levels. Equally important are qualitative data—the stories that reveal the real impact of community work. While numbers provide measurable outcomes, personal narratives offer deeper insights into how programs meaningfully change lives, illustrating why our work matters.
Planning what to measure and why is crucial before collecting data. Many of us use logic models to visually map the relationships between resources, activities, and intended outcomes. Thinking ahead about why you are starting a new program or service and predicting the effect it will have on the community is key to making sure you are collecting the data you need and only the data you need. During this chapter we will talk about developing a logic model. It sounds intimidating but fear not, we will guide you through the process to make planning and collecting data fun!
Identifying and Collecting Meaningful Data
In this video we talk about the benefits of collecting data and different types of data you can gather to show progress and the short-term impact of your initiative.
We want you to start thinking about data in your community. In the reflection, we will ask you to watch a video depiction of a program offered by Age-Friendly Saco and then to think about a service, program, or activity that your age-friendly team is leading and to identify the data you need to help you make needed course corrections and engage partners, including residents, funders, and municipal decision-makers.
Application - Collecting the Data You Need
Please watch this brief video about a project that installs a virtual personal assistant in the homes of community residents.
While you are watching, try to think about how you could measure:
activities
outputs
short-term outcomes
During the video, we hear a bit about how the program works and how it has effected this resident's life. The video is an example of using qualitative data to tell the story of change.
Click on each picture to find some ideas about the activities, outputs, and short-term impact that could be used to show the effectiveness of the project.
Reflection - Collecting the Data You Need
Now, think about your own community. Is there a program or activity in place or are you starting to plan a new project? What are some ways that you could measure activities, outputs, and short-term impact? What about resident stories? How could you gather qualitative data to explain how the project makes a difference and why it matters? Click here to complete the first of two reflections in this chapter. Completing your reflection will also record your progress. Important: Complete each section before moving on to its corresponding reflection. When you return to the form, you will automatically be taken to where you last left off.
Organizing for Data-Driven Decision Making
This section explores the use of logic models as powerful planning tools. We'll demonstrate how these models can guide you in selecting relevant data to evaluate your services and activities. Learn to pinpoint key indicators that effectively showcase your progress towards goals, ensuring your efforts are both measurable and impactful. Then, we'll briefly describe how to share your data with partners, including funders, municipal decision-makers and residents.
In the reflection, you will have an opportunity to start putting together a logic model describing your plans for a service, program, or activity.
Application, part 1 - Identifying the Data You Need
After reading the handout "Tearless Logic Model", work with your team to complete this worksheet for one or two of the activities you have planned as part of the Community Connector Pilot.
Application, part 2 - Identifying the Data You Need
With your goals, activities, and anticipated short-term impacts defined, it's time to craft your evaluation plan. This crucial step outlines your data collection strategy: what information you'll gather, who will be responsible, and when or where it will be collected. Having a plan in place keeps everyone on track and ensures that you are able to pivot when the data suggests a course correction. Moreover, it ensures you'll have the evidence needed to tell a compelling, data-driven story about your project's implementation and impact.
This worksheet can help develop the evaluation that fits your project and your community.
Reflection - Identifying the Data You Need
Now, think about your own community. You have developed a logic model and an evaluation plan. How will you tailor a message about the impact of your activity, program or service to engage current and potential partners? Think about how best to communicate the data to residents, other organizations or groups, municipal decision-makers, and funders. Click here to complete the final reflection in this chapter and record successful completion of the Data chapter. Note: Clicking will bring you back to where you left off when you completed your last reflection. When you have finished, please click "submit" to record completion of the Data chapter.
Additional Resources
Community Toolbox. Chapter 2. Developing a Logic Model or Theory of Change
We often turn to the Community Toolbox for ideas to help us move age-friendly forward. This chapter focuses on developing a logic model and identifying the data you need to show progress toward goals. We recommend Chapter 36 as well - Developing an Evaluation Plan.
Katherine Harnish. Tell me a story... making data more compelling through narrative
In this 25 minute video, Katherine Harnish, data storyteller extraordinaire and chair of Age-Friendly Houlton shares hints and tips for developing a compelling data story.
Hubspot. 17 Best Types of Charts and Graphs for Data Visualization
This article contains excellent advice to develop compelling charts and graphs.
Lifelong Maine. For more information about the power of measuring and celebrating your age-friendly initiative, visit Age-Friendly Guide: Measure and Celebrate
Pro-Tip. Are you looking for data gathered by the US Census data about your community? Go to Lifelong Maine - By County, find the county where your community is located, then click on your community. In each community profile, there is a link to data about your community and about the older residents who live in your city or town.
Cormac Russell. The Value of Stories
This short, 4-minute video, describes the method Cormac Russell uses to tell stories about community impact. His model, the story of Truth and Story, emphasizes that stories are the seeds of social change. Cold data is devoid of meaning unless stories are added to bring depth and mobilize people to work alongside age-friendly.
World Health Organization. Measuring the age-friendliness of cities: a guide to using core indicators
This guide provides guidance on selecting and using core indicators for establishing baselines, setting goals/targets, monitoring and evaluating age-friendly community initiatives.
Meet Your Chapter Guide - Patricia Oh, PhD, MSW
Patricia Oh serves as the Assistant Director of Community Innovation and Research at the University of Maine Center on Aging where she works with her colleagues on community-engaged research. Her expertise lies in translational research, program development, evaluation, and community education. Since 2012, Dr. Oh has focused on age-friendly community development at national and state levels, with a particular emphasis on rural communities. Dr. Oh is also Co-Director of the Consortium for Aging Policy Research and Analysis, a partnership between the University of Maine and the University of Southern Maine. Based on her research with communities, Dr. Oh has authored more than a dozen book chapters and articles about aging in community and is lead author to the award-winning AARP Roadmap to Livability Series and Rural Livability Report. Recent peer reviewed publications include:
Black, K., & Oh, P. (2022). Assessing age-friendly community progress: What have we learned?. The Gerontologist, 62(1), 6-17.
Black, K., & Oh, P. (2023). Exploring sectoral reach in age-friendly communities. The Gerontologist, 63(5), 920-932.
Black, K., Oh, P., Montepare, J., and Kaye, L. (2024). Leveraging Higher Education in Our Age-Friendly World. Journal of Aging and Social Policy, 1-17. doi:10.1080/08959420.2024.2384187
Greenfield, E. A., Black, K., Oh, P., & Pestine-Stevens, A. (2022). Theories of community collaboration to advance age-friendly community change. The Gerontologist, 62(1), 36-45.
Oh, P., Kaye, L., & Parham, L. (2021). Community leaders’ perspective of strategies to enhance social connectedness in rural communities. Innovation in Aging, 5(Suppl 1), 315.
Oh, P. & White, L. (2022). Approaches to Community Supports and Health Services in U.S. Age-Friendly Communities: Focus on Advance Care and End-of-Life Planning. Journal of Aging Life Care, 32(1), 11-17.
During this chapter, we hope you will gain a few tools to make data collection easier and more efficient.
If you have any questions as you are going through the material, please email: lifelong@maine.edu.