Dr. Tanvir Ahmed MPH, MBBS ICDDR,B
[email protected] [email protected]
The systematic collection of information about the activities, characteristics, and outcomes of programs to make judgments about the program, improve program effectiveness, and/ or inform decisions about future program development. Michael Quinn Patton
To determine achievement of objectives; progress on goals, outcomes To improve program implementation & delivery For accountability to funders, community, & other stakeholders To increase community support for initiatives through community awareness To contribute to the scientific base for community public health interventions
To inform policy decisions To ensure the effective programs are maintained and
resources are not wasted on ineffective programs
To permit comparisons among groups , (* populations with high risk factors) To justify the need for further funding and support To find opportunities for continuous quality improvement (CQI)
Getting Money Keeping money Celebrating successes Improving programs Increasing clarity of program objectives and
actions Using feedback to make the program better
Program Evaluation
Formative
Summative
Used to help form or shape the program to perform better; used to improve delivery of the program
Examines the effects or outcomes of the program, a summary judgment on the program’s performance
Formative PE Evaluation of need: Assessment and identification
of unmet needs within an organization or community. ▪ Used for program planning
Process Evaluation: is the program operating as
planned or expected? ▪ Do the needs of the community match what was believed during planning? ▪ Learn how the program works ▪ The extent of implementation ▪ The nature of the people being served
Summative PE Outcome Evaluation: is the program having the
desired effects on specifically defined outcomes? Impact Evaluation: what are the overall intended
or unintended effects of the program?
Six Steps: Engage stakeholders Describe the program Focus the evaluation design Gather credible evidence Justify conclusions Ensure use and share lessons learned
Engage stakeholders:
People or organizations that have something to gain or lose from what will be learned from an evaluation, and also in what will be done with that knowledge. 1. 2. 3.
Those involved in program operations; Those served or affected by the program; and Primary intended users of the evaluation.
Describe the program
Specific aspects to include when describing a program are: 1. Need 2. Expectations 3. Activities 4. Resources 5. Stage of development 6. Context 7. Logic model
Focus the evaluation design 1. Purpose 2. Users 3. Uses 4. Questions 5. Methods 6. Agreements
Gather credible evidence 1. Indicators 2. Sources 3. Quality 4. Quantity 5. Logistics
Justify conclusions 1. Standards 2. Analysis and synthesis 3. Interpretation 4. Judgment 5. Recommendations
Ensure use and share lessons learned 1. Design 2. Preparation 3. Feedback 4. Follow-up 5. Dissemination
Standards for "good" evaluation Utility Who needs the info from this evaluation what info do they need?
Feasibility How much money, time, and effort can we put into this?
Propriety Does the evaluation protect the rights of individuals? Does it engage those most affected by the program and
its outcomes?
Accuracy Does the evaluation produce findings that are valid and
reliable?
Scientific Dissemination
Scientific write-up I – Introduction M – Method R – Result A – Analysis D – Discussion and Conclusion
Report/Thesis write-up Introduction Background Example; pilot Justification
Objectives
General and Specific
Method
Design, site, sample (frame, size, technique) bias and limitation
Findings Discussion Conclusion Reference Appendix
Avoid focus Avoid originality and personality Write l o n g contributions Remove most implications and every speculation Leave out illustrations, particularly good ones Omit necessary steps of reasoning Use many abbreviations and technical terms Suppress humor and flowery language Degrade species and biology to statistical elements Quote numerous papers for self-evident statements
Hope you all become scientists!
Good Luck!!!
