Syllabus
Master of Public Health
GPH 753: Advanced Program Evaluation – ILE – Spring 2024
Credits - 3
Description
Students will collaborate with a public health site that they have identified to evaluate an aspect of a program as partial fulfillment for the requirements for their MPH degree. All MPH students must create a high quality written product, synthesizing public health competencies. Based on their selected topic, students will analyze data related to a real-world problem and present their findings in a high quality written document. Readings and lectures will provide further education and guidance, and all assignments are designed to guide students through the analysis and writing process.
Materials
Learning Objectives and Outcomes
Public Health Competencies
PC 1. Synthesize and incorporate scientific evidence into professional writing
PC 2. Search databases and critically analyze peer-reviewed literature
PC 4: Evaluate the use of financial resources and management techniques by public health programs to achieve goals and sustainability
FC 4. Interpret results of data analysis for public health research, policy or practice
FC 6: Discuss the means by which structural bias, social inequities and racism undermine health and create challenges to achieving health equity at organizational, community, and systemic levels
FC 7: Assess population needs, assets, and capacities that affect communities’ health
FC 8: Apply awareness of cultural values and practices to the design, implementation, or critique of public health policies or programs
FC 11. Select methods to evaluate public health programs
FC 13. Propose strategies to identify stakeholders and build coalitions and partnerships for influencing public health outcomes
FC 14: Advocate for political, social or economic policies and programs that will improve health in diverse populations
FC 19: Communicate audience-appropriate (i.e., non-academic, non-peer audience) public health content, both in writing and through oral presentation
Assignments
Please make sure to review the full assignment and discussion prompts in the course. Make sure to carefully review the modules in the course.
Identifying Key Stakeholders
Utilizing a worksheet from the self-study guide as a template, identify stakeholders in the three broad categories: those affected, those involved in operations, and those who will use the evaluation results. Then identify key stakeholders needed to improve credibility, implementation, advocacy, or funding/authorization decisions.
Literature Review
Conduct a literature review focusing on sources that are related to the health program you are addressing and evaluations that are relevant to your topic.
Logic Model
Provide a logic model for your program that visually depicts the inputs, activities, outputs, outcomes, and impact. Use arrows to demonstrate the relationships between specific elements.
Evaluation Questions
Submit 4-7 overarching questions that your data analysis will aim to answer. Evaluation questions should be clear and precise so that they help focus your methods and analysis. They should also be realistic (answerable), relevant to key stakeholders, and open-ended (not yes/no questions).
Background Section
Integrate formative research and key stakeholder data to provide a detailed outline of the background section of your paper.
Logistic Protocols
Establish an appropriate plan for data collection that is feasible and equitable.
Evaluation Plan Methodology
Submit a detailed outline of the methodology section of your evaluation plan that describes the methods used to collect and analyze your data.
Data Collection Instruments
Submit data collection instruments you developed for your ILE project and will use to collect participant data (surveys, focus group guides, key informant interview guides, etc.).
Findings
Submit a detailed outline showing the findings of your ILE data collection.
Discussion Section
Submit a draft of the discussion section that supports arguments with evidence, highlights the implications of the findings for public health practice and includes future recommendations resulting from the evaluation.
Draft Report
Submit a draft of the full report for feedback.
Final Report
Integrating faculty mentor feedback, submit a clean draft of the final report, including an abstract, executive summary, background, methods, results, and discussion.
Oral Presentation
Submit oral presentation slides for faculty mentor feedback. Slides must follow CDC accessibility guidelines.
Grading Policy
Your grade in this course will be determined by the following criteria:
Grade Breakdown
| Acknowledgement of Academic Engagement | 1 |
| 1:1 Meetings with your Instructor | 4 |
| Learning Journal Entries | 16 |
| Week 1: Identifying Key Stakeholders | 2 |
| Week 2: Literature Review | 5 |
| Week 4: Logic Model | 3 |
| Week 4: Evaluation Questions | 3 |
| Week 5: Background Section Online | 5 |
| Week 6: Data Collection Logistics | 3 |
| Week 7: Outline of Methodology Section | 7 |
| Week 8: Data Collection Instruments | 3 |
| Week 11: Outline of Finding Section | 5 |
| Week 12: Full Draft of Discussion Section | 6 |
| Week 13: Full Draft ILE Report | 10 |
| Week 14: Presentation Slides | 5 |
| Week 15: Final Report | 17 |
| Week 16: Discussion | 2 |
| Week 15 Oral Presentation | 3 |
| Total | 100 |
Grade Scale
| Grade | Points Grade | Point Average (GPA) |
| A | 94 – 100% | 4.00 |
| A- | 90 – 93% | 3.75 |
| B+ | 87 – 89% | 3.50 |
| B | 84 – 86% | 3.00 |
| B- | 80 – 83% | 2.75 |
| C+ | 77 – 79% | 2.50 |
| C | 74 – 76% | 2.00 |
| C- | 70 – 73% | 1.75 |
| D | 64 – 69% | 1.00 |
| F | 00 – 63% | 0.00 |
Schedule
Each week opens on Wednesday at 12:01 AM Eastern Time (ET). Each week closes on Wednesday at 11:59 PM ET, with the exception of Week 16, which ends on Sunday.
Week 1: Jan 17 – Jan 24
Week 2: Jan 24 – Jan 31
Week 3: Jan 31 – Feb 7
Week 4: Feb 7 – Feb 14
Week 5: Feb 14 – Feb 21
Week 6: Feb 21 – Feb 28
Week 7: Feb 28 – Mar 6
Week 8: Mar 6 – Mar 13
Week 9: Mar 13 – Mar 20
Week 10: Mar 20 – Mar 27
Week 11: Mar 27 – Apr 3
Week 12: Apr 3 – Apr 10
Week 13: Apr 10 – Apr 17
Week 14: Apr 17 – Apr 24
Week 15: Apr 24 – May 1
Week 16: May 1 – May 5
Please make sure to review the full assignment prompts in the course. Make sure to carefully review the modules in the course.
Week 1: Course Introduction and Stakeholder Engagement
Outcomes
- Identify key stakeholders
- Identify types of evidence by stakeholder
- Recognize the importance of stakeholder engagement
- Assess the roles of stakeholders in public health
Assignments
- Identifying Key Stakeholders
- Schedule 1:1 Meetings with Your Instructor
Week 2: Literature Review
Outcomes
- Identify relevant peer-reviewed trustworthy sources and evidence-based research
- Identify key aspects of peer-reviewed journal articles
- Explore health equity implications of research
Assignments
- Literature Review
- 1:1 Meeting with your Instructor
Week 3: Conducting Key Stakeholder Interviews
Outcomes
- Proactively schedule interviews with key stakeholders using appropriate communication channels
- Demonstrate effective communication and interviewing skills to obtain comprehensive information from interviewees
- Establish rapport, maintain focus, and manage time effectively during interviews
Assignments
- Learning Journal Entry 1
Week 4: Logic Model & Evaluation Questions
Outcomes
- Write evaluation questions that focus on the evaluation and inform decisions related to methods and analysis
- Use peer-reviewed literature and stakeholder input to inform decisions about the focus of the evaluation
- Explain the benefits and limitations of outcome (effect) evaluations
- Develop evaluation questions to guide data collection and analysis methodology
- Utilize stakeholder input and existing research to inform program evaluation needs
Assignment
- Logic Model
- Evaluation Questions
Week 5: Background Section Outline
Outcomes
- Discuss the prevalence, impact, and risk factors associated with a public health topic including the relevant social determinants of health
- Identify health disparities among the priority population served by a health promotion program
- Identify the gaps in the existing literature
Assignment
- Background Section Outline
Week 6: Logistics and Protocols
Outcomes
- Establish protocols for data collection and/or use of existing data
Assignments
- Data Collection Logistics
Week 7: Methodology
Outcomes
- Develop and implement a data security plan
- Develop an evaluation design to answer evaluation questions around a complex public health issue
- Create an equitable data collection plan that includes respect for participants and considerations related to social determinants of health
- Develop a data analysis plan appropriate for the type of data collected
- Implement strategies to minimize bias and ensure the accuracy and reliability of data collected and analyzed
Assignment
- Data Collection & Analysis
Week 8: Data Collection Instruments
Outcomes
- Determine which type of data analysis is most appropriate to answer evaluation questions
- Develop an equitable data collection instrument appropriate for the selected evaluation design and priority population
- Formulate clear and concise questions to capture relevant information needed for a program evaluation
- Identify the key components of a data collection instrument
- Integrate asset-framing in data collection instrument design
Assignment
- Data Collection Instruments
- Learning Journal Entry 2
Week 9: Data Collection – Organizing and Cleaning Data
Outcomes
- Examine and apply best practices for data collection, storage, and management
- Describe common obstacles and possible solutions for data collection
- Clean raw data to prepare for analysis
- Maintain data according to appropriate security standards
Week 10: Data Cleaning & Analysis
Outcomes
- Conduct basic analysis of qualitative data
- Identify the pros and cons of the use of qualitative data in program evaluation
- Conduct basic quantitative analysis of evaluation data
Assignment
- 1:1 Meeting with your Instructor
Week 11: Findings
Outcomes
- Effectively analyze and interpret data from data collection
- Structure and present findings in a clear, concise, and organized manner
- Convey the significance of findings and their implications for public health practice, policy, and health equity
Assignment
- Outline of Finding Section
- Learning Journal Entry 3
Week 12: Report Writing
Outcomes
- Identify and address intervention strengths and barriers
- Write a clear and concise discussion section that is supported by evidence from the data
- Synthesize evidence to develop innovative recommendations to address a complex public health issue
- Discuss the role of a health promotion program on health equity among a priority population
Assignments
- Full Draft of Discussion Section
Week 13: Submit Draft ILE Project Report
Outcomes
- Demonstrate the ability to incorporate feedback from faculty and peers
- Produce a well-written, comprehensive, and evidence-based evaluation report that addresses all of the required components
- Discuss the significance of the program on population health and suggest future recommendations
- Identify implications of the findings for improving population health outcomes and reducing health disparities
Assignment
- Submit Full Draft
Week 14: Presentation Slides
Outcomes
- Develop a clear and concise presentation
- Create effective visuals to support a presentation
- Refine presentation skills and deliver a polished and professional presentation
- Apply a systems thinking tool to visually represent a public health issue
Assignments
- 1:1 Meeting with your Instructor
- Submit Presentation Slides
Week 15: Submit ILE Project Report and Presentations
Outcomes
- Demonstrate the ability to incorporate feedback from faculty and peers to improve the quality of the summary report
- Produce a well-written, comprehensive, and evidence-based evaluation report that addresses all of the required components
- Discuss the significance of the program on population health and suggest future recommendations
- Identify implications of the findings for improving population health outcomes and reducing health disparities
- Critically reflect on public health proficiencies gained throughout the program
Assignment
- Final ILE Project Report
Week 16: Getting Your Work Out There
Outcomes
- Understand the importance of publishing in reputable academic journals
- Gain the tools and knowledge to navigate the publication process, including identifying appropriate publication venues, crafting compelling manuscripts, and engaging with peer reviewers
- Develop strategies to strategically share work among the broader professional public health community
- Critically reflect on the process of synthesizing knowledge and skills to produce a comprehensive final public health paper
Discussion
- Journal Selection Tools
Assignment
- Learning Journey Entry 4
Student Resources
Online Student Support
Your Student Support Specialist is a resource for you. Please don't hesitate to contact them for assistance, including, but not limited to course planning, current problems or issues in a course, technology concerns, or personal emergencies.
Questions? Visit the Student Support Public Health page
UNE Libraries:
- Library Access for all students: Your library login ID and password are the same as the ones you use to log into Blackboard/Brightspace.
- Public Health Databases: https://library.une.edu/library-materials/find/research-by-subject/public-health/
- Library Tutorial: Find an article
- Library Questions: Ask a librarian or phone library staff at (207) 602-2361 or (207) 221-4330.
UNE Student Academic Success Center
UNE's Student Academic Success Center (SASC) offers a range of free online services to support your academic achievement. Writing support, ESOL support, study strategy and learning style consultations, as well as downloadable resources, are available to all matriculating students. The SASC also offers tutoring for GPH 712 Epidemiology, GPH 716 Biostatistics, GPH 717 Applied Epidemiology, GPH 718 Biostatistics II, and GPH 719 Research Methods. To make an appointment for any of these services, go to une.tutortrac.com. For more information and to view and download writing and studying resources, please visit:
Information Technology Services (ITS)
- ITS Contact: Toll Free Help Desk 24 hours/7 days per week at 1-877-518-4673
Accommodations
Any student who would like to request, or ask any questions regarding, academic adjustments or accommodations must contact the Student Access Center at (207) 221-4438 or pcstudentaccess@une.edu. Student Access Center staff will evaluate the student's documentation and determine eligibility of accommodation(s) through the Student Access Center registration procedure.
Policies
AMA Writing Style Statement
The American Medical Association Manual (AMA) of Style, 11th edition is the required writing format for this course. Additional support for academic writing and AMA format is provided throughout the coursework as well as at the UNE Portal for Online Students.
Online resources: AMA Style Guide
Turnitin Originality Check and Plagiarism Detection Tool
The College of Professional Studies uses Turnitin to help deter plagiarism and to foster the proper attribution of sources. Turnitin provides comparative reports for submitted assignments that reflect similarities in other written works. This can include, but is not limited to, previously submitted assignments, internet articles, research journals, and academic databases.
Make sure to cite your sources appropriately as well as use your own words in synthesizing information from published literature. Webinars and workshops, included early in your coursework, will help guide best practices in APA citation and academic writing.
You can learn more about Turnitin in the Turnitin Student quick start guide.
Technology Requirements
Please review the technical requirements for UNE Online Graduate Programs: Technical Requirements
Course Evaluation Policy
Course surveys are one of the most important tools that University of New England uses for evaluating the quality of your education, and for providing meaningful feedback to instructors on their teaching. In order to assure that the feedback is both comprehensive and precise, we need to receive it from each student for each course. Evaluation access is distributed via UNE email at the beginning of the last week of the course.
Late Policy
Students are responsible for submitting work by the date indicated in Brightspace.
Quizzes and Tests: Quizzes and tests must be completed by the due date. They will not be accepted after the due date.
Assignments: Unless otherwise specified, assignments will be accepted up to 3 days late; however, there is a 10% grade reduction (from the total points) for the late submission. After three days the assignment will not be accepted.
Discussion posts: If the initial post is submitted late, but still within the discussion board week, there will be a 10% grade reduction from the total discussion grade (e.g., a 3 point discussion will be reduced by 0.3 points). Any posts submitted after the end of the Discussion Board week will not be graded.
Please make every effort ahead of time to contact your instructor and your student support specialist if you are not able to meet an assignment deadline. Arrangements for extenuating circumstances may be considered by faculty.
Student Handbook Online - Policies and Procedures
The policies contained within this document apply to all students in the College of Graduate and Professional Studies. It is each student's responsibility to know the contents of this handbook.
UNE Course Withdrawal
Please contact your student support specialist if you are considering dropping or withdrawing from a course. The last day to drop for 100% tuition refund is the 2nd day of the course. Financial Aid charges may still apply. Students using Financial Aid should contact the Financial Aid Office prior to withdrawing from a course.
Academic Integrity
The University of New England values academic integrity in all aspects of the educational experience. Academic dishonesty in any form undermines this standard and devalues the original contributions of others. It is the responsibility of all members of the University community to actively uphold the integrity of the academy; failure to act, for any reason, is not acceptable. For information about plagiarism and academic misconduct, please visit https://www.une.edu/studentlife/plagiarism.
Academic dishonesty includes, but is not limited to the following:
- Cheating, copying, or the offering or receiving of unauthorized assistance or information.
- Fabrication or falsification of data, results, or sources for papers or reports.
- Action which destroys or alters the work of another student.
- Multiple submissions of the same paper or report for assignments in more than one course without permission of each instructor.
- Plagiarism, the appropriation of records, research, materials, ideas, or the language of other persons or writers and the submission of them as one's own.
Charges of academic dishonesty will be reviewed by the Program Director. Penalties for students found responsible for violations may depend upon the seriousness and circumstances of the violation, the degree of premeditation involved, and/or the student’s previous record of violations. Appeal of a decision may be made to the Dean whose decision will be final. Student appeals will take place through the grievance process outlined in the student handbook.
Attendance Policy
Online students are required to submit a graded assignment/discussion prior to Sunday evening at 11:59 pm ET of the first week of the term. If a student does not submit a posting to the graded assignment/discussion prior to Sunday evening at 11:59 pm ET, the student will be automatically dropped from the course for non-participation. Review the full attendance policy.
Late Policy
Assignments: Late assignments will be accepted up to 3 days late; however, there is a 10% grade reduction (from the total points) for the late submission. After three days the assignment will not be accepted.
Discussion posts: If the initial post is submitted late, but still within the discussion board week, there will be a 10% grade reduction from the total discussion grade (e.g., a 3 point discussion will be reduced by 0.3 points). Any posts submitted after the end of the Discussion Board week will not be graded.
Please make every effort ahead of time to contact your instructor and your student support specialist if you are not able to meet an assignment deadline. Arrangements for extenuating circumstances may be considered by faculty.
Student Handbook Online - Policies and Procedures
The policies contained within this document apply to all students in the College of Graduate and Professional Studies. It is each student's responsibility to know the contents of this handbook.
UNE Course Withdrawal
Please contact your student support specialist if you are considering dropping or withdrawing from a course. The last day to drop for 100% tuition refund is the 2nd day of the course. Financial Aid charges may still apply. Students using Financial Aid should contact the Financial Aid Office prior to withdrawing from a course.
Academic Integrity
The University of New England values academic integrity in all aspects of the educational experience. Academic dishonesty in any form undermines this standard and devalues the original contributions of others. It is the responsibility of all members of the University community to actively uphold the integrity of the academy; failure to act, for any reason, is not acceptable. For information about plagiarism and academic misconduct, please visit UNE Plagiarism Policies.
Academic dishonesty includes, but is not limited to the following:
- Cheating, copying, or the offering or receiving of unauthorized assistance or information.
- Fabrication or falsification of data, results, or sources for papers or reports.
- Action which destroys or alters the work of another student.
- Multiple submissions of the same paper or report for assignments in more than one course without permission of each instructor.
- Plagiarism, the appropriation of records, research, materials, ideas, or the language of other persons or writers and the submission of them as one's own.
Charges of academic dishonesty will be reviewed by the Program Director. Penalties for students found responsible for violations may depend upon the seriousness and circumstances of the violation, the degree of premeditation involved, and/or the student’s previous record of violations. Appeal of a decision may be made to the Dean whose decision will be final. Student appeals will take place through the grievance process outlined in the student handbook.