Syllabus

Master of Social Work

SSWO 514 – Program Evaluation- Spring A 2019

Credits - 3

Description

The course will build upon the knowledge, methods, and skills learned in foundation research courses. Students will learn how to critically assess research from ethical, multicultural, and social justice perspectives particularly in the context of agency-based research and program evaluation. An expectation is for students to collaborate with their field placement instructors, employers, or a community group with the aim of improving individual or community health through the lens of program evaluation and practice assessment. 

Materials

Required Readings:

Knowlton, L. W., & Phillips, C. C. (2013). The logic model guidebook: Better strategies for great results (2nd ed.). Thousand Oaks, CA: Sage Publications. ISBN: 9781452216751.

McDavid, J. C., Huse, I., & Hawthorn, L. R. L. (2013). Program evaluation and performance measurement: An introduction to practice (2nd ed.). Thousand Oaks: Sage Publications. ISBN: 9781412978316.

Yin, R. K. (2014). Case study research: Design and methods (5th ed.). Thousand Oaks, CA: Sage Publications. ISBN: 9781452242569

Additional Resources:

Additional readings include assigned journal articles that are accessible online or at the University of New England library. These will be presented in the Learning Modules.

Learning Objectives and Outcomes

School of Social Work Program Outcomes:

Graduates of the UNE SSWO will demonstrate knowledge, skills, and leadership in the following:

  1. Practice social inclusion to enable people, populations, and communities to fully participate in society, enhance human bonds in the context of cultural diversity and ensure improved quality of life and equitable resource distribution. EPAS Competencies 2 & 3
  2. Engage in culturally-informed relationship building, being respectful of the complexity and diversity of contexts and circumstances. EPAS Competencies 3 & 6
  3. Utilize theories of human behavior, social systems and social inclusion when offering interventions with people and their environments. EPAS Competency 8
  4. Promote ethical reflection, critical consciousness and shared decision-making based in social work values and with consideration of the broader contexts of the world in which we live. EPAS Competency 1
  5. Balance the roles of helpers, activists, and advocates through collaboration with communities to build healthy and sustainable resources. EPAS Competencies 2, 5, & 6
  6. Engage as critical consumers and producers of research as it relates to assessment, intervention and evaluation of clinical and community practices. EPAS Competencies 4, 7, 8 & 9
  7. Practice person-centered and collaborative community partnerships across diverse settings. EPAS Competency 6

Course Objectives

Upon successful completion of this course, students will:

  1. Be competent in program evaluation methods and program assessments (relates to PROGRAM OBJECTIVE 6). As measured by:
    • Discussion Forums
    • Final Research Proposal
  2. Discuss the ethical and socio-political factors that influence the process of evaluation (relates to PROGRAM OBJECTIVE 4). As measured by:
      • Discussion Forums
      • Final Research Proposal
  3. Conceptualize and propose a program evaluation, which integrates and utilizes foundational research knowledge and critical thinking (relates to PROGRAM OBJECTIVES 4 and 6). As measured by:
    • Discussion Forums
    • Final Research Proposal Introduction
    • Final Research Proposal

Assignments

A variety of learning activities are designed to support the course objectives, facilitate different learning styles, and build a community of learners. Learning activities include readings, videos, discussions, and two key assessment assignments.

Discussions 

You are expected to actively participate in whole class discussion forums each week. To actively participate in the forums means to provide an initial response to the discussion questions and a minimum of three (3) responses to different classmates per week (unless otherwise indicated). Your initial posting does not count towards responses to others. This is the minimum standard for response discussion, however, there are no limitations to the number or length of your response in class discussions. The Discussion Board is an opportunity for you to examine new ideas and learn how to articulate some of the essential concepts, theories, and language that frame your profession. Think of it as your “sandbox” to explore, challenge, and reflect on practice. Your professional success going forward will depend upon what you know, but it will also depend upon how well you can express what you know and whether you can use your knowledge effectively.

Responses to others must add substantively to the discussion by building upon classmates’ ideas or posing critical questions to further the discussion. For example, a posting of “I agree with what people are saying” is not sufficient. What is considered sufficient is initiating further discussion; promoting further thought; providing critical or integrative dialogue; providing support or encouragement; challenging a peer by showing supporting literature or other documentation, and/or self-reflecting regarding the topic. Responses should reflect your ability to apply critical thinking in the discussion and topical analysis. What is critical thinking? Very simply, critical thinking means that you provide an objective, logical analysis of a topic and ask relevant, challenging questions.

Post your response no later than the assigned due date or as early in the week as possible, since doing so facilitates student-to-student interaction and maximizes the learning experience for everyone. Late responses may result in a reduction in grade. All weekly discussion questions are graded using the College-wide Discussion Rubric. 

Program Evaluation Selection (Week Two)

In this assignment, you will describe a program evaluation that you would propose to conduct in your community. The goal is to define what you would propose to study, and also to provide some background as to why you would like to study this, including references from academic sources to back up your topic and justify why it should be studied.

Theory of Change or Logic Model (Week Three)

In this assignment, you will create a theory of change or logic model for your program evaluation.  The logic model/theory of change model is be a visual document that others can follow or replicate if they were to conduct a similar study. 

Data Collection Plan & Research Questions  (Week Four)

In this assignment, you will develop 2-3 research questions that will guide your inquiry for your program evaluation.  You will also describe how you will collect your data. The goal is to identify the specific items you will measure, and to match your data collection methods to your logic model and research topic. 

Data Analysis Plan (Week Five)

In this assignment, you will describe your plan for analyzing your data. You will also edit your logic model/theory of change to align with your research question and data analysis strategy. Your edited logic model/theory of change should incorporate the feedback provided by your classmates and the instructor.

Sampling Plan, Recruitment & Dissemination of Results (Week Six)

In this assignment, you will describe your plan for selecting and recruiting participants for your study. You will also explain how you will disseminate the results of your program evaluation to relevant audiences.

Final Research Proposal (Week Seven)

Your final assignment for this course is a Research Proposal for a program evaluation that you would propose to conduct in your community. 

Your research proposal will be comprised of several different components submitted over the course of the term (Assignments Weeks 2-6). Each component will be graded with specific feedback, including feedback from your instructor as well as peer feedback on a draft of your Research Proposal, submitted during the Week 6 Discussion. Your Final Research Proposal should incorporate the feedback you receive from your instructor and peers.

Your Research Proposal will include the following sections: 

  • Introduction/Overview – Describe proposed program evaluation, background and rationale (Week 2 Assignment).
  • Theoretical Support – Provide Logic Model or Theory of Change to support the program evaluation (Week 3 Assignment).
  • Research Questions & Measurement Plan – Provide research questions and data collection methods (Week 4 Assignment)
  • Data Analysis – Explain data analysis plan, aligned to Logic Model or Theory of Change (Week 5 Assignment). 
  • Sampling Plan, Recruitment & Dissemination of Results – Describe plan for sampling and recruiting participants. Explain how results will be disseminated.

Grading Policy

The School of Social Work uses the following grading system for all courses with the exception of field education courses. Students are expected to maintain a “B” (3.0) average over the course of their study. Students with less than a GPA of 3.0 will be placed on academic probation. Students must have an overall GPA of 3.0 in order to receive their Master’s Degree.

Your grade in this course will be determined by the following criteria:

Grade Breakdown

AssignmentPoint Value% of Grade
Discussion Forums200 points (20 pts x 10 discussion forums)20%
Program Evaluation Selection100 points10%
Theory of Change/Logic Model100 points10%
Data Collection Plan & Research Questions200 points20%
Data Analysis Plan100 points10%
Sampling Plan, Recruitment & Dissemination of Results100 points10%
Final Research Proposal200 points20%
Total1,000 points100%

Grade Scale

Grade Points Grade Point Average (GPA)
A 94 – 100% 4.00
A- 90 – 93% 3.75
B+ 87 – 89% 3.50
B 84 – 86% 3.00
B- 80 – 83% 2.75
C+ 77 – 79% 2.50
C 74 – 76% 2.00
C- 70 – 73% 1.75
D 64 – 69% 1.00
F 00 – 63% 0.00

Schedule

Program Evaluation | Course Dates: January 2, 2019 – February 24, 2019

Each week begins on Wednesday at 12:01 a.m. and ends on Tuesday, 11:59 p.m. All assignments are to be submitted by 11:59 p.m. Eastern Time (ET) on the dates listed below. Unless otherwise specified below, all module discussions and assignments are due the last day of the module or unit week.

Module/Week

Readings/ Resources

Discussion(s)

Assignment

Week 1: Searching the Literature

1/2 – 1/8

 

 

Reading:

  • Case Study Research textbook:
    • Chapter 1: Getting Started: How to Know Whether and When to Use the Case Study As a Research Method, pages 1–25
    • Read Chapter 2: Designing Case Studies: Identifying Your Case(s) and Establishing the Logic of Your Case Study, pages 26–69
    • Appendix B: A Note on the Uses of Case Study Research in Evaluations, pages 219–228
  • The Logic Model Guidebook
    • Chapter 1: Introducing Logic Models, pages 2–15
    • Chapter 2: Building and Improving Theory of Change Logic Models, pages 16–30
  • Sample Program Evaluation Report

Lectures and Videos

  • What is a program evaluation? 
  • Logic models and theory of change for a program evaluation
  • Program Evaluation 
  • Program evaluation literature review

Week 1 Discussion Forum

 

Week 2: Evaluating the Literature

1/9 – 1/15

 

Reading

  • Program Evaluation and Performance Measurement textbook:
    • Chapter 1: Key Concepts and Issues in Program Evaluation and Performance Measurement, pages 1–44
    • Chapter 2: Understanding and Applying Program Logic Models, pages 45–88
    • Chapter 3: Research Designs for Program Evaluations, pages 89–144
    • Chapter 4: Measurement for Program Evaluation and Performance Monitoring, pages 145–186

Lectures and Videos

  • Participant oriented program evaluation
  • Introduction to program evaluation and literature

Week 2 Discussion Forum

 

 

Week 2 Assignment: Program Evaluation Selection

Week 3: Theory and Logic Model for Proposed Research Plan

1/16 – 1/22

 

 

Reading

  • In Case Study Research textbook:
    • Review Chapter 2: Designing Case Studies: Identifying Your Case(s) and Establishing the Logic of Your Case Study, pages 26–69
    • Chapter 5: Analyzing Case Study Evidence: How to Start Your Analysis, Your Analytic Choices, and How They Work, pages 132–175

Lectures and Videos

  • From Logic Model to Program Evaluation

 

Week 3 Discussion Forum 

Week 3 Assignment: Theory of Change or Logic Model

Week 4: Measurement

1/23 – 1/29

 

Reading

  • In Case Study Research textbook:
    • Chapter 3: Preparing to Collect Case Study Evidence: What You Need to Do Before Starting to Collect Case Study Data, pages 70–101
    • Chapter 4: Collecting Case Study Evidence: The Principles You Should Follow in Working With Six Sources of Evidence, pages 102–131
  • In The Logic Model Guidebook textbook:
    • Chapter 5: Logic Models for Evaluation, pages 64–86
  • In Program Evaluation and Performance Measurement textbook
    • Review Chapter 3: Research Designs for Program Evaluations, pages 89–144
    • Review Chapter 4: Measurement for Program Evaluation and Performance Monitoring, pages 145–186

Lectures and Videos

  • Measuring Program Impact
  • Measurement, Assessment and Evaluation

Week 4 Discussion Forum One

Week 4 Discussion Forum Two

Week 4 Assignment: Data Collection Plan & Research Questions

Week 5: Using Logic Models to Build Research Questions

1/30 – 2/5

 

Readings

  • In Program Evaluation and Performance Measurement textbook:
    • Review Chapter 3: Research Designs for Program Evaluations, pages 89–144
    • Review Chapter 4: Measurement for Program Evaluation and Performance Monitoring, pages 145–186

Lectures and Videos

  • Data Analysis

 

 

Week 5 Discussion Forum

Week 5 Assignment: Data Analysis Plan

Week 6: Aligning Research Questions and Measurements

2/6 – 2/12

 

Reading

  • In Case Study Research textbook:
    • Review Chapter 5: Analyzing Case Study Evidence: How to Start Your Analysis, Your Analytic Choices, and How They Work, pages 132–175.
  • In Program Evaluation and Performance Measurement textbook:
    • Chapter 5: Applying Qualitative Evaluation Methods,” pages 187–224.
    • Chapter 8: Performance Measurement As an Approach to Measurement, pages 309–336.
      • Pay attention to question 7 on page 221; the content this question addresses will be relevant for the first discussion in this module

Lectures and Videos

  • Data Collection and Analysis
  • How to Interpret Qualitative Data

Week 6 Discussion Forum One

Week 6 Discussion Forum Two: Submit draft of Research Proposal to Discussion Board and provide peer feedback to two classmates

 

 

Week 6 Assignment: Sampling Plan, Recruitment & Dissemination of Results

Week 7: Sampling, Recruitment and Dissemination Plan

2/13 – 2/19

 

Readings

  • In Program Evaluation and Performance Measurement textbook:
    • Chapter 9: Design and Implementation of Performance Design Systems, pages 337–374.
      • Pay attention to question 1 on page 366. The content this question addresses will be relevant for the discussion during this week.

Lectures and Videos

  • Evaluation Research Sampling
  • Different Sampling Methodologies

 

Week 7 Discussion Forum

 

 

Week 7 Assignment: Final Research Proposal

 Week 8: Action Plan

2/20 – 2/24

(Runs Wednesday to Sunday at 11:59 pm ET)

Reading

  • In Program Evaluation and Performance Measurement textbook:
    • Chapter 10: Using Performance Measurement for Accountability and Performance Improvement, pages 375–410

Lectures and Videos

  • 6 Steps to Effective Program Evaluation Planning
  • Evaluation Reasons and Results 

Week 8 Discussion Forum

 

Student Resources

Accommodations

Any student who would like to request, or ask any questions regarding, academic adjustments or accommodations must contact the Student Access Center at (207) 221-4438 or pcstudentaccess@une.edu. Student Access Center staff will evaluate the student's documentation and determine eligibility of accommodation(s) through the Student Access Center registration procedure.

Policies

Attendance Policy

Online students are required to submit a graded assignment/discussion prior to Sunday evening at 11:59 pm ET of the first week of the term. If a student does not submit a posting to the graded assignment/discussion prior to Sunday evening at 11:59 pm ET, the student will be automatically dropped from the course for non-participation. Review the full attendance policy.

Late Policy

Assignments: Late assignments will be accepted up to 3 days late; however, there is a 10% grade reduction (from the total points) for the late submission. After three days the assignment will not be accepted.

Discussion posts: If the initial post is submitted late, but still within the discussion board week, there will be a 10% grade reduction from the total discussion grade (e.g., a 3 point discussion will be reduced by 0.3 points). Any posts submitted after the end of the Discussion Board week will not be graded.

Please make every effort ahead of time to contact your instructor and your student support specialist if you are not able to meet an assignment deadline. Arrangements for extenuating circumstances may be considered by faculty.

Student Handbook Online - Policies and Procedures

The policies contained within this document apply to all students in the College of Graduate and Professional Studies. It is each student's responsibility to know the contents of this handbook.

UNE Online Student Handbook

UNE Course Withdrawal

Please contact your student support specialist if you are considering dropping or withdrawing from a course. The last day to drop for 100% tuition refund is the 2nd day of the course. Financial Aid charges may still apply. Students using Financial Aid should contact the Financial Aid Office prior to withdrawing from a course.

Academic Integrity

The University of New England values academic integrity in all aspects of the educational experience. Academic dishonesty in any form undermines this standard and devalues the original contributions of others. It is the responsibility of all members of the University community to actively uphold the integrity of the academy; failure to act, for any reason, is not acceptable. For information about plagiarism and academic misconduct, please visit UNE Plagiarism Policies.

Academic dishonesty includes, but is not limited to the following:

  1. Cheating, copying, or the offering or receiving of unauthorized assistance or information.
  2. Fabrication or falsification of data, results, or sources for papers or reports.
  3. Action which destroys or alters the work of another student.
  4. Multiple submissions of the same paper or report for assignments in more than one course without permission of each instructor.
  5. Plagiarism, the appropriation of records, research, materials, ideas, or the language of other persons or writers and the submission of them as one's own.

Charges of academic dishonesty will be reviewed by the Program Director. Penalties for students found responsible for violations may depend upon the seriousness and circumstances of the violation, the degree of premeditation involved, and/or the student’s previous record of violations.  Appeal of a decision may be made to the Dean whose decision will be final.  Student appeals will take place through the grievance process outlined in the student handbook.