Syllabus

Master of Social Work

SSW 514 – Program Evaluation

Credits - 3

Description

This course introduces students to social work research specific to program evaluation methods. Students will learn and discuss program evaluation assessment types and the research methodologies conducted in research and applied in practice. Students will conceptualize the steps involved in a program evaluation, for a human services organization, to demonstrate evidence based practices and the potential for social change among clients, organizations, and communities. The content of this course integrates other elements of the MSW curriculum and is designed to include resources that are relevant to direct and macro levels of practice.

Materials

Required Readings:

Royse, D., Thyer, B.A., & Padgett, D.K., (2010). Program evaluation : An introduction (5th ed.). Belmont, CA:Wadsworth, Cengage Learning. 

Publication Manual of the American Psychological Association. 6th Ed. Washington, DC: American Psychological Association, 2009. Print.

Additional Resources:

Additional readings include assigned journal articles that are accessible online or at the University of New England library. These will be presented in the Learning Modules.

Learning Objectives and Outcomes

School of Social Work Program Outcomes:

Graduates of the UNE SSWO will demonstrate knowledge, skills, and leadership in the following:

  1. Practice social inclusion to enable people, populations, and communities to fully participate in society, enhance human bonds in the context of cultural diversity and ensure improved quality of life and equitable resource distribution. EPAS Competencies 2 & 3
  2. Engage in culturally-informed relationship building, being respectful of the complexity and diversity of contexts and circumstances. EPAS Competencies 3 & 6
  3. Utilize theories of human behavior, social systems and social inclusion when offering interventions with people and their environments. EPAS Competency 8
  4. Promote ethical reflection, critical consciousness and shared decision-making based in social work values and with consideration of the broader contexts of the world in which we live. EPAS Competency 1
  5. Balance the roles of helpers, activists, and advocates through collaboration with communities to build healthy and sustainable resources. EPAS Competencies 2, 5, & 6
  6. Engage as critical consumers and producers of research as it relates to assessment, intervention and evaluation of clinical and community practices. EPAS Competencies 4, 7, 8 & 9
  7. Practice person-centered and collaborative community partnerships across diverse settings. EPAS Competency 6

Course Objectives

Upon successful completion of this course, students will:

  • Be competent consumers and producers of knowledge that informs their practice. PROGRAM OBJECTIVES 6. As measured by 1) DISCUSSION FORUMS, 2) ANNOTATED BIBLIOGRAPHIES, 3) FINAL PAPER INTRODUCTION, and 4) FINAL PAPER
  • Discuss the ethical and socio-political factors that influence the process of evaluation. PROGRAM OBJECTIVE 4. As measured by 1) DISCUSSION FORUMS, 2) FINAL PAPER, and 3) POWERPOINT PRESENTATION
  • Conceptualize and propose a program evaluation, which integrates and utilizes foundation research knowledge and critical thinking. PROGRAM OBJECTIVES 4 and 6. As measured by 1) DISCUSSION FORUMS, 2) ANNOTATED BIBLIOGRAPHIES, 3) FINAL PAPER INTRODUCTION, 4) FINAL PAPER, and 5) POWERPOINT PRESENTATION

Assignments

Your course grade will be determined by the following:     

Class Participation 

(Mandatory for a passing grade).   

  1. Participation: You are expected to participate in classroom discussions and demonstrate an understanding of course material and integration of course material. You are expected to provide a total of 3 posts per discussion board per week: one initial post and two substantial responses (i.e. 4-5 sentences in length) to peers, following APA 6th edition formatting as appropriate.
  2. This course is premised on the notion that social work practice is evidence-based and guided by critical thinking. You will be asked to complete three Annotated Bibliographies over the course of the term in the discussion boards. An Annotated Bibliography is a short (i.e., 2 single spaced pages) paper in which you provide the following information. Refer to the template document “Writing an Annotated Bibliography” for details. Students must follow the template format which includes:
    1. Full bibliographic information following APA 6 edition formatting
    2. Summary of research methods and findings
    3. Critical Assessment of the Article
    4. Statement of the Value of the Article (i.e. How it applies to the social work profession)  

    Each review will critique one journal article published within the last 5-10 years:

    1. The first annotated bibliography (Week 2 Discussion Board) must be relevant to qualitative methodology (i.e. needs assessment evaluation)pdfcrowd.com
    2. The second annotated bibliography (Week 3 Discussion Board) must be relevant to quantitative methodology (i.e. outcome evaluation)
    3. The third annotated bibliography (Week 5 Discussion Board) must be relevant to mixed methodology (i.e. process evaluation)
  3. Critique of PowerPoint presentations of Final Paper. You will actively participate in the review of peer presentations of their final paper. Microsoft PowerPoint must be used for this task. 

Final Paper 

Part 1 due Day 7 of Week 3 (200 points). Parts 1 and 2 due Day 7 of Week 7 (300 points)

For this paper you will work individually to conceptualize a program evaluation for a human service organization.  The final paper should be no more than 12 pages (Title page, abstract, references and Logic Model do not contribute to page count) in length following APA 6th edition formatting. You should have 5-8 scholarly references. Your paper will be submitted in two parts. Part 1 is due Day 7 of Week 3. Parts 1 and 2 (edits and revisions based on instructor feedback are required) is due Day 7 of Week 7. For the final paper, you are to use headings and sub-headings covering all the sections below:

Part 1 –Due Day 7 of Week 3

  1. Introduction (1 page)
    1. The agency or program of focus
    2. The mission/vision of the agency or program
    3. The client population served
    4. The services/entitlements/programs provided
    5. What is lacking in the agency or program that could benefit from an evaluation
  2. Background of the Program and Statement of the Evaluation Goals (1-2 pages)
    1. Describe the program, including its goals and objectives
    2. List the goals of your proposed evaluation. Specify the program evaluation approach   and the proposed methodology to be discussed in detail in Part 2.
  3. Brief Literature Review (2-3 pages): What is known already about evaluating this type of program? Have program evaluations been conducted? What was found? What is lacking?
  4. Logic Model (included as an Appendix): Provide a visual model on the selected agency and key components to consider for the evaluation proposal

    Parts 1 and 2 (edits and revisions based on instructor feedback are required) is due Day 7 of Week 7. Content for Part 2 is sections V-VII.

  5. Proposed Methodology (2-3 pages): How would you evaluate the program?
    1. Evaluation design (i.e. design is clearly stated and reasoning is provided)
    2. Sample (i.e. selected sampling frame and reasoning provided)
    3. Data collection techniques (i.e. how will data be collected?)
    4. Data collection instruments (i.e. what will be used to gather data?)
    5. Data Analysis (i.e. what is the overall process for qual or quan data?)
    6. Outcome measures (i.e. what are the objectives of this proposal?)
    7. Limitations of the study (i.e what are the proposed limitations? This will be discussed in detail in VII)
  6. Proposed Results (2-3 pages):
    1. What descriptive statistics would you use to describe the proposed sample?
    2. What statistical tests/analysis would you conduct?
    3. If implemented what could these findings mean?  What could account for these findings other than the intervention?
    4. How could the limitations of the study (the design, instrument, sample, reliability, validity) influence findings?
  7. Conclusions and Recommendations (2-3 pages)
    1. Recommendations regarding the program:  Based on your proposal, what does the program need to do? Are there cost/funding considerations?
    2. Recommendations for future evaluation research:  What recommendations would you make to other researchers interested in evaluating this type of program?  Be specific.

NOTE for Sections V and VI: The objective is for you to practice forward critical thinking. Based on the discussions of the proposed analysis and proposed results – what can you infer will be the next steps of the process? Based on the identified area of need in the Introduction, can you assess if the program goals are appropriate? These are just some (of many) items to consider.

PowerPoint Presentation 

Due Day 3 of Week 8 (100 points)

You will create a PowerPoint presentation of your final paper. Refer to the PowerPoint Presentation Rubric for the necessary items to include. You have creative freedom (i.e. font, color scheme, number of slides, etc) on this task. It is recommended that if images are included, they be Clip Art or public domain images in an effort to respect copyright laws. Post to the Discussion board AND submit to assignment link by day 3 of Week 8.

Grading Policy

The School of Social Work uses the following grading system for all courses with the exception of field education courses. Students are expected to maintain a “B” (3.0) average over the course of their study. Students with less than a GPA of 3.0 will be placed on academic probation. Students must have an overall GPA of 3.0 in order to receive their Master’s Degree.

Your grade in this course will be determined by the following criteria:

Grade Breakdown

AssignmentPoint Value% of Grade
Participation400 points (40 pts x 10 discussion forums)40%
Part 1 of Final Paper200 points20%
Parts 1 & 2 of Final Paper300 points30%
PowerPoint Presentation100 points10%
Total1,000 points100%

Grade Scale

Grade Points Grade Point Average (GPA)
A 94 – 100% 4.00
A- 90 – 93% 3.75
B+ 87 – 89% 3.50
B 84 – 86% 3.00
B- 80 – 83% 2.75
C+ 77 – 79% 2.50
C 74 – 76% 2.00
C- 70 – 73% 1.75
D 64 – 69% 1.00
F 00 – 63% 0.00

Schedule

Program Evaluation | Course Dates: June 28, 2017 – August 20, 2017

All assignments are to be submitted by 11:59 p.m. EST on the dates listed below. Unless otherwise specified below, all module discussions and assignments are due the last day of the module or unit week.

Module/Week

Readings/ Resources

Discussion(s)

Assignment

Module 1, Week 1: Program Evaluation Overview

 

(Runs Wed to Tuesday at 11:59pm EST, June 28 – July 4)

 

Week 1 Reading: Chapters 1-2

 

Multimedia:

 

Videos as listed in the module

Week 1 Discussion Forum

 

Module 2, Week 2: Program Evaluation Approaches: Needs Assessment, Qualitative and Mixed Methods

 

(Runs Wed to Tuesday at 11:59pm EST, July 5 – July 11)

 

Week 2 Reading: Chapter 3-4

 

Multimedia: Videos as listed in the module

Annotated Bibliography: Qualitative

 

 

 

Module 2, Week 3: Program Evaluation Approaches: Formative and Process Evaluation

 

(Runs Wed to Tuesday at 11:59pm EST, July 12 – July 18)

 

 Week 3 Readings: Chapter 5

Multimedia: videos as listed in the module

 

Discussion 1:

Week 3 Discussion Forum

Discussion 2:

Annotative Bibliography: Quantitative 

Submit Part of 1 of Final Paper by Day 7 of Week 3

Module 3, Week 4 Sampling

 

(Runs Wed to Tuesday at 11:59pm EST, July 19 – July 25)

 

Week 4 Reading: Chapter 8

 

Multimedia: videos as listed in the module

Week 4 Discussion Forum

 

Module 3, Week 5 Data Analysis

 

(Runs Wed to Tuesday at 11:59pm EST, July 26 – August 1)

 

Week 5 Reading: Chapter 14

Review Chapter 4, pp. 93-97

 

Multimedia: videos as listed in the module

 

 

Annotated Bibliography: 

Mixed Methods 

 

Module 4, Week 6: Cost and Funding Considerations

 

(Runs Wed to Tuesday at 11:59pm EST, August 2 – August 8)

 

Week 6 Reading: Chapter 10

 

Websites: as listed in the module

 

Week 6 Discussion Forum

 

 

 

Module 5, Week 7: Writing Evaluation Proposals

 

(Runs Wed to Tuesday at 11:59pm EST, August 9 – August 15)

 

Week 7 Reading: Chapter 15

 

Week 7 Discussion Forum

 

 

Submit Parts 1 and 2 of Final Paper by Day 7 of Week 7.

Module 6,  Week 8:

 

(Runs Wed to Sunday at 11:59pm EST, August 16 – August 20)

Reading: Review Chapter 15 of Royse, et al (2010)

 

Multimedia: as listed in the module

Discussion 1: PowerPoints

 

Discussion 2: Reflective Discussion

Submit PowerPoint presentation to Dropbox by Day 5 of Week 8.

Student Resources

Online Student Support

Your Student Support Specialist is a resource for you. Please don't hesitate to contact them for assistance, including, but not limited to course planning, current problems or issues in a course, technology concerns, or personal emergencies.

Questions? Visit the Student Support Social Work page

UNE Libraries:

Information Technology Services (ITS)

ITS Contact: Toll Free Help Desk 24 hours/7 days per week at 1-877-518-4673

Policies

Late Policy

You will receive a 10% deduction on work submitted late. The 10% deductions reflect the total point value of each assignment unless the instructor receives university documentation granting extensions. Documentation received by University of New England’s Office of Disabilities granting accommodations should be forwarded to the course instructor immediately. Accommodations are not retroactive and are made available upon receipt of documentation.

 

Written Work

All  written  work  should  be  typed  and  double-spaced and submitted in Microsoft Word (doc or docx) format. Work must include in-text citations and full reference information following APA 6th edition formatting. Students  who  are  not  clear   about  proper  format  are  encouraged  to  consult  the  U.N.E.  Learning  Assistance   Center  or  various  library,  online,  and  other  resources  to  get  this  information  (click   on  “University  Resources”  in  the  navigation  menu  to  access  these  resources).   Material  obtained  from  the  Internet  should  be  referenced  and  limited  to  recognized   scholarly,  academic,  or client/consumer-­oriented  sources  (such  as  on­line  journals   and  information  from  advocacy  oriented  organizations).  Gender-­neutral  language   should  be  used  throughout  all  written  assignments.

Extensions and Incompletes

Under  normal  circumstances,  there  will  be  no  extensions  for  papers  or  other   assignments,  or  incompletes  for  the  course.    If  you  have  concerns  about  an   assignment,  please  discuss  with  the  instructor  well  in  advance  of  the  due  date.  If  you   have  reason  to  believe  that  you  will  be  unable  to  complete  the  work,  contact  the   Course  Instructor  immediately.  Refer to Late Policy information.

Essential Academic and Technical Standards

Please review the essential academic and technical standards of the University of New England School Social Work (SSW): https://online.une.edu/social-work/academic-and-technical-standards-une-online-ssw/

Technology Requirements

Please review the technical requirements for UNE Online Graduate Programs: Technical Requirements

Confidentiality Statement

Student and faculty participation in this course will be governed by standards in the NASW Code of Ethics relating to confidentiality in sharing information from their placement sites and practice experiences. Students should be aware that personal information they choose to share in class, class assignments or conversations with faculty does not have the status of privileged information.