Syllabus

Master of Social Work

SSWO 514 – Program Evaluation – Spring 2018

Credits - 3

Description

The course will build upon the knowledge, methods, and skills learned in foundation research courses. Students will learn how to critically assess research from ethical, multicultural, and social justice perspectives particularly in the context of agency-based research and program evaluation. An expectation is for students to collaborate with their field placement instructors, employers, or a community group with the aim of improving individual or community health through the lens of program evaluation and practice assessment. 

Materials

Required Readings:

Royse, D., Thyer, B. & Padgett, D. (2016). Program evaluation : an introduction to an evidence-based approach. Boston, MA: Cengage Learning. ISBN: 978-1305101968 

Publication Manual of the American Psychological Association. 6th Ed. Washington, DC: American Psychological Association, 2009. Print.

Additional Resources:

Additional readings include assigned journal articles that are accessible online or at the University of New England library. These will be presented in the Learning Modules.

Learning Objectives and Outcomes

School of Social Work Program Outcomes:

Graduates of the UNE SSWO will demonstrate knowledge, skills, and leadership in the following:

  1. Practice social inclusion to enable people, populations, and communities to fully participate in society, enhance human bonds in the context of cultural diversity and ensure improved quality of life and equitable resource distribution. EPAS Competencies 2 & 3
  2. Engage in culturally-informed relationship building, being respectful of the complexity and diversity of contexts and circumstances. EPAS Competencies 3 & 6
  3. Utilize theories of human behavior, social systems and social inclusion when offering interventions with people and their environments. EPAS Competency 8
  4. Promote ethical reflection, critical consciousness and shared decision-making based in social work values and with consideration of the broader contexts of the world in which we live. EPAS Competency 1
  5. Balance the roles of helpers, activists, and advocates through collaboration with communities to build healthy and sustainable resources. EPAS Competencies 2, 5, & 6
  6. Engage as critical consumers and producers of research as it relates to assessment, intervention and evaluation of clinical and community practices. EPAS Competencies 4, 7, 8 & 9
  7. Practice person-centered and collaborative community partnerships across diverse settings. EPAS Competency 6

Course Objectives

Upon successful completion of this course, students will:

  • Be competent consumers and producers of knowledge that informs their practice. PROGRAM OBJECTIVES 6. As measured by 1) DISCUSSION FORUMS, 2) ANNOTATED BIBLIOGRAPHIES, 3) FINAL PAPER INTRODUCTION, and 4) FINAL PAPER
  • Discuss the ethical and socio-political factors that influence the process of evaluation. PROGRAM OBJECTIVE 4. As measured by 1) DISCUSSION FORUMS, 2) FINAL PAPER, and 3) POWERPOINT PRESENTATION
  • Conceptualize and propose a program evaluation, which integrates and utilizes foundation research knowledge and critical thinking. PROGRAM OBJECTIVES 4 and 6. As measured by 1) DISCUSSION FORUMS, 2) ANNOTATED BIBLIOGRAPHIES, 3) FINAL PAPER INTRODUCTION, 4) FINAL PAPER, and 5) POWERPOINT PRESENTATION

Assignments

Your course grade will be determined by the following:     

Class Participation 

(Mandatory for a passing grade).   

  1. Participation: You are expected to participate in classroom discussions and demonstrate an understanding of course material and integration of course material. You are expected to provide a total of 3 posts per discussion board per week: one initial post and two substantial responses (i.e. 4-5 sentences in length) to peers, following APA 6th edition formatting as appropriate.
  2. This course is premised on the notion that social work practice is evidence-based and guided by critical thinking. You will be asked to complete three Annotated Bibliographies over the course of the term in the discussion boards. An Annotated Bibliography is a short (i.e., 2 single spaced pages) paper in which you provide the following information. Refer to the template document “Writing an Annotated Bibliography” for details. Students must follow the template format which includes:
    1. Full bibliographic information following APA 6 edition formatting
    2. Summary of research methods and findings
    3. Critical Assessment of the Article
    4. Statement of the Value of the Article (i.e. How it applies to the social work profession)  

    Each review will critique one journal article published within the last 5-10 years:

    1. The first annotated bibliography (Week 2 Discussion Board) must be relevant to qualitative methodology (i.e. needs assessment evaluation)pdfcrowd.com
    2. The second annotated bibliography (Week 3 Discussion Board) must be relevant to quantitative methodology (i.e. outcome evaluation)
    3. The third annotated bibliography (Week 5 Discussion Board) must be relevant to mixed methodology (i.e. process evaluation)
  3. Critique of PowerPoint presentations of Final Paper. You will actively participate in the review of peer presentations of their final paper. Microsoft PowerPoint must be used for this task. 

Final Paper 

Part 1 due Day 7 of Week 3 (200 points). Parts 1 and 2 due Day 7 of Week 7 (300 points)

For this paper you will work individually to conceptualize a program evaluation for a human service organization.  The final paper should be no more than 12 pages (Title page, abstract, references and Logic Model do not contribute to page count) in length following APA 6th edition formatting. You should have 5-8 scholarly references. Your paper will be submitted in two parts. Part 1 is due Day 7 of Week 3. Parts 1 and 2 (edits and revisions based on instructor feedback are required) is due Day 7 of Week 7. For the final paper, you are to use headings and sub-headings covering all the sections below:

Part 1 –Due Day 7 of Week 3

  1. Introduction (1 page)
    1. The agency or program of focus
    2. The mission/vision of the agency or program
    3. The client population served
    4. The services/entitlements/programs provided
    5. What is lacking in the agency or program that could benefit from an evaluation
  2. Background of the Program and Statement of the Evaluation Goals (1-2 pages)
    1. Describe the program, including its goals and objectives
    2. List the goals of your proposed evaluation. Specify the program evaluation approach   and the proposed methodology to be discussed in detail in Part 2.
  3. Brief Literature Review (2-3 pages): What is known already about evaluating this type of program? Have program evaluations been conducted? What was found? What is lacking?
  4. Logic Model (included as an Appendix): Provide a visual model on the selected agency and key components to consider for the evaluation proposal

    Parts 1 and 2 (edits and revisions based on instructor feedback are required) is due Day 7 of Week 7. Content for Part 2 is sections V-VII.

  5. Proposed Methodology (2-3 pages): How would you evaluate the program?
    1. Evaluation design (i.e. design is clearly stated and reasoning is provided)
    2. Sample (i.e. selected sampling frame and reasoning provided)
    3. Data collection techniques (i.e. how will data be collected?)
    4. Data collection instruments (i.e. what will be used to gather data?)
    5. Data Analysis (i.e. what is the overall process for qual or quan data?)
    6. Outcome measures (i.e. what are the objectives of this proposal?)
    7. Limitations of the study (i.e what are the proposed limitations? This will be discussed in detail in VII)
  6. Proposed Results (2-3 pages):
    1. What descriptive statistics would you use to describe the proposed sample?
    2. What statistical tests/analysis would you conduct?
    3. If implemented what could these findings mean?  What could account for these findings other than the intervention?
    4. How could the limitations of the study (the design, instrument, sample, reliability, validity) influence findings?
  7. Conclusions and Recommendations (2-3 pages)
    1. Recommendations regarding the program:  Based on your proposal, what does the program need to do? Are there cost/funding considerations?
    2. Recommendations for future evaluation research:  What recommendations would you make to other researchers interested in evaluating this type of program?  Be specific.

NOTE for Sections V and VI: The objective is for you to practice forward critical thinking. Based on the discussions of the proposed analysis and proposed results – what can you infer will be the next steps of the process? Based on the identified area of need in the Introduction, can you assess if the program goals are appropriate? These are just some (of many) items to consider.

PowerPoint Presentation 

Due Day 3 of Week 8 (100 points)

You will create a PowerPoint presentation of your final paper. Refer to the PowerPoint Presentation Rubric for the necessary items to include. You have creative freedom (i.e. font, color scheme, number of slides, etc) on this task. It is recommended that if images are included, they be Clip Art or public domain images in an effort to respect copyright laws. Post to the Discussion board AND submit to assignment link by day 3 of Week 8.

Grading Policy

The School of Social Work uses the following grading system for all courses with the exception of field education courses. Students are expected to maintain a “B” (3.0) average over the course of their study. Students with less than a GPA of 3.0 will be placed on academic probation. Students must have an overall GPA of 3.0 in order to receive their Master’s Degree.

Your grade in this course will be determined by the following criteria:

Grade Breakdown

AssignmentPoint Value% of Grade
Participation400 points (40 pts x 10 discussion forums)40%
Part 1 of Final Paper200 points20%
Parts 1 & 2 of Final Paper300 points30%
PowerPoint Presentation100 points10%
Total1,000 points100%

Grade Scale

Grade Points Grade Point Average (GPA)
A 94 – 100% 4.00
A- 90 – 93% 3.75
B+ 87 – 89% 3.50
B 84 – 86% 3.00
B- 80 – 83% 2.75
C+ 77 – 79% 2.50
C 74 – 76% 2.00
C- 70 – 73% 1.75
D 64 – 69% 1.00
F 00 – 63% 0.00

Schedule

Program Evaluation | Course Dates: October 25, 2017 – December 17, 2017

All assignments are to be submitted by 11:59 p.m. EST on the dates listed below. Unless otherwise specified below, all module discussions and assignments are due the last day of the module or unit week.

Module/Week

Readings/ Resources

Discussion(s)

Assignment

Module 1, Week 1: Program Evaluation Overview

 

(Runs Wed to Tuesday at 11:59 pm EST, February 28 – March 6)

 

Week 1 Reading: Chapters 1-2

 

Multimedia: Videos as listed in the module

Week 1 Discussion Forum

 

Module 2, Week 2: Program Evaluation Approaches: Needs Assessment, Qualitative and Mixed Methods

 

(Runs Wed to Tuesday at 11:59 pm EST, March 7 – 13)

 

Week 2 Reading: Chapter 3 Chapter 4 pp. 93-104

 

Multimedia: Videos as listed in the module

Annotated Bibliography: Qualitative

 

 

 

Module 2, Week 3: Program Evaluation Approaches: Formative and Process Evaluation

 

(Runs Wed to Tuesday at 11:59 pm EST, March 14 – 20)

 

 Week 3 Readings: Chapter 5

Multimedia: Videos as listed in the module

 

Discussion 1:

Week 3 Discussion Forum

Discussion 2:

Annotative Bibliography: Quantitative 

Submit Part of 1 of Final Paper by Day 7 of Week 3

Module 3, Week 4 Sampling

 

(Runs Wed to Tuesday at 11:59 pm EST, March 21 – 27)

 

Week 4 Reading: Chapter 8 and Chapter 11

 

Multimedia: Videos as listed in the module

Week 4 Discussion Forum

 

Module 3, Week 5 Data Analysis

 

(Runs Wed to Tuesday at 11:59 pm EST, March 28 – April 3)

 

Week 5 Reading: Chapter 4, pp. 104-113; Chapter 12

 

Multimedia: Videos as listed in the module

 

 

Annotated Bibliography: 

Mixed Methods 

 

Module 4, Week 6: Cost and Funding Considerations

 

(Runs Wed to Tuesday at 11:59 pm EST, April 4 – 10)

 

Week 6 Reading: Chapter 10

 

Websites: As listed in the module

 

Week 6 Discussion Forum

 

 

 

Module 5, Week 7: Writing Evaluation Proposals

 

(Runs Wed to Tuesday at 11:59 pm EST, April 11 – 17)

 

Week 7 Reading: Chapter 14

 

Week 7 Discussion Forum

 

 

Submit Parts 1 and 2 of Final Paper by Day 7 of Week 7.

Module 6,  Week 8:

 

(Runs Wed to Sunday at 11:59 pm EST, April 18 – 22)

Reading: Review Chapter 14

 

Multimedia: As listed in the module

Discussion 1: PowerPoints

 

Discussion 2: Reflective Discussion

Submit PowerPoint presentation to Dropbox by Day 5 of Week 8.

Student Resources

Accommodations

Any student who would like to request, or ask any questions regarding, academic adjustments or accommodations must contact the Student Access Center at (207) 221-4438 or pcstudentaccess@une.edu. Student Access Center staff will evaluate the student's documentation and determine eligibility of accommodation(s) through the Student Access Center registration procedure.

Policies

Attendance Policy

Online students are required to submit a graded assignment/discussion prior to Sunday evening at 11:59 pm ET of the first week of the term. If a student does not submit a posting to the graded assignment/discussion prior to Sunday evening at 11:59 pm ET, the student will be automatically dropped from the course for non-participation. Review the full attendance policy.

Late Policy

Assignments: Late assignments will be accepted up to 3 days late; however, there is a 10% grade reduction (from the total points) for the late submission. After three days the assignment will not be accepted.

Discussion posts: If the initial post is submitted late, but still within the discussion board week, there will be a 10% grade reduction from the total discussion grade (e.g., a 3 point discussion will be reduced by 0.3 points). Any posts submitted after the end of the Discussion Board week will not be graded.

Please make every effort ahead of time to contact your instructor and your student support specialist if you are not able to meet an assignment deadline. Arrangements for extenuating circumstances may be considered by faculty.

Student Handbook Online - Policies and Procedures

The policies contained within this document apply to all students in the College of Graduate and Professional Studies. It is each student's responsibility to know the contents of this handbook.

UNE Online Student Handbook

UNE Course Withdrawal

Please contact your student support specialist if you are considering dropping or withdrawing from a course. The last day to drop for 100% tuition refund is the 2nd day of the course. Financial Aid charges may still apply. Students using Financial Aid should contact the Financial Aid Office prior to withdrawing from a course.

Academic Integrity

The University of New England values academic integrity in all aspects of the educational experience. Academic dishonesty in any form undermines this standard and devalues the original contributions of others. It is the responsibility of all members of the University community to actively uphold the integrity of the academy; failure to act, for any reason, is not acceptable. For information about plagiarism and academic misconduct, please visit UNE Plagiarism Policies.

Academic dishonesty includes, but is not limited to the following:

  1. Cheating, copying, or the offering or receiving of unauthorized assistance or information.
  2. Fabrication or falsification of data, results, or sources for papers or reports.
  3. Action which destroys or alters the work of another student.
  4. Multiple submissions of the same paper or report for assignments in more than one course without permission of each instructor.
  5. Plagiarism, the appropriation of records, research, materials, ideas, or the language of other persons or writers and the submission of them as one's own.

Charges of academic dishonesty will be reviewed by the Program Director. Penalties for students found responsible for violations may depend upon the seriousness and circumstances of the violation, the degree of premeditation involved, and/or the student’s previous record of violations.  Appeal of a decision may be made to the Dean whose decision will be final.  Student appeals will take place through the grievance process outlined in the student handbook.