Office for People With Developmental Disabilities

Print: Print this page

Evaluation Ideas for OPTS Proposals

04/10/12

This document provides a few examples of outcomes and ways to measure outcomes that may be relevant to OPTS proposals. These are just examples. OPWDD is not recommending that these outcomes are appropriate for all OPTS proposals. However, the outcomes and measurement tools identified in the following examples are meant to be a model for providers who will be developing an evaluation for an OPTS proposal.

Examples of outcomes for residential oriented OPTS Pilot Projects

Outcome A: Community inclusion will be increased through the participation of individuals and small groups in preferred community activities.

Indicator 1A: An increase in the number of places and groups individuals interact with on a regular basis within the community

Measurement for Indicator 1A: The number and diversity of places visited by the individual receiving services. Data on community participation will be recorded daily for three months prior to the start of the pilot. This data will continue to be recorded through the first year of the project. At the six month and one year mark, staff will determine how community inclusion changed as a result of the OPTS pilot project by examining changes in the following areas: the # of places visited, the regularity of these visits, and the frequency individuals were able to visit preferred locations.

Indicator 2A: A decrease in the size of groups attending community events

Measurement for Indicator 2A: Group size while participating in community events. Staff members will document the size of the group attending community activities and events. This information will be gathered for six months before the implementation of the OPTS pilot project and collected on an ongoing basis after implementation. Statistics about group size from before and after implementation will be compared.

Outcome B: Individuals will increase their independence at home and in the community.

Indicator 1B: Scores generated from The Arc’s Self-Determination Scale1 . This scale asks individuals about whether they are actively involved in areas like: routine personal care, interaction with the environment, recreation, community and personal expression. (Wehmeyer, Ph.D and Kelchner, M.Ed., 1995). The section of the scale relating to “Autonomy” will be distributed to individuals receiving services before implementation of the OPTS pilot project. The scale will be redistributed six months after implementation to determine whether individuals perceive themselves as more independent than before their involvement in the OPTS pilot. Increased scores are an indicator that individuals have become more autonomous.

Indicator 2B: Increased knowledge of how to access transportation within the community

Measurement of Indicator 2B: Scores from an interview process that gauges ability to use transportation independently. The individual will be interviewed about their ability to do tasks that are related to community mobility. For example, during the interview, the individual will be asked to read a schedule and complete other tasks related to riding public transportation. The interviewer will make a yes/no determination about whether the person successfully completed the tasks presented to them during the interview. Many "yes" determinations are an indication that the individual can move around independently in the community. This interview will be administered before receiving OPTS services and six months afterward to determine whether skills have improved. Components of the interview will also include assessing whether the person knows how to use the public transportation system to get to often frequented places and, also, to places that he or she has never been to before. Does he or she know the nearest bus/train stop or how to use a transfer?

Examples of outcomes for vocational oriented OPTS Pilot Projects

Outcome A: Individual will improve work-related skills

Indicator 1A: Scores from, for example, the Becker Work Adjustment Profile (Becker, Ralph, 1989)2 or other similar instrument. This profile measures a worker’s work habits, skills and attitudes. The profile includes questions about personal hygiene, motivation, cooperation and other areas related to becoming a successful worker. An individual who closely observes the individual being evaluated on a daily basis will act as the "rater" on all of the areas covered by the profile. Through rating the individual in all of these areas, a determination will be made about their employability status. The Becker Profile or similar instrument can be administered before implementation of the OPTS pilot project and again after participation in the pilot for some time.

Outcome B: The individual will increase his or her vocational opportunities

Indicator 1B: Increased earnings and hours worked

Measurement of Indicator 1B: The amount of money the individual earns. Earnings from a reasonable period of time before the implementation OPTS will be compared to earnings while the OPTS pilot is in existence. The same method will be used to track hours worked.

Indicator 2B: Increased access to different kinds of jobs

Measurement of Indicator 2B: The number of job interviews the person attends. The number of interviews the individual participated in before receiving services through OPTS (looking back over a reasonable amount of time) will be compared to those after implementation of the OPTS pilot project. The type of job the person was interviewing for will also be tracked (both before and after the OPTS pilot) in order to show that diversity in job opportunities has increased after implementation of the OPTS pilot.

Outcome C: The individual will experience increased job satisfaction.

 

Measurement of Outcome C: Scores generated from a survey that asks the consumer to compare the job they have now to the best job they have held so far. The person receiving services will be asked to think about the best job that they have held prior to OPTS. An interview will be administered to determine how the job held after OPTS services were received compares to the individual best job. The individual will be prompted during the interview about several different areas related to work. Does he or she feel confident (more so? about the same? less so?) performing his or her job tasks? A “more so” response would generate a +1, “about the same” generates a 0, and “less so” generates a -1. All questions in the interview will be tallied generating an overall satisfaction score.

 

1 Title: The ARC’s Self-Determination Scale
Author: Wehmeyer, M.
Link: www.beachcenter.org/Books/FullPublications/PDF/TheArcsSelfDeterminationScale.pdf

2 Title: Becker Work Adjustment Profile
Author: Becker, Ralph L.
Publisher: Elbern Publications
Publisher Telephone: 614-231-1950; FAX: 614-237-2637

OPTS Main Page