Outcomes Report

Outcomes for 2016

In an ongoing effort to look closely at the impact of what we do and to be ever vigilant in our drive to provide the highest quality and most effective and efficient services possible, targeted outcome expectations were established across all areas of our organization.

For a summary of our outcomes and results from FY ’16, please see our 2016 Annual Report.  For a complete list of outcome indicators, please continue.

Key terminology definitions, outcome results are as follows:

Definitions:

  • Social Competence: skills required for effective social interaction. Includes one’s ability to engage in verbal, or nonverbal methods such as taking perspective, greeting others, reciprocating conversation, body language, actively participate in a group, understanding how to respond in social situations, initiating and maintaining/nurturing relationships, and emotional regulation.
  • Transferrable (Soft Skills): Adaptive skills used in in daily activities, and typically required for competence in a work setting; e.g. independent initiation, accepting and responding to feedback, managing time, problem solving, decision making, organization, and follow through.
  • Functional: Set of skills necessary for increasing knowledge of  and accessing community resources, transportation planning and usage, money management, healthy lifestyle choice and safety.

Outcomes:

Effectiveness Outcomes

  • Objective: Maximize participant skill utilization
  • 1A – Measure: Percent of participants routinely practicing skills and/or using compensatory strategies related to individual goals  (overall skill categories)
  • Goal: 75%
  • 2016 Result: 78.5%
  • 1B – Measure: Percent of social competence goals routinely practiced or utilized during events
  • Goal:80%
  • 2016 Result: 87.9%
  • 1C – Measure: Percent of transferrable soft skill goals routinely practiced or utilized during events
  • Goal: 60%
  • 2016 Result: 72%
  • 1D – Measure: Percent of functional skill goals routinely practiced or utilized during events
  • Goal: 65%
  • 2016 Result: 67%

2. Objective: Maximize participant skill development – planning

  • Measure: Percent of social planning goals achieved as part of the Social Focus program
  • Goal: 50%
  • 2016 Result: 14.5%
  • Explanation:  Not valid as related to measure.  Results tallied for final event participation only.  The agency has adopted a more individualized approach to goals related to the planning process that can be measured and achieved regardless if the get-together occurs.

3.  Objective: Maximize participant skill generalization

  • Measure: Percent of participants with families indicating skill utilization occurs at home and /or the community
  • Goal: 75%
  • 2016 Result: 94%
  • Explanation: It is important to note that not only do participants recognize their ability to use skills outside of PTI events, but that family members see this as well. Overwhelmingly, PTI families reported an increase in generalization beyond the programmed PTI opportunities.

4. Objective: Maximize Social College results

  • Measure: Percent of participants that meet stated practice objectives of Social College courses
  • Goal: 80%
  • 2016 Results: 100%
  • Explanation: Maximizing Social College results is key to the long-term success of a person engaging in PTI services. Social College reinforces the fundamental skills necessary for successful interaction with others and supports the participant in recognizing how to apply those skills in settings that pertain to their everyday lives.

5. Objective: Optimize family participation & support

  • Measure: Percent of families participating in PTI-related activities (fundraising efforts, board, event volunteers, etc.)
  • Goal: 60%
  • 2016 Result: 47.4%
  • Explanation: PTI continually seeks ways to involve families. In situations where family members have become less active for age, geographic or financial reasons, PTI is working to engage siblings while maintaining an atmosphere that promotes greater independence from family.

6. Objective: Optimize staff competencies consistent with participant need

  • 6A – Measure: Percent of full-time program staff completing advanced Autism training
  • Goal: 100%
  • 2016 Result: 100%
  • Explanation: Two staff became Certified Autism Specialists in May/June of 2016.
  • 6B – Measure: Percent of staff attaining minimum amount of training required to advance knowledge for respective positions
  • Goal: 100%
  • 2016 Result: 100%
  • Explanation: As part of the 2016 Strategic Plan Update adopted in January of 2016, there is a goal to enhance program delivery techniques to maximize skill development. PTI staff is consistently provided the opportunities to further develop their knowledge and skills as well as engage with evidence-practice research partners to further develop program delivery models. As a result, PTI had four projects with local universities where evidence-based research was conducted to guide existing and future programs. In addition, PTI will place an emphasis during FY ’17 on identifying delivery methods that specifically address the wants and needs of those living with level 1 autism spectrum disorder.

7. Objective: Maximize program-level volunteer involvement

  • Measure: Percent of group programmatic events that will include volunteer involvement
  • Goal: 15%
  • 2016 Result: 23%

Efficiency Outcomes:

Pathways’ program structure is designed such that individuals can participate in the programs they feel best fit their objectives and at the frequency that best fits their learning styles and needs. To continually maximize efficiency, we monitor measures that tell us if we are being consistent and directing the resources in a way that encourages growth in a responsible manner.

  1. Objective: Maximize PTI participants
  • 1A – Measure: Percent increase in number of participants
  • Goal: 7%
  • 2016 Result: 4.58% (or 22%*)
  • Explanation: Served 137 individuals in FY ’16 through PTI standard programs compared to 131 in FY ’15.      * PTI saw a significant increase in the number of people served through our partnership with the MERS/Goodwill Autism Employment Program. The combination of standard programs and partnerships had us supporting 168 individuals, a 22% increase.
  • 1B – Measure: Percent increase in number of new participants (reported as new participants as a percentage of total participants)
  • Goal: 10%
  • 2016 Result: 15%
  • Explanation: PTI had 21 individuals begin services for the first time, representing 15% of all people participating in the PTI standard programs of Social Growth, Social Focus and Social College.

2. Objective: Maximize retention of PTI participants from previous fiscal year

  • Goal: 80%
  • 2016 Result: 89.3%
  • Explanation: 117 of 131 participants from FY ’15 continued supportive services in FY ’16.

3. Objective: Maximize allocated service units

  • 3A – Measure: Percent of publicly funded allocation of units that is utilized
  • Goal: 75%
  • 2016 Result: 90%
  • Explanation: PTI is allocated reimbursement funding from three different entities.  PTI utilized 1,910.5 of 2,125 combined units,  with 100% utilization by City of St. Louis residents, 186% utilization by individuals utilizing EMAP funds and 72% utilization by St. Charles County residents.  The St. Charles County utilization was expected as PTI enrollment continues to grow in that area, but has not reached the number forecasted.
  • 3B – Measure: Percent increase in total units served for fiscal year will be equal to or greater than the percent increase in the annual organizational expenses from the previous year.
  • Goal: 17.73%
  • 2016 Result: 19.04%
  • Explanation: In order to maintain unit (one hour of face-to-face) costs, PTI seeks to increase service units by a similar percentage as the increase in the overall agency budget. PTI saw a 17.73% increase in expenses in FY ’16 and had a 19.04% increase in units provided. This resulted in a 1.8% DECREASE to $42.36 in the average cost of each unit provided.

4. Objective: Maximize staff productivity

  • Measure: Staff members meeting productivity target (face-to-face hours) as a percentage of time worked for the year.
  • Goal: 7
  • 2016 Result: 5
  • Explanation: Of 2 who did not meet the target, 1 was within 2.5% and the other within 5%.

5.  Objective: Maximize income-based community relationships

  • Measure: Number of community -based relationships that generate income
  • Goal: equal to or greater than 2
  • 2016 Result: 1
  • Explanation: PTI partners with the MERS/Goodwill Autism Employment Program to provide the skill generalization component to the social skills portion of their training and is reimbursed set rate for each participant involved.  This partnership resulted in increased revenue opportunities over the previous year.

6. Objective: Maintain or decrease cost per unit of service delivery

  • Measure: Percent increase in unit cost in any one category of service delivery from previous fiscal year
  • Goal: Less than or equal to 10%
  • 2016 Result: 1.8% DECREASE
  • Explanation: Average unit rate DECREASE to $42.36 for each unit provided in FY ’16 compared to $43.15 in FY ‘ 15.

7. Objective: Maintain diversity of revenue sources

  • Measure: No one category will account for more than 40% of the total revenue
 Category Goal Range % Achieved
 Annual Contributions*  18-25%  19%
 Fundraising Revenue  15-22%  18.25%
 Corporate/Family Foundations  15-25%  36.04%
 Governmental Sources (DDRB, DDR, EMAP)  15-20%  14.06%
 Participant Fees  15-20%  11.69%
Investment Income 1-3% 0.78%
*Board Members (as a percentage of Annual Contributions) 10-15% 19.60%
  • Explanation: Revenue was further diversified during FY ’16 with no funding source representing more than 40% of the overall budget and all funding sources falling within a reasonable percentage of the goal for their respective category.

Satisfaction Outcomes:

  1. Objective: Maximize satisfaction with the PTI program
  • 1A – Measure: Percent of overall participant satisfaction with PTI program
  • Goal: 85%
  • 2016 Result: 97.60%
  • 1B – Measure: Percent of  overall family satisfaction with PTI program
  • Goal: 85%
  • 2016 Result: 91.70%
  • Explanation: Overall satisfaction with support services is extremely high both by participants and family members. Further, per the annual PTI survey conducted in June of 2016, 100% of respondents self-reported improved self-esteem and 98% reported improved self-confidence. 95% of family members report the successful transfer of skills to everyday life situations.
  • Social competence skills most commonly noted as improved include initiating friendships, participation in groups, and improved conversations. One area where more focus would benefit is in nurturing friendships.
  • Transferrable soft skills showed the greatest improvement in self-advocacy while initiating plans with others, planning and managing time continue to be areas where skill development is most needed.
  • Functional skills needing the most attention include transportation planning and financial management.

 

Qualitative Results:

Pathways, to me, is an outlet to grow, to develop, to get encouragement to believe in myself, to push forward toward higher goals – and to keep doing that over and over again, over a lifetime.

–          Preston, Pathways to Independence participant

As a parent who watched our son struggle for years to make any plans for socializing, I will forever be grateful to Pathways, which has enhanced his life immeasurably. He has made a number of good friends and is able to enjoy a variety of events. This has carried over into his ability to live independently and also his employment opportunities.”

–          Doris R., Parent

When I walk into a Pathways event, the first thing I see is friends. There is an ease and a comfort to it – a familiarity that is really nice.”

–          Leigh, Pathways to Independence participant

 

How PTI has benefited the individual participating:

Participant responses:

  • More community involvement
  • Making new friends
  • More social patterns
  • Increased independence
  • Improved skills
  • Improved confidence

Family member responses:

  • Participant is starting to accept help from others outside of family
  • More out-going and self-reliant
  • Initiates phone calls
  • More empathy
  • More problem-solving
  • More self-determination
  • Better conversationalist
  • Happier
  • Better understanding of admission fees, ect.
  • Better self-advocate
  • More independent

Referral sources responses:

  • Improved confidence
  • A stronger willingness to participate
  • Better able to establish and maintain friendships
  • More planning skills
  • More responsible time management

Participant Demographic Data:

Diagnoses:

  • 36%  Autism/PDD-NOS or Asperger’s Syndrome
  • 31%   Learning Disability
  • 18%   Intellectual Disability (mild)
  • 14%   AD(H)D
  • 9%    Borderline Intellectual Functioning
  • 8%    Written/Expressive Disorders
  • 2%    Developmental Brain Injury

(some individuals have multiple diagnoses resulting in a total exceeding 100%)

 

Associated trend: More people with an Autism Spectrum Disorder (ASD) diagnosis coming into program and with higher intellectual capacities and adaptive functioning.  Since 2012, those with an ASD diagnosis have increased from 12% of those served to 36%. This impacts programming needs to respond the associated needs.

Geographic location:

  • 8%     St. Louis City
  • 74%   St. Louis County
  • 18%   St. Charles County
  • One resident from Illinois

 

Associated trend: St. Charles County and St. Louis County participation continue to grow.  St. Charles County residents did not access our services until 2012 and 2016 saw an increase from 22 participants in FY ’15 to 26 individuals in FY ’16

Gender:

  • 42% female
  • 58% male

 

Associated trend: Those requesting services in the past two years have tended to be more males than females.  At one time, this was near even distribution.

Race:

  • 88% Caucasian
  • 12% African American

 

Associated trend: While still a small percentage, PTI has noticed more individuals of African-American descent participating.  Within the past few years, this percentage has increased from 7% to 12%.

Age Breakdown:

  • 2% –  18-19
  • 42% – 20s
  • 21% – 30s
  • 23% – 40s
  • 9%  –  50s

 

Associated trend: The average age of current participants is now younger as the number of people entering the program in increasing at a faster pace over the past few years. Most who enter our services are entering at the younger ages of 18-29.  Those who continue utilizing our services tend to stay involved several years.  Due to the age of our organization (founded in 1987), there is also a small group of individuals who are entering their 50’s.  We anticipate this age group to increase in the next few years while the youngest age categories also increase.  Those in their 20s and 30s should balance out with continuity in the program.

Length of involvement:

  • 39% – Two years or less
  • 40% – 3-9 years
  • 31% – 10+ years

 

Associated trend: PTI has seen a substantial increase in referrals who become active participants.  PTI is currently averaging almost 2 new participants each month, thus driving the first category below.

Income/Employment:

  • All participants fall within 250% of Federal poverty levels when considering earned income alone.
  • Many are utilizing Social Security Income as a source of monthly income.
  • 15% have requested additional scholarship assistance to participate.
  • 78% of survey respondents are employed. Of those, 62% are working at least 20 hours per week and 84% have been employed for at least one year in their current position.

 

Summary / Plan

Top Accomplishments of Past Year:

  • Two key staff members obtained Autism Specialist Certification
  • Enhanced our strategies to better measure and report participant and agency outcomes
  • Updated 3-year strategic plan
  • Introduced GAP and Relaxation programming
  • Continued expansion of services to St. Charles County residents
  • Increased funding partners and fundraising

Strategic Direction:

  • Reach additional individuals whose moderate levels of social competence and independence result in a feeling that they do not belong in the disability group but struggle to gain acceptance in society
  • Formally reduce staff to consumer ratios resulting in more Social Focus programming to deliver stronger training potential
  • Expand collaboration opportunities with partner agencies in response to unique needs of the population
    • MERS/Goodwill Industries Autism Employment Program
    • St. Louis Arc Connect Program
    • Center for Hearing and Speech Social College instruction
    • St. Louis University TEEN Connect
    • Best Buddies of Missouri
    • (Workshop) Social College consulting
  • Enhance awareness of PTI in the community through strategic referral and network contacts
  • Refinement of social college curriculum
  • Further increase capacity beyond the current maximum of 140 individuals
  • Reduce staff member caseloads by hiring additional regular FT or PT program staff
  • Enhance corporate and foundation support by building Board of Directors, Young Professionals Board and volunteer engagement

Ongoing Focus:

  • Provide ongoing opportunities to increase staff knowledge and competency
  • Continually recruit diverse professional skill sets to provide multi-dimensional approach to service
  • Monitor outcome measures, survey results and trends to proactively respond to needs, research and industry changes.
  • Increase episodic volunteer opportunities that support participant outcomes
  • Refine donor communication
  • Strengthen awareness of planned giving vehicles and annual giving options that benefit the donor and the organization