As housing reform takes place, it will be important to evaluate the outcomes to ensure the
changes made are making a positive difference to our clients. Best practices in housing identifies a number of indicators that should be measured to assess the success of housing reform. Improved access to housing and individualized services tailored to individual needs is an important indicator of positive change and should be measured and evaluated.
Programs and services should be provided in a psychosocial rehabilitation (PSR) environment in a recovery oriented system of care. The use of PSR principles throughout the residential and housing program would be considered a positive indicator of change and therefore should be assessed for evidence of its use.
It is also important to assess and evaluate the level of consumer involvement in the housing reform process. Consumers should play significant roles in any new housing redesign. Consumers can be involved in the evaluation of residential and housing programs through “self management tools”. Clients are the experts in their own mental health and therefore it is important to have clients participate in outcome measurement through this means.
Other indicators that would identify success with mental health housing reform would include an overall increase in housing capacity and a reduction of the number of people on waitlists for residential care and supported housing. A decrease in re-hospitalization rates for individuals with frequent hospitalizations prior to stable housing would also indicate positive outcomes.
Surveying consumer and family satisfaction is a useful tool to identify positive outcomes as well as identify areas for change. Objective surveys and direct contact with client and family
members would enable evaluators to continually monitor issues within the housing and residential program. This feedback could be utilized for improved services and program changes. Service accountability and a complaint management process could be established whereby consumers and family members can identify issues that may be related to housing issues. This will assist in evaluating current and future programs and initiate changes that may be necessary.
And one final indicator that could be utilized to evaluate the success of housing reform is evidence of increased and ongoing training in the area of psychosocial rehabilitation principles within a recovery oriented system of care. Best practices identify PSR as an important
orientation to any housing reform, and it will be important to monitor that a PSR oriented system if being established.
Along with the evaluation of housing redesign, there is a need to evaluate clinical program indicators. These indicators will be established in partnership with residential service providers, clinical staff, and other affected parties and be evaluated on a regular basis. Examples of clinical indicators that could be measured include medication related issues, illness stability, PSR activities, and reports of serious incidents.
Client self assessment can also be used in outcome measurement. Clients can ensure their “side of the story” is heard from their perspective with accurate data being obtained to assess
treatment efficacy. The BASIS-32 is one example of a self rating scaled that is used extensively in Canada, the United States and Australia. This rating scale measures the change in self- reported symptom and problem difficulty over the course of treatment.
Ongoing research along with evaluation is necessary to ensure programs remain viable and the most current and “cutting edge” programs are being developed. Data bases that collect statistical information and managed through “Information management systems” are necessary. Waitlists for current residential and housing services and identification of current vacancies in the housing and residential programs are two examples of the type of data that could be collected to improve program services.
The information management systems would ensure resources are used more efficiently, access to service and resources are improved, duplication of resources is reduced, and the development of public policy is well informed.
Evaluation & Research
Recommendation: It is recommended that ongoing program evaluation be implemented
throughout the housing and residential program to ensure appropriate outcomes are measured. Ongoing research is also necessary to ensure current housing trends are identified. Data collection managed through information management systems is also necessary to support both evaluation and research.
Objective To ensure the residential and housing programs are evaluated on an ongoing basis to assess outcome measures. Ongoing research activities are necessary to ensure the most current housing and residential trends and ideas are being identified and implemented.
Activity Outcome measurement will be implemented with new and current housing and residential programs.
Ongoing research into current trends in the housing and residential programs will be completed.
Data bases will be developed to capture statistical information and be supported by Information management systems.
Outcomes There will be ongoing evaluation and research processes established.
Data collection will identify current waitlists and vacancies in the housing and residential programs.
Performance Measures
Increased access to statistical and data information. Establishment of feedback mechanisms for program evaluation and improvement. Increased availability of information regarding new and innovative housing and residential programs.