Outcome monitoring Empowerment of clients and their local and national representatives

Transcriptie

1 Outcome monitoring Empowerment of clients and their local and national representatives Chris Nas Senior policy advisor WHO Collaborating Centre for Research and Training Lille, January 31 th 2014

2 About GGZ Nederland Dutch Association of Mental Health and Addiction Care Chris Nas Between leading the nationwide programme for ROM in Mental Health (joint programme of client organisations, professional associations and service providers) works for GGZ Nederland Sector organisation in the Netherlands for mental healthcare. With more than 100 member organisations Providing 95% of specialist mental healthcare in the Netherlands To 815,800 unique clients (children and adults) Services are prevention, addiction care, outpatient care, acute clinical care, sheltered housing/assisted living, forensic care. For which they employ 89,500 staff Turnover 5.4 billion (10.6 % of Dutch healthcare expenditure) GGZ Nederland (2013), GGZ in de Zorgverzekeringswet 2

3 When you leave this room, I hope you will take this home with you Outcome monitoring empowers clients and their representatives, because it facilitates: shared decision making in treatment on the level of clients and professionals; professional reflection on the level of teams, departments and/or providers; transparency on relevance and effectiveness of treatments and guidelines; transparency on effectiveness of mental health care organisations. 3

4 Outcome measurement is primarily an aid for clients and mental health workers Clients fill in questionnaires at the beginning, during and end of treatment or support. Measuring: reduction of symptoms functioning in daily life quality of life 4

5 Quality of Life questionnaire (QoL+) Could you please tell how satisfied you are with.. 1). your housing situation? ). your relations with people? ). your physical health? ). your mental health? ). your financial situation? ). your work? ). your life in general? ). the support you receive?

6 What does this QoL+ scores tell us about the quality of life of a person?

7 What does 2 nd QoL+ base line say about recovery of a person?

8 Outcome measurement provides a base for shared decision making

9 Collecting and analysing outcome data is possible and meaningful Clinical recovery (according to RCI) A B C D % Recovered 31% 39% 23% 28% % Reliable improved 11% 13% 19% 21% % No change 55% 43% 50% 43% % Reliable aggravated 4% 6% 9% 8% Results of pilot in 2011 of 4 mental health services providers in long term mental health care on the basis of HONOS questionnaires. Not corrected or standardised for case mix. RCI = Reliable Change Index (RCI). 9

10 as shown by this comparison of the aggregated outcomes. Clinical recovery (according to RCI) A B C D % Recovered 31% 39% 23% 28% % Reliable improved 11% 13% 19% 21% % No change 55% 43% 50% 43% % Reliable aggravated 4% 6% 9% 8% Results of pilot in 2011 of 4 mental health services providers in long term mental health care on the basis of HONOS questionnaires. Not corrected or standardised for case mix. RCI = Reliable Change Index (RCI). 10

11 Internal benchmark of mental health provider in child and youth psychiatry Instroom Uitstroom IOG-EV IOG-EV IOG 13/18 IOG 13/18 PMTO PMTO IOG 6/12 IOG 6/12 IOG 0/5 IOG 0/5 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100 % Geen problemen Matige problemen Ernstige problemen 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100 % Geen problemen Matige problemen Ernstige problemen 11

12 Accumulation of outcome data are opportunity to discuss performance National Benchmark Institute collects anonymous outcome data nationwide. LPGGZ (national client platform) is board member and therefore in the position to influence criteria performance assessment. Local client organisations are able to assess the performance of their service provider and discuss results with board of directors. 12

13 In the nationwide project ROM MH, clients participated in various ways Full member Steering Committee Co-author of statement Vision on Outcome Monitoring in Mental Health Initiating projects: Meetings with client and family councils Client expert groups on ROM 8 short movies for clients, family and client councils about questionnaires Critical appraisal of existing questionnaires 13

14 Meetings with client and family councils with over 100 participants What is ROM exactly? Who makes these questionnaries? Who uses the outcomes? What is in it for us? How do we get the case worker to discuss my personal outcomes? 14

15 Eight short movies on ROM (in Dutch without subtitles): 15

16 Room for improvement: develop questionnaires with peer experts Checklist ROM-instrumentarium voor de doelgroep Kinderen & Jeugd Instrument Kwaliteit Meetpretentie Inspanning cliënt Inspanning behandelaar Normering Kosten ASEBA (CBCL voor ouders/fam, TRF voor leerkrachten, YSR voor jeugdigen) items SDQ Diverse versies tbv leeftijd kind 25 items + schaal en 8 items HoNOSCA 15 items Goed Ernst van de problematiek Voldoende tot goed Voldoende tot goed; Ernst van de problematiek (met aan-vulling op dagelijks functioneren) Dagelijks functioneren CBCL: minuten, beoordelingslijst ouders TRF: minuten, beoordelingslijst leerkracht YSR: minuten, zelfinvullijst kind Waardering gebruik: onbekend Papier & potlood: 5 minuten, zelfinvullijst kind of observatielijst oudere/familie of leerkracht Waardering gebruik: onbekend Meest gebruikt als observatielijst geen activiteit door cliënt Waardering gebruik: onbekend Scoring & intepretatie: plm. 10 minuten Ja Terugkoppeling aan cliënt: betrekkelijk snel en efficiënt Geen specifieke training nodig. Algemeen: kennis over gestandaardiseerde diagnostische onderzoeksmethoden en opleiding gericht op werken met ouders en kinderen Scoring & intepretatie: 15 minuten Ja Terugkoppeling aan cliënt: onbekend Training: 1 uur vertrouwd raken met materiaal, instructies en handleiding. Geen herhaling noodzakelijk. Afnameduur: minuten Nee Terugkoppeling aan cliënt: onbekend Training: 1x training, 1x hertraining en daarna jaarlijkse supervisie bijeenkomsten Questionnaires made by experts for research Appreciation clients was lacking completely Reduction of symptoms instead of recovery 7,- per 10 stuks Paper & pencil: gratis downloaden; Online afname of digitalisering: 0,15 per afname Engelse versie gratis te downloaden 16

17 Outcome monitoring: driver for client empowerment shared decision making in treatment on the level of clients and professionals; professional reflection on the level of teams, departments and/or providers; transparency on relevance and effectiveness of treatments and guidelines; transparency on effectiveness of mental health care organisations. 17