Original Study| Volume 19, ISSUE 8, P663-671, August 2018

Process Evaluation of an Intervention for the Management of Neuropsychiatric Symptoms in Young-Onset Dementia



      A process evaluation was performed for an intervention aimed at improvement of the management of neuropsychiatric symptoms in young-onset dementia. Data about sample quality and intervention quality was evaluated to better understand internal and external validity. In addition, data about the implementation strategy and factors affecting implementation were evaluated to improve further implementation of the intervention.


      A model proposed by Leontjevas and colleagues consisting of first-order (validity) and second-order (implementation) data was used.

      Setting and Participants

      Care units delivering specialized treatment and support for residents with young-onset dementia.


      A description of the recruitment, randomization procedure, and intervention reach was carried out to determine sample quality. To determine intervention quality, data on satisfaction, relevance, feasibility, and fidelity were collected through a questionnaire and reports logged on the server of the web-based intervention. A description of the implementation strategy was provided. Barriers and facilitators for implementation were collected by a questionnaire and analyzed by deductive content analysis.


      Care units varied in size and were recruited from different geographical regions in the Netherlands. The informed consent rate of the residents was 87.7%. The majority of the nursing home staff were satisfied with the intervention. However, parts of the intervention were perceived as less relevant for their own organization. The feasibility of the intervention was considered low. The fidelity differed between care units. The implementation strategy did not overcome all barriers. Factors affecting implementation covered 3 themes: organizational aspects, culture of the organization, and aspects of the intervention.


      In general, our results showed sufficient internal and external validity, warranting further effect analyses. Adaptations to specific steps of the care program should be considered to increase feasibility and sustainability. In addition, integration of the care program into the electronic health records is expected to further improve implementation.


      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'


      Subscribe to Journal of the American Medical Directors Association
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect


        • Mulders A.J.M.J.
        • Fick I.W.F.
        • Bor H.
        • et al.
        Prevalence and correlates of neuropsychiatric symptoms in nursing home patients with young-onset dementia: The BEYOnD Study.
        J Am Med Dir Assoc. 2016; 17: 495-500
        • Mulders A.J.M.J.
        • Zuidema S.U.
        • Verhey F.R.
        • Koopmans R.T.C.M.
        Characteristics of institutionalized young onset dementia patients—The BEYOnD study.
        Int Psychogeriatr. 2014; 12: 1973-1981
        • Wetzels R.
        • Zuidema S.
        • de Jonghe J.
        • et al.
        Determinants of quality of life in nursing home residents with dementia.
        Dement Geriatr Cogn Disord. 2010; 29: 189-197
        • Murman D.L.
        • Chen Q.
        • Powell M.C.
        • et al.
        The incremental direct costs associated with behavioral symptoms in AD.
        Neurology. 2002; 59: 1721-1729
        • Zwijsen S.A.
        • Kabboord A.
        • Eefsting J.A.
        • et al.
        Nurses in distress? An explorative study into the relation between distress and individual neuropsychiatric symptoms of people with dementia in nursing homes.
        Int J Geriatr Psychiatry. 2014; 29: 384-391
        • Ballard C.G.
        • Margallo-Lana M.L.
        The relationship between antipsychotic treatment and quality of life for patients with dementia living in residential and nursing home care facilities.
        J Clin Psychiatry. 2004; 65: 23-28
        • Gonzalez-Salvador T.
        • Lyketsos C.G.
        • Baker A.
        • et al.
        Quality of life in dementia patients in long-term care.
        Int J Geriatr Psychiatry. 2000; 15: 181-189
        • Appelhof B.
        • Bakker C.
        • van Duinen-van den IJssel J.C.L.
        • et al.
        The determinants of quality of life of nursing home residents with young-onset dementia and the differences between dementia subtypes.
        Dement Geriatr Cogn Disord. 2017; 43: 320-329
        • van Duinen-van den IJssel J.C.L.
        • Appelhof B.
        • Zwijsen S.A.
        • et al.
        Behavior and Evolution of Young-ONset Dementia part 2 (BEYOND-II) study: An intervention study aimed at the improvement of the management of challenging behavior in institutionalized people with young-onset dementia.
        Int Psychogeriatr. 2017; (Epub ahead of print)
        • Leontjevas R.
        • Gerritsen D.L.
        • Koopmans R.T.C.M.
        • et al.
        Process evaluation to explore internal and external validity of the “Act in Case of Depression” care program in nursing homes.
        J Am Med Dir Assoc. 2012; 13: 488.e1-488.e8
        • Eldridge S.
        • Ashby D.
        • Bennet C.
        • et al.
        Internal and external validity of cluster randomised trials: Systematic review of recent trials.
        BMJ. 2008; 336: 876-880
        • Proctor E.
        • Silmere H.
        • Hovmand P.
        • et al.
        Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda.
        Adm Policy Ment Health. 2011; 38: 65-76
        • Peters D.H.
        • Taghreed A.
        • Agyepong A.
        • et al.
        Implementation research: What it is and how to do it.
        BMJ. 2013; 347: 1-7
        • Vernooij-Dassen M.
        • Moniz-Cook E.
        Raising the standard of applied dementia care research: Addressing the implementation error.
        Aging Ment Health. 2014; 18: 809-814
        • Oakley A.
        • Strange V.
        • Bonell C.
        • et al.
        Process evaluation in randomised controlled trials of complex interventions.
        BMJ. 2006; 332: 413-416
        • Rychetnik L.L.
        • Frommer M.
        • Hawe P.
        • Shiell A.
        Criteria for evaluating evidence on public health interventions.
        J Epidemiol Community Health. 2002; 56: 119-127
        • Moore G.
        • Audrey S.
        • Barker M.
        • et al.
        Process evaluation of complex interventions: Medical Research Council guidance.
        BMJ. 2015; 350: 1-7
        • Zwijsen S.A.
        • Smalbrugge M.
        • Eefsting J.A.
        • et al.
        Grip on challenging behavior: Process evaluation of the implementation of a care program.
        Trials. 2014; 15: 302
        • Mentes J.C.
        • Tripp-Reimer T.
        Barriers and facilitators in nursing home intervention research.
        West J Nurs Res. 2002; 24: 918-936
        • van de Ven G.
        • Draskovic I.
        • Adang E.M.M.
        • et al.
        Effects of dementia-care mapping on residents and staff of care homes: A pragmatic cluster-randomised controlled trial.
        PLoS One. 2013; 8: 1-7
        • Proctor E.K.
        • Powell B.J.
        • McMillen J.C.
        Implementation strategies: Recommendations for specifying and reporting.
        Implement Sci. 2013; 8: 139
        • Zwijsen S.A.
        • Gerritsen D.L.
        • Eefsting J.A.
        • et al.
        The development of the Grip on Challenging Behaviour dementia care programme.
        Int J Palliat Nurs. 2014; 20: 15-21
        • Zwijsen S.A.
        • Smalbrugge M.
        • Zuidema S.U.
        • et al.
        Grip on challenging behaviour: A multidisciplinary care programme for managing behavioural problems in nursing home residents with dementia. Study protocol.
        BMC Health Serv Res. 2011; 11: 1-6
        • Zwijsen S.A.
        • Gerritsen D.L.
        • Eefsting J.A.
        • et al.
        Coming to grips with challenging behaviour: A cluster randomised controlled trial on the effects of a new care programme for challenging behaviour on burnout, job satisfaction and job demands of care staff on dementia special care units.
        Int J Nurs Stud. 2015; 52: 68-74
        • Zwijsen S.A.
        • Smalbrugge M.
        • Eefsting J.A.
        • et al.
        Coming to grips with challenging behavior: A cluster randomized controlled trial on the effects of a multidisciplinary care program for challenging behavior in dementia.
        J Am Med Dir Assoc. 2014; 15: 1-531
        • Koopmans R.C.T.M.
        • Pellegrom M.
        • van der Geer E.R.
        The Dutch move beyond the concept of nursing home physician specialists.
        J Am Med Dir Assoc. 2017; 18: 746-749
        • Ribbe M.W.
        • Ljunggren G.
        • Steel K.
        • et al.
        Nursing homes in 10 nations: A comparison between countries and settings.
        Age Ageing. 1997; 26: 3-12
        • Kaufer D.I.
        • Cummings J.L.
        • Ketchel P.
        • et al.
        Validation of the NPI-Q, a brief clinical form of the Neuropsychiatric Inventory.
        J Neuropsychiatry Clin Neurosci. 2000; 12: 233-239
        • Orrell M.
        • Hancock G.
        CANE: Camberwell Assessment of Need for the Elderly.
        Gaskell, London2004
        • Reynolds T.T.
        • Thornicroft G.
        • Abas M.
        • et al.
        Camberwell Assessment of Need for the Elderly (CANE). Development, validity and reliability.
        Br J Psychiatry. 2000; 176: 444-452
        • Verpleegkundigen en Verzorgenden Nederland (V&VN)
        Richtlijn Omgaan met Gedragsproblemen bij Patiënten met Dementie.
        V&VN, Nijmegen2005
        • Nederlands Instituut van Psychologen (NIP)
        Handreiking Psychologische Hulpverlening bij Gedragsproblemen bij Dementie.
        NIP, SPO, Amsterdam2013
        • Verenso
        Richtlijn Probleemgedrag—met herziene medicatieparagraaf.
        Verenso, Utrecht2008
        • van der Spek K.
        • Gerritsen D.L.
        • Smalbrugge M.
        • et al.
        PROPER I: Frequency and appropriateness of psychotropic drugs use in nursing home patients and its associations: A study protocol.
        BMC Psychiatry. 2013; 13: 1-7
        • van der Spek K.
        • Gerritsen D.L.
        • Smalbrugge M.
        • et al.
        A reliable and valid index was developed to measure appropriate psychotropic drug use in dementia.
        J Clin Epidemiol. 2015; 68: 903-912
        • Linnan N.
        • Steckler A.
        Process Evaluation for Public Health Interventions and Research: An Overview.
        Jossey Bass, San Francisco, CA2002
        • Elo S.
        • Kyngas H.
        The qualitative content analysis process.
        J Adv Nurs. 2008; 62: 107-115
        • Craig P.
        • Dieppe P.
        • Nazareth I.
        • Petticrew M.
        Developing and evaluating complex interventions: The new Medical Research Council guidance.
        BMJ. 2008; 337: 1-6
        • Boersma P.
        • van Weert J.C.M.
        • Lakerveld J.
        • Droes R.M.
        The art of successful implementation of psychosocial interventions in residential dementia care: A systematic review of the literature based on the RE-AIM framework.
        Int Psychogeriatr. 2015; 27: 19-35
        • Choi M.
        Employees’ attitudes toward organizational change: A literature review.
        Hum Resource Manage. 2011; 50: 479-500
        • van der Spek K.
        • Gerritsen D.L.
        • Smalbrugge M.
        • et al.
        Only 10% of the psychotropic drug use for neuropsychiatric symptoms in patients with dementia is fully appropriate. The PROPER I-study.
        Int Psychogeriatr. 2016; 28: 1589-1595
        • Kotter J.P.
        • Schlesinger L.A.
        Choosing strategies for change.
        Harvard Business Rev. 1979; 57: 106-114