Advertisement
Original Study| Volume 21, ISSUE 12, P1751-1758.e5, December 2020

Download started.

Ok

Burnout and Associated Factors Among Health Care Workers in Singapore During the COVID-19 Pandemic

Published:October 05, 2020DOI:https://doi.org/10.1016/j.jamda.2020.09.035

      Abstract

      Objectives

      The strain on health care systems due to the COVID-19 pandemic has led to increased psychological distress among health care workers (HCWs). As this global crisis continues with little signs of abatement, we examine burnout and associated factors among HCWs.

      Design

      Cross-sectional survey study.

      Setting and Participants

      Doctors, nurses, allied health professionals, administrative, and support staff in 4 public hospitals and 1 primary care service in Singapore 3 months after COVID-19 was declared a global pandemic.

      Methods

      Study questionnaire captured demographic and workplace environment information and comprised 3 validated instruments, namely the Oldenburg Burnout Inventory (OLBI), Safety Attitudes Questionnaire (SAQ), and Hospital Anxiety and Depression Scale (HADS). Multivariate mixed model regression analyses were used to evaluate independent associations of mean OLBI-Disengagement and -Exhaustion scores. Further subgroup analysis was performed among redeployed HCWs.

      Results

      Among 11,286 invited HCWs, 3075 valid responses were received, giving an overall response rate of 27.2%. Mean OLBI scores were 2.38 and 2.50 for Disengagement and Exhaustion, respectively. Burnout thresholds in Disengagement and Exhaustion were met by 79.7% and 75.3% of respondents, respectively. On multivariate regression analysis, Chinese or Malay ethnicity, HADS anxiety or depression scores ≥8, shifts lasting ≥8 hours, and being redeployed were significantly associated with higher OLBI mean scores, whereas high SAQ scores were significantly associated with lower scores. Among redeployed HCWs, those redeployed to high-risk areas in a different facility (offsite) had lower burnout scores than those redeployed within their own work facility (onsite). A higher proportion of HCWs redeployed offsite assessed their training to be good or better compared with those redeployed onsite.

      Conclusions and Implications

      Every level of the health care workforce is susceptible to high levels of burnout during this pandemic. Modifiable workplace factors include adequate training, avoiding prolonged shifts ≥8 hours, and promoting safe working environments. Mitigating strategies should target every level of the health care workforce, including frontline and nonfrontline staff. Addressing and ameliorating burnout among HCWs should be a key priority for the sustainment of efforts to care for patients in the face of a prolonged pandemic.

      Keywords

      The first COVID-19 case was reported in Singapore on January 23, 2020, and by April 3, 2020, stay-at-home orders, locally termed “circuit breaker” measures, were instituted whereby work-from-home arrangements were encouraged and schools and nonessential services such as dining, retail, and entertainment establishments were closed for approximately 2 months. Nonurgent medical care was reduced wherever possible to redeploy health care resource towards surge capacity and frontline units such as the emergency department, inpatient pandemic, and intensive care units.
      • Liang Z.C.
      • Ooi S.B.S.
      COVID-19: A Singapore orthopedic resident’s musings in the emergency department.
      Although “circuit breaker” measures sharply curbed community spread, major outbreaks emerged within migrant worker accommodations.
      • Koh D.
      Migrant workers and COVID-19.
      Work permit holders in Singapore constitute approximately 1 million of a total population of 5.7 million residents.
      • Koh D.
      Migrant workers and COVID-19.
      ,
      • Sadarangani S.P.
      • Lim P.L.
      • Vasoo S.
      Infectious diseases and migrant worker health in Singapore: A receiving country's perspective.
      Most semi-skilled workers involved in the construction, shipbuilding, and manufacturing industries are housed in dormitory-style accommodations regulated by the government,
      Ministry of Manpower Government of Singapore
      Various types of housing and their specific requirements.
      which house between 3000 and 25,000 residents and feature communal living and various shared facilities, including laundry, recreation, eating, and groceries. In spite of our migrant workers comprising only 5% of Singapore's resident population, outbreaks among dormitory residents have contributed toward 95% of Singapore's total number of cases.
      Ministry of Health Government of Singapore
      29 July 2020. Daily Report on COVID-19.
      Possible reasons include the usage of shared facilities, which make social distancing and isolation challenging.
      • Koh D.
      Migrant workers and COVID-19.
      Forward Assurance and Support Teams (FAST) were deployed at each of the 43 purpose-built dormitories and several other similar housing facilities.
      Ministry of Manpower Government of Singapore
      Comprehensive approach to take care of the well-being of foreign workers living in dormitories.
      These included onsite medical facilities
      • Chew M.H.
      • Koh F.H.
      • Wu J.T.
      • et al.
      Clinical assessment of COVID-19 outbreak among migrant workers residing in a large dormitory in Singapore.
      staffed by health care workers (HCWs) redeployed from public health care institutions and supplemented by private health care groups and volunteers. Other sites of HCW redeployment were Community Care and Swab Isolation facilities which were set up to isolate and care for clinically-well cases (potential- or proven-COID-19 positivity) who do not require inpatient care.
      Ministry of Health Government of Singapore
      Comprehensive Medical Strategy for COVID-19.
      Pandemics impose immense psychological burden on health care staff due to a mix of workplace stressors and personal fears. A meta-analysis
      • Kisely S.
      • Warren N.
      • McMahon L.
      • et al.
      Occurrence, prevention, and management of the psychological effects of emerging virus outbreaks on healthcare workers: Rapid review and meta-analysis.
      showed that when comparing high- versus low-risk exposure groups, the odds ratio for acute or posttraumatic stress (PTS) and psychological distress was 1.71 and 9.94, respectively. Similar findings were seen in the SARS outbreak of 2003
      • Chan A.O.
      • Huak C.Y.
      Psychological impact of the 2003 severe acute respiratory syndrome outbreak on health care workers in a medium size regional general hospital in Singapore.
      • Tam C.W.
      • Pang E.P.
      • Lam L.C.
      • Chiu H.F.
      Severe acute respiratory syndrome (SARS) in Hong Kong in 2003: Stress and psychological impact among frontline healthcare workers.
      • Wu P.
      • Fang Y.
      • Guan Z.
      • et al.
      The psychological impact of the SARS epidemic on hospital employees in China: Exposure, risk perception, and altruistic acceptance of risk.
      • Nickell L.A.
      • Crighton E.J.
      • Tracy C.S.
      • et al.
      Psychosocial effects of SARS on hospital staff: Survey of a large tertiary care institution.
      when emotional distress, depression, and anxiety occurred more frequently among frontline HCWs. Burnout is a syndrome caused by chronic workplace stress and, according to Maslach and Jackson,
      • Maslach C.
      • Jackson S.E.
      The measurement of experienced burnout.
      consists of 3 dimensions: emotional exhaustion, depersonalization, and feelings of reduced personal accomplishment. Burnout in HCWs has consistently shown a dose-response relationship with poorer patient safety outcomes.
      • Shanafelt T.D.
      • Bradley K.A.
      • Wipf J.E.
      • Back A.L.
      Burnout and self-reported patient care in an internal medicine residency program.
      ,
      • Dewa C.S.
      • Loong D.
      • Bonato S.
      • Trojanowski L.
      The relationship between physician burnout and quality of healthcare in terms of safety and acceptability: A systematic review.
      It has been associated with anxiety, depression, marital stress, early retirement, substance abuse, and suicide among HCWs.
      • McManus I.C.
      • Winder B.C.
      • Gordon D.
      The causal links between stress and burnout in a longitudinal study of UK doctors.
      • Brown S.D.
      • Goske M.J.
      • Johnson C.M.
      Beyond substance abuse: Stress, burnout, and depression as causes of physician impairment and disruptive behavior.
      • Balch C.M.
      • Freischlag J.A.
      • Shanafelt T.D.
      Stress and burnout among surgeons: Understanding and managing the syndrome and avoiding the adverse consequences.
      Of note, burnout among HCWs during a pandemic is not fully understood, especially with regard to different facets of the work environment and concomitant psychological responses, such as anxiety and depression.
      Pandemics require HCWs to sustain a period of heightened workload under stressful conditions, rapidly changing guidelines and redeployment to unfamiliar, high-risk settings
      • Coughlan C.
      • Nafde C.
      • Khodatars S.
      • et al.
      COVID-19: Lessons for junior doctors redeployed to critical care.
      while evoking fears of passing infection to loved ones.
      • Nickell L.A.
      • Crighton E.J.
      • Tracy C.S.
      • et al.
      Psychosocial effects of SARS on hospital staff: Survey of a large tertiary care institution.
      Although Singapore has reported only 27 COVID-19 mortalities at the time of writing this article,
      Ministry of Health Government of Singapore
      29 July 2020. Daily Report on COVID-19.
      high per capita case load has necessitated a rapid redeployment of HCWs to FAST teams to staff medical posts under physically demanding conditions, such as under tentage in full personal protective equipment (PPE) amid Singapore's hot and humid climate with daytime temperatures reaching 35C. At 6 months into this pandemic and no clear end in sight, we hypothesize that there would be a high level of burnout among HCWs that may be associated with changes in working environment including redeployment and workplace safety as well as anxiety and depression.

      Methods

      We conducted a multicenter, cross-sectional survey study whereby a questionnaire was distributed to doctors, nurses, allied health care professionals (AHPs), administrative or managerial staff, and support staff across 4 public hospitals involved in the care of COVID-19 cases (bed capacities of approximately 300, 700, 1200, and 2000 beds, respectively) and a public primary health care service from May 29 to June 24, 2020 (Supplementary Table 1). This was approximately 4 months from Singapore's first case and 2 months since the institution of national stay-at-home measures to curb COVID-19 spread. Support staff comprised nonclinical employees who were involved in the operations of the hospital such as porters, cleaners, laboratory technicians, and security staff. This questionnaire was voluntary, anonymous, worded in English, and distributed via corporate e-mail accounts using a secure, online questionnaire platform FormSG (GovTech, Singapore). As English is the standard operating language in Singapore, no literacy issues were encountered. The questionnaire captured basic demographic and workplace environment information and responses to 3 validated questionnaires: The Safety Attitudes Questionnaire (SAQ), Oldenburg Burnout Inventory (OLBI), and Hospital Anxiety and Depression Scale (HADS). We grouped respondents by categories such as (1) HCW roles, (2) Sex, (3) Ethnicity, (4) Redeployment outside primary roles, (5) Being tested for COVID-19, (6) Primary site of work, (7) Educational status, and (8) Average duration of shift during the pandemic (compared with routine 8- to 10-hour shifts during nonpandemic periods).
      As redeployed HCWs constituted a large proportion of our health care workforce, we performed a subgroup analysis whereby this group was further divided into (1) Redeployed onsite (low risk), that is, not in direct contact with known COVID-19 cases; (2) Redeployed onsite (high risk), that is, highly likely to be in direct contact with known COVID-19 cases (eg, emergency department, critical care unit); and (3) Redeployed offsite to high-risk areas (eg, foreign work dormitory, community care facility, swab isolation facility).

      Oldenburg Burnout Inventory

      The OLBI is a 16-item validated tool to assess burnout
      • Demerouti E.
      • Bakker A.B.
      • Vardakou I.
      • Kantas A.
      The convergent validity of two burnout instruments: A multitrait-multimethod analysis.
      (Supplementary Table 2) covering 2 dimensions: Exhaustion and Disengagement. Disengagement refers to distancing oneself from the objects and content of one's work while exhaustion refers to feelings of emptiness, overwork, a strong need for rest, and physical exhaustion. Each dimension consists of 8 items rated on a 4-point Likert scale with options including “Strongly disagree,” “Disagree,” “Agree,” and “Strongly agree” with 4 points for the highest burnout response and 1 point for the lowest. The means and SDs were calculated for each domain and compared across baseline respondent characteristics. Burnout was determined with a cutoff of ≥2.25 for Exhaustion and ≥2.10 for Disengagement, which correlates with physical symptoms
      • Peterson U.
      • Bergström G.
      • Demerouti E.
      • et al.
      Burnout levels and self-rated health prospectively predict future long-term sickness absence: A study among female health professionals.
      and has been used in recent studies
      • Molodynski A.
      • Lewis T.
      • Kadhum M.
      • et al.
      Cultural variations in wellbeing, burnout and substance use among medical students in twelve countries.
      ,
      • Collin V.
      • Toon M.
      • O'Selmo E.
      • et al.
      A survey of stress, burnout and well-being in UK dentists.
      to determine the extent of burnout. The OLBI offers advantages over the commonly used Maslach Burnout Inventory, as it uses both positively and negatively framed questions for each domain, which reduces the risk of artefactual relationships
      • Lee R.T.
      • Ashforth B.E.
      On the meaning of Maslach's three dimensions of burnout.
      and acquiescence response biases,
      • Podsakoff P.M.
      • MacKenzie S.B.
      • Lee J.-Y.
      • Podsakoff N.P.
      Common method biases in behavioral research: A critical review of the literature and recommended remedies.
      thus making it a superior psychometric scale.
      • Demerouti E.
      • Bakker A.B.
      • Vardakou I.
      • Kantas A.
      The convergent validity of two burnout instruments: A multitrait-multimethod analysis.
      ,
      • Aldrich B.
      • Price J.
      • Mueller C.
      Handbook of organizational measurement.
      The OLBI has been validated for use in a variety of populations and settings.
      • Reis D.
      • Xanthopoulou D.
      • Tsaousis I.
      Measuring job and academic burnout with the Oldenburg Burnout Inventory (OLBI): Factorial invariance across samples and countries.
      • Mahadi N.
      • Chin R.W.
      • Chua Y.
      • et al.
      Malay language translation and validation of the Oldenburg Burnout Inventory Measuring Burnout.
      • Sinval J.
      • Queirós C.
      • Pasian S.
      • Marôco J.
      Transcultural adaptation of the Oldenburg Burnout Inventory (OLBI) for Brazil and Portugal.

      The Safety Attitudes Questionnaire

      The SAQ
      • Sexton J.B.
      • Helmreich R.L.
      • Neilands T.B.
      • et al.
      The Safety Attitudes Questionnaire: Psychometric properties, benchmarking data, and emerging research.
      (Supplementary Table 3) has been validated for different languages, HCW roles, and health care settings,
      • Profit J.
      • Etchegaray J.
      • Petersen L.A.
      • et al.
      The Safety Attitudes Questionnaire as a tool for benchmarking safety culture in the NICU.
      ,
      • Samsuri S.E.
      • Pei Lin L.
      • Fahrni M.L.
      Safety culture perceptions of pharmacists in Malaysian hospitals and health clinics: A multicentre assessment using the Safety Attitudes Questionnaire.
      and consists of questions covering 6 patient safety domains of teamwork climate, safety climate, perceptions of management, job satisfaction, working conditions, and stress recognition. These items are scored on a 5-point Likert scale with options including “Strongly Disagree,” “Disagree,” “Neutral,” “Agree,” and “Strongly Agree.” A higher score reflects better safety attitudes. Although the full SAQ comprises 60 questions, each validated version includes the same 30 core questions with additional relevant questions. As this survey was disseminated to HCWs in both clinical and nonclinical roles, respondents had the option to omit domains that were not applicable to them, as some of these domains only applied to clinical situations. A Safety Culture Score was calculated for each domain
      • Sexton J.B.
      • Helmreich R.L.
      • Neilands T.B.
      • et al.
      The Safety Attitudes Questionnaire: Psychometric properties, benchmarking data, and emerging research.
      ,
      • Profit J.
      • Sharek P.J.
      • Amspoker A.B.
      • et al.
      Burnout in the NICU setting and its relation to safety culture.
      :
      (Mean value of item scores within a domain – 1) × 25
      Thus, a score of “1” is transformed to “0,” ”2” to “25,” “3” to “50,” “4” to “75,” and “5” to “100.” A score of ≥75 is a “Percentage Agree” for that domain and a “Percentage Agree Rate” is the proportion of respondents with a “Percentage Agree.” Conversely, a score of ≤50 represented “Percentage Disagree.”

      The Hospital Anxiety and Depression Scale

      The HADS
      • Zigmond A.S.
      • Snaith R.P.
      The hospital anxiety and depression scale.
      is a self-reported questionnaire evaluating Depression and Anxiety with 7 items each (Supplementary Table 4). Each item is rated on a 4-point Likert scale scored as 0, 1, 2, and 3. A score of ≤7 is normal, 8 to 10 is borderline abnormal, and ≥11 is abnormal. We deemed a score of ≥8 or more to signify risk of depression and/or anxiety.

      Outcomes

      Our primary outcome measure was OLBI mean scores. Secondary outcomes measured included burnout rates based on OLBI-D ≥2.10 and OLBI-E ≥2.25, SAQ Percentage Agree Rates overall and for each domain and proportion of HCWs with a score of ≥8 for HADS-Anxiety and -Depression.

      Statistics

      Analyses were performed using SPSS 26.0 (IBM Corp, Armonk, NY) with statistical significance set as P < .05.
      Cronbach's alpha was presented to show the internal consistency of each questionnaire where an α > 0.7 suggested good reliability. Confirmatory factor analysis was also performed to assess the goodness of fit of the data on the instruments used. Root mean square error of approximation (RMSEA < 0.06), Comparative Fit Indices (CFI ≥0.90) and Standardized Root Mean Square Residual (SRMSR < 0.08) were presented.
      • Vandenberg R.J.
      • Lance C.E.
      A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research.
      OLBI scores in each of the subscales, that is, disengagement and exhaustion, were used as continuous variables and described using the mean and SD. Crude and adjusted predictors (demographic and workplace characteristics as well as HADS and SAQ domain scores) for the OLBI scores were performed using mixed linear models with institution as a random effect.

      Ethics

      Waiver of consent and ethics approval was obtained from the National Healthcare Group's Domain Specific Review Board (Reference Number 2020/00598). The questionnaire's front page provided participants with information regarding the purpose of the study and assurance of anonymity.

      Funding

      No funding was received directly for this study. The authors declare no conflicts of interest.

      Results

      Survey Responses

      Among 11,286 invited HCWs, we received 3075 valid responses, which constituted complete demographic and workplace information, OLBI scores, and HADS scores, giving an overall response rate of 27.2%. Although respondents could omit SAQ domain questions that were not appropriate to their work, 94.3% completed at least 1 SAQ domain and 62.7% completed all 6 domains. Table 1 shows the demographic characteristics. Women comprised 71.5% and HCWs of Chinese ethnicity comprised 53.3% with the remainder being of Malay, Indian, and Other ethnicities in roughly equal proportions. Doctors, nurses, AHPs, support staff, and administrative staff comprised 14.9%, 45.3%, 15.7%, 16.0%, and 8.0% of respondents, respectively, with response rates within each HCW role of 38.6%, 31.1%, 23.1%, 23.4%, and 17.5%, respectively.
      Table 1Respondent Demographics, Work Environment Characteristics, and Baseline Measures of Emotional Well-Being (n = 3075)
      Age, y, Mean (SD)36.84 ± 9.95
      n (%)
      Total3075
      Sex
       Female2199 (71.5)
       Male794 (25.8)
       Not stated82 (2.7)
      Ethnicity
       Chinese1608 (53.3)
       Malay401 (13.0)
       Indian410 (13.3)
       Others: Filipino, Burmese, Eurasian, white, Vietnamese506 (16.5)
       Not stated150 (4.9)
      Role
       Doctor458 (14.9)
       Nurse1394 (45.3)
       Allied health professional483 (15.7)
       Support staff: cleaners, porters, technicians, security491 (16.0)
       Administrative and managerial247 (8.0)
       Not stated2 (0.1)
      Education level
      Thresholds for deeming burnout for (1) OLBI-Disengagement ≥ 2.10 and (2) OLBI-Exhaustion ≥ 2.25.
       College degree and above2132 (69.3)
       Pre-university (ie, associate degrees, ‘A’ levels, technical colleges)699 (22.7)
       Secondary or below241 (7.9)
       Not specified3 (0.1)
      Redeployed558 (18.1)
       Not redeployed2534 (82.4)
       Within hospital, low risk140 (25.1)
       Within hospital, high risk245 (43.9)
       Outside of hospital156 (28.0)
      Current primary place of work
       Healthcare facility with COVID-19 cases2442 (79.5)
       Healthcare facility without COVID-19 case329 (10.7)
       Migrant worker dormitory or community care90 (2.9)
       Work from home201 (6.5)
      Tested for COVID-19
       Yes527 (17.2)
       No
      Average duration of your shift or daily work hours?
       Less than 8 hours299 (9.7)
       8–12 hours2462 (80.1)
       12 hours or more314 (10.2)
      ScalesMean (SD)Meeting Threshold, n (%)
      Oldenburg Burnout Inventory (OLBI) (n = 3075)
      Thresholds for deeming burnout for (1) OLBI-Disengagement ≥ 2.10 and (2) OLBI-Exhaustion ≥ 2.25.
       Disengagement2.38 (0.46)2452 (79.7)
       Exhaustion2.50 (0.47)2315 (75.3)
       Meeting threshold for either Disengagement or Exhaustion2670 (86.8)
       Meeting threshold for both Disengagement and Exhaustion2097 (68.2)
      Hospital Anxiety and Depression Scale (HADS) (n = 3075)
      Thresholds for deeming risk of anxiety or depression for HADS was ≥8 in either subscale.
       Depression5.7 (3.9)979 (31.8)
       Anxiety6.9 (4.0)1253 (40.7)
       Meeting threshold for both Depression and Anxiety716 (23.3)
      Safety Attitudes Questionnaire (SAQ)Percentage Agree Rate,
      The Percentage Agree Rate refers to the proportion of respondents who scored 75% or above for the Safety Culture Score in each domain.
      n (%)
      Total mean (n = 1931)64.0 (15.3)501 (25.9)
      Teamwork (n = 2479)74.4 (18.8)1386 (55.9)
      Safety climate (n = 2525)72.3 (18.1)1329 (52.7)
      Stress recognition (n = 2501)31.5 (25.7)205 (8.2)
      Job satisfaction (n = 2725)74.6 (22.3)1613 (59.2)
      Perceptions of Management (n = 2633)64.1 (20.0)932 (35.4)
      Working conditions (n = 2428)66.2 (20.8)1030 (42.4)
      Thresholds for deeming burnout for (1) OLBI-Disengagement ≥ 2.10 and (2) OLBI-Exhaustion ≥ 2.25.
      Thresholds for deeming risk of anxiety or depression for HADS was ≥8 in either subscale.
      The Percentage Agree Rate refers to the proportion of respondents who scored 75% or above for the Safety Culture Score in each domain.

      Internal Consistency and Internal Construct Validity

      In our study, the Cronbach's alpha for each subscale was good to excellent: OLBI-Exhaustion (α = 0.80) and Disengagement (α = 0.83), HADS Depression (α = 0.80) and Anxiety (α = 0.84), and SAQ Teamwork (α = 0.86), Safety Culture (α = 0.83), Job Satisfaction (α = 0.91), Perceptions of Management (α = 0.83), Stress Recognition (α = 0.83), and Working Conditions (α = 0.83). Goodness of fit indices for most subscales demonstrated a good model fit (Supplementary Table 5).

      Scale Scores

      In our study population, the scores for each scale are seen in Table 1. The average OLBI scores were 2.38 and 2.50 for Disengagement and Exhaustion, respectively. Burnout thresholds were met by 79.7% and 75.3% of respondents for Disengagement and Exhaustion, respectively, with 86.8% meeting thresholds for either and 68.2% for both. The mean Disengagement scores were highest for administrative staff (2.46) and lowest for support staff (2.32), whereas mean Exhaustion scores were highest for nurses (2.52) and lowest for support staff (2.44), although there was no significant difference in scores among HCW roles (see Table 2 and Figure 1). Mean HADS Depression and Anxiety scores were 5.7 and 6.9, respectively. Average Total SAQ Percentage Agree Rate was 25.9% with the lowest domain being Stress Recognition (8.2%) and highest, Teamwork (55.9%).
      Table 2Multivariate Analysis for Total Study Population (n = 3075) Using OLBI-Disengagement and -Exhaustion Scores as Dependent variables
      Covariatesn (%)
      Percentage was calculated as a percentage of valid responses for that covariate and placed in parentheses.
      OLBI-DisengagementOLBI-Exhaustion
      Mean (SD)AdjustedMean (SD)Adjusted
      b (95% CI)P Valueb (95% CI)P Value
      Gender
       Female2199 (73.4)2.38 (0.44)−0.02 (−0.05 to 0.05).3832.51 (0.46)0.03 (0.00 to 0.07).051
       Male794 (26.5)2.34 (0.44)ref2.42 (0.49)ref
      Ethnicity
       Overall<.001<.001
       Chinese1508 (53.4)2.43 (0.47)0.10 (0.06 to 0.14)<.0012.51 (0.48)0.08 (0.04 to 0.12)<.001
       Malay401 (14.2)2.40 (0.46)0.06 (0.01 to 0.11).0262.54 (0.46)0.08 (0.03 to 0.13).002
       Indian410 (14.5)2.23 (0.42)ref2.36 (0.46)ref
       Others505 (17.9)2.27 (0.38)0.01 (−0.04 to 0.05).8512.41 (0.42)0.02 (−0.03 to 0.07).397
      Role
       Overall.027.157
       Doctor458 (14.9)2.33 (0.52)−0.03 (−0.08 to 0.03).0932.45 (0.52)−0.02 (−0.07 to 0.04).625
       Nurse1394 (45.4)2.39 (0.43)0.01 (−0.03 to 0.06).5702.52 (0.46)0.05 (−0.04 to 0.05).849
       Support491 (16.0)2.32 (0.43)ref2.44 (0.44)ref
       Administrative247 (8.04)2.46 (0.50)0.07 (−0.01 to 0.16).0892.47 (0.48)−0.05 (−0.13 to 0.04).306
       Allied health483 (15.7)2.41 (0.48)0.03 (−0.03 to 0.08).3722.53 (0.49)0.02 (−0.03 to 0.08).447
      Education
       Overall.042.009
       Degree2132 (69.4)2.38 (0.48)0.08 (0.02 to 0.14).0312.50 (0.47)0.10 (0.04 to 0.16).001
       Diploma699 (22.8)2.42 (0.47)0.06 (−0.001 to 0.12).0532.54 (0.48)0.09 (0.03 to 0.16).003
       Secondary241 (7.85)2.28 (0.35)ref2.37 (0.42)ref
      Site of Work
       Overall.156.491
       At hospital/polyclinic2771 (90.2)2.38 (0.46)0.002 (−0.07 to 0.08).9632.50 (0.47)−0.02 (−0.10 to 0.05).551
       In community
      In community refers to Foreign worker dormitories, Community Care Facilities, or Swab Isolation Facilities.
      100 (3.26)2.28 (0.45)ref2.40 (0.47)ref
       Work from home201 (6.54)2.40 (0.46)−0.06 (−0.16 to 0.09).2752.48 (0.50)−0.07 (−0.17 to 0.03).194
      Tested for COVID-19
       Yes527 (17.1)2.33 (0.43)ref2.47 (0.44)ref
       No2548 (82.9)2.39 (0.46)0.04 (−0.003 to 0.07).0692.50 (0.48)0.03 (−0.01 to 0.07).125
      Duration of shift
       Overall, h.169<.001
       < 8299 (9.72)2.29 (0.43)ref2.33 (0.46)ref
       8 to < 122462 (80.1)2.38 (0.45)0.002 (−0.09 to 0.04).9152.49 (0.46)0.06 (0.01 to 0.10).015
       ≥ 12314 (10.2)2.49 (0.52)0.04 (−0.002 to 0.09).0592.69 (0.50)0.16 (0.10 to 0.23)<.001
      Redeployed
       Yes558 (18.1)2.45 (0.46)0.08 (0.04 to 0.11)<.0012.55 (0.48)0.04 (0.01 to 0.08).020
       No2517 (81.9)2.37 (0.45)ref2.48 (0.47)ref
      Hospital Anxiety and Depression Scale
       Depression
      Yes: score ≥ 8979 (31.8)2.67 (0.48)0.19 (0.15 to 0.22)<.0012.82 (0.44)0.23 (0.19 to 0.62)<.001
      No: score <82095 (68.2)2.25 (0.39)ref2.34 (0.41)ref
       Anxiety
      Yes: score ≥ 81253 (40.7)2.60 (0.45)0.14 (0.11 to 0.17)<.0012.78 (0.42)0.25 (0.22 to 0.28)<.001
      No: score <81822 (59.3)2.23 (0.40)ref2.30 (0.40)ref
      Safety Assessment Questionnaire
       Teamwork
      Percentage agree1583 (56.7)2.22 (0.40)−0.05 (−0.08 to −0.01).0132.36 (0.43)−0.02 (−0.06 to 0.01).192
      Percentage disagree1208 (43.3)2.58 (0.46)ref2.69 (0.46)ref
       Safety climate
      Percentage agree1512 (53.5)2.20 (0.38)−0.04 (−0.08 to −0.01).0212.33 (0.43)−0.03 (−0.07 to 0.01).120
      Percentage disagree1314 (46.5)2.59 (0.46)ref2.70 (0.45)ref
       Job satisfaction
      Percentage agree1715 (53.4)2.17 (0.35)−0.28 (−0.31 to −0.24)<.0012.32 (0.41)−0.17 (−0.21 to −0.13)<.001
      Percentage disagree1173 (40.6)2.69 (0.43)ref2.77 (0.44)ref
       Stress recognition
      Percentage agree228 (7.94)1.99 (0.39)−0.20 (−0.25 to −0.15)<.0012.05 (0.42)−0.26 (−0.31 to −0.21)<.001
      Percentage disagree2642 (92.1)2.42 (0.45)ref2.54 (0.46)ref
       Perception of management
      Percentage agree1059 (36.8)2.16 (0.39)−0.07 (−0.11 to −0.04)<.0012.27 (0.41)−0.08 (−0.11 to −0.04)<.001
      Percentage disagree1819 (63.2)2.51 (0.45)ref2.63 (0.46)ref
       Working conditions
      Percentage agree1232 (44.8)2.17 (0.37)−0.07 (−0.10 to −0.03)<.0012.29 (0.41)−0.09 (−0.12 to −0.05)<.001
      Percentage disagree1517 (55.2)2.54 (0.46)ref2.66 (0.46)ref
      NOTE. Bold values are statistically significant (P < .05).
      Mixed Model analysis with Institution as random effect. b = the linear regression estimate which reflects the difference in the OLBI Disengagement or Exhaustion score between groups.
      Percentage was calculated as a percentage of valid responses for that covariate and placed in parentheses.
      In community refers to Foreign worker dormitories, Community Care Facilities, or Swab Isolation Facilities.
      Figure thumbnail gr1
      Fig. 1Burnout rates based on OLBI-E and OLBI-D scores by HCW roles among the total study population (%).

      Multivariate Mixed Model Regression Analysis

      On mixed model regression analysis with institution as random effects (Table 2), gender, site of work, and being tested for COVID-19 did not have significant differences in OLBI scores, although female gender approached significance for Exhaustion (P = .051). HCWs of Malay and Chinese ethnicities had significantly higher OLBI scores compared with HCWs of Indian ethnicity. Degree holders had significantly higher OLBI scores than HCWs with secondary or lower educational qualifications. Shifts lasting ≥8 hours were associated with significantly higher Exhaustion scores. HADS scores ≥8 for either depression or anxiety were strongly associated (P ≤ .001) with significantly higher OLBI scores. Respondents with a Percentage Agree for any of the SAQ domains had significantly lower Disengagement score. For Exhaustion, this relationship was seen with all SAQ domains except Teamwork and Safety Climate. Redeployment was also associated with significantly higher Exhaustion and Disengagement scores and underwent further subgroup analysis.

      Redeployed Subgroup Analysis

      A total of 486 (15.8%) HCWs in clinical roles (ie, doctors, nurses, and AHPs) were redeployed. Among redeployed HCWs, the mean Disengagement and Exhaustion scores were 2.45 and 2.55, respectively, both being significantly higher than in non-redeployed HCWs at 2.37 and 2.50 (Table 3), respectively. Among the 3 redeployment groups, that is, (1) Onsite (low risk), (2) Onsite (high risk), and (3) Offsite, a paradoxical but statistically significant relationship was demonstrated in which HCWs redeployed offsite had the lowest Disengagement and Exhaustion scores (2.31 and 2.44) followed by non-redeployed (2.37 and 2.48) and redeployed onsite (low risk 2.49 and 2.62, high risk 2.51 and 2.61). In addition, SAQ Percentage Agree Rates for each domain were highest among HCWs redeployed offsite with significantly higher rates seen for Job Satisfaction and Perceptions of Management. On multivariate analysis, factors that were strongly correlated with high OLBI scores included redeployment onsite (especially high risk), training assessed to be neutral or worse, shift duration ≥8 hours (Table 4).
      Table 3Comparison of SAQ, OLBI, and Training Quality in Non-redeployed and Redeployed Clinical HCWs, That is, Doctors, Nurses, Allied Health Professionals
      Non-Redeployed n = 2534Redeployed
      In our sample population, HCWs were redeployed to 1 of 3 areas: (1) within their own work facility with a low risk of COVID-19 contact, that is, Onsite (Low Risk), (2) within their own work facility with a high risk of COVID-19 contact, that is, Onsite (High Risk), or (3) different facility (foreign work dormitory, community care facility, swab isolation facility) with high risk of COVID-19 contact, that is, Offsite.
      P Value
      Onsite (Low Risk) n = 122Onsite (High Risk) n = 214Offsite n = 123
      OLBI Score (Mean)
       Disengagement2.372.492.512.31<.001
       Exhaustion2.502.622.612.44<.001
      SAQ percentage agree rate (%)
       Teamwork57.849.660.165.3.081
       Safety Culture54.444.755.654.4.201
       Stress Recognition7.93.27.66.4.266
       Job Satisfaction58.646.456.172.8<.001
       Perceptions of Management36.429.829.144.8.012
       Work Culture42.631.542.645.6.086
       Total
      Individual assessment of training quality (%)
       Good or better36.147.952.8.002
       Neutral or worse38.541.932.0
       No training received25.410.215.2
      In our sample population, HCWs were redeployed to 1 of 3 areas: (1) within their own work facility with a low risk of COVID-19 contact, that is, Onsite (Low Risk), (2) within their own work facility with a high risk of COVID-19 contact, that is, Onsite (High Risk), or (3) different facility (foreign work dormitory, community care facility, swab isolation facility) with high risk of COVID-19 contact, that is, Offsite.
      Table 4Subgroup Analysis of Redeployed Clinical HCWs (n = 459), That Is, Doctors, Nurses, Allied Health Professionals Using Oldenburg Burnout Inventory (OLBI) Disengagement and Exhaustion Scores as Dependent Variables
      nOLBI-DisengagementOLBI-Exhaustion
      Mean (SD)b (95% CI)P ValueMean (SD)b (95% CI)P Value
      Role.772.480
       Doctor1142.43 (0.49)ref2.52 (0.56)ref
       Nurse3082.45 (0.44)0.02 (−0.09 to 0.11).8462.59 (0.45)0.07 (−0.05 to 0.16).268
       Allied Health482.48 (0.50)0.05 (−0.10 to 0.21).4802.58 (0.49)0.06 (−0.09 to 0.24).349
      Redeployed
      In our sample population, HCWs were redeployed to 1 of 3 areas: (1) within their own work facility with a low risk of COVID-19 contact, that is, Onsite (Low Risk), (2) within their own work facility with a high risk of COVID-19 contact, that is, Onsite (High Risk), or (3) different facility (foreign work dormitory, community care facility, swab isolation facility) with high risk of COVID-19 contact, that is, Offsite.
      to
      .001.009
       Onsite (low risk)1252.49 (0.46)0.18 (0.06 to 0.29).0042.62 (0.47)0.18 (0.05 to 0.29).007
       Onsite (high risk)2212.51 (0.46)0.20 (0.09 to 0.30)<.0012.61 (0.48)0.17 (0.05 to 0.28).005
       Offsite1242.31 (0.42)ref2.44 (0.48)ref
      Individual assessment of training quality<.001<.001
       Good or better2102.31 (0.41)ref2.44 (0.46)ref
       Neutral or worse1772.59 (0.46)0.28 (0.20 to 0.37)<.0012.69 (0.49)0.25 (0.16 to 0.35)<.001
       No training received722.56 (0.47)0.25 (0.13 to 0.36)<.0012.68 (0.48)0.24 (0.12 to 0.37)<.001
      Tested for COVID-19
       Yes672.42 (0.53)ref2.57 (0.48)ref
       No4032.46 (0.45)0.04 (−0.10 to 0.16).4772.59 (0.52)0.02 (−0.16 to 0.10).633
      Duration of shift, h.007< .001
       < 8532.27 (0.35)ref2.31 (0.43)ref
       8 to < 123582.46 (0.46)0.19 (0.05 to 0.31).0072.58 (0.47)0.27 (0.13 to 0.40)<.001
       ≥ 12592.55 (0.47)0.28 (0.09 to 0.43).0022.70 (0.51)0.39 (0.21 to 0.56)<.001
      NOTE. The bolded values have achieved pre-determined levels statistical significance amongst components of each subcategory.
      Mixed model with Institution as random effects performed.
      In our sample population, HCWs were redeployed to 1 of 3 areas: (1) within their own work facility with a low risk of COVID-19 contact, that is, Onsite (Low Risk), (2) within their own work facility with a high risk of COVID-19 contact, that is, Onsite (High Risk), or (3) different facility (foreign work dormitory, community care facility, swab isolation facility) with high risk of COVID-19 contact, that is, Offsite.

      Discussion

      The few studies conducted on burnout among HCWs in Singapore have mostly used the Maslach Burnout Inventory and note burnout rates ranging from 40% to 60%.
      • See K.C.
      • Zhao M.Y.
      • Nakataki E.
      • et al.
      Professional burnout among physicians and nurses in Asian intensive care units: A multinational survey.
      • Ang S.Y.
      • Dhaliwal S.S.
      • Ayre T.C.
      • et al.
      Demographics and personality factors associated with burnout among nurses in a Singapore tertiary hospital.
      • Lee P.T.
      • Loh J.
      • Sng G.
      • et al.
      Empathy and burnout: A study on residents from a Singapore institution.
      • Lim W.Y.
      • Ong J.
      • Ong S.
      • et al.
      The Abbreviated Maslach Burnout Inventory can overestimate burnout: A study of anesthesiology residents.
      The only pre-pandemic study in Singapore using OLBI involved 37 mental health HCWs and showed mean Exhaustion and Disengagement scores of 2.38 and 2.25,
      • Suyi Y.
      • Meredith P.
      • Khan A.
      Effectiveness of mindfulness intervention in reducing stress and burnout for mental health professionals in Singapore.
      respectively, which is lower than this study's 2.50 and 2.38. Our study is unique in comparing burnout against SAQ as a surrogate for workplace safety environment during a pandemic among other variables and did so at a timely juncture of 4 months after Singapore's first case and 2 months after instituting major changes to the public health system to combat COVID-19.
      Demographic factors that were significantly associated with burnout included ethnicity and educational level. HCWs of Malay and Chinese ethnicities had higher burnout scores than those of Indian or other ethnicities. This has been noted in other studies in Malaysia
      • Al-Dubai S.A.R.
      • Ganasegeran K.
      • Perianayagam W.
      • Rampal K.G.
      Emotional burnout, perceived sources of job stress, professional fulfillment, and engagement among medical residents in Malaysia.
      and Singapore
      • Ang S.Y.
      • Dhaliwal S.S.
      • Ayre T.C.
      • et al.
      Demographics and personality factors associated with burnout among nurses in a Singapore tertiary hospital.
      where Chinese and Malays constitute the 2 largest ethnic groups. This may be influenced by religio-cultural factors in ways that are not yet fully understood. Higher educational status was associated with higher burnout, as it is likely associated with seniority in health care and thus greater responsibilities. In our study, women had higher Exhaustion scores, which is consistent with other studies
      • Norlund S.
      • Reuterwall C.
      • Höög J.
      • et al.
      Burnout, working conditions and gender—results from the northern Sweden MONICA Study.
      ,
      • Purvanova R.K.
      • Muros J.P.
      Gender differences in burnout: A meta-analysis.
      and may be due to greater susceptibility to work-family role conflict
      • Byron K.
      A meta-analytic review of work-family conflict and its antecedents.
      that interacted with other factors, such as longer work hours, fears of infecting loved ones,
      • Nickell L.A.
      • Crighton E.J.
      • Tracy C.S.
      • et al.
      Psychosocial effects of SARS on hospital staff: Survey of a large tertiary care institution.
      and significant travel restrictions limiting female migrant HCWs’ return to their families.

      Hassan H. Malaysia bans travel abroad, shuts schools and businesses over coronavirus spread; lockdown till March 31. Straits Times. March 16, 2020.

      ,
      Ministry of Health Government of Singapore
      Gradual re-opening of travel and changes to border measures.
      In our study, female-dominated HCW roles included nurses (88.4%), AHPs (73.7%), and administrative (71.1%), whereas doctors and support staff had a roughly equal divide (48.5% and 55.4%, respectively). Nevertheless, after adjusting for factors such as gender, multivariate analysis did not show significant difference in burnout between different HCW roles, although there was a nonsignificant trend toward higher exhaustion scores among nurses that has been observed in other studies.
      • Chou L.-P.
      • Li C.-Y.
      • Hu S.C.
      Job stress and burnout in hospital employees: Comparisons of different medical professions in a regional hospital in Taiwan.
      Surprisingly, HCWs in administrative roles and those who work from home had relatively high disengagement scores, which may be linked to increased operational demands while switching to a different working environment at home. The observation that every strata of the health care workforce can be at risk of increased psychological burden was also noted by Rossi et al.,
      • Rossi R.
      • Socci V.
      • Pacitti F.
      • et al.
      Mental health outcomes among frontline and second-line health care workers during the Coronavirus Disease 2019 (COVID-19) pandemic in Italy.
      who found that nonfrontline HCWs had largely comparable psychological outcomes, such as anxiety, depression, insomnia, and perceived stress levels compared with frontline HCWs.
      Various countries have had to redeploy HCWs during this pandemic,
      • Coughlan C.
      • Nafde C.
      • Khodatars S.
      • et al.
      COVID-19: Lessons for junior doctors redeployed to critical care.
      ,
      • Bernucci C.
      • Brembilla C.
      • Veiceschi P.
      Effects of the COVID-19 outbreak in Northern Italy: Perspectives from the Bergamo Neurosurgery Department.
      ,
      • Sarpong N.O.
      • Forrester L.A.
      • Levine W.N.
      What's important: Redeployment of the orthopaedic surgeon during the COVID-19 pandemic: Perspectives from the trenches.
      but the effects of redeployment during a pandemic on HCW burnout have not been well studied. The paradoxically higher OLBI scores among HCWs redeployed onsite versus those redeployed offsite and non-redeployed, challenged our hypothesis that unfamiliar work environments under physically demanding conditions
      • Ong J.J.Y.
      • Bharatendu C.
      • Goh Y.
      • et al.
      Headaches associated with personal protective equipment - a cross-sectional study among frontline healthcare workers during COVID-19.
      ,
      • Tabah A.
      • Ramanan M.
      • Laupland K.B.
      • et al.
      Personal protective equipment and intensive care unit healthcare worker safety in the COVID-19 era (PPE-SAFE): An international survey.
      would cause more burnout. Possibly, HCWs redeployed onsite worked with sicker patients compared with those being redeployed offsite within a community setting. Unfortunately, our study did not capture the details and complexities of care within each area of redeployment. A significantly greater proportion of HCWs redeployed offsite rated their training as good or better (52.8%) versus those redeployed onsite (36.1%–47.9%). This was strongly associated with lower OLBI scores and underscores the importance of effective pre-deployment preparation. Many of the HCWs redeployed offsite were volunteers, unlike HCWs who were redeployed onsite, often out of operational necessity or closure of nonessential services. This may contribute to the higher Job Satisfaction and Perceptions of Management Percentage Agree Rates among HCWs redeployed offsite. Altruism
      • Wu P.
      • Fang Y.
      • Guan Z.
      • et al.
      The psychological impact of the SARS epidemic on hospital employees in China: Exposure, risk perception, and altruistic acceptance of risk.
      ,
      • Yamamoto-Mitani N.
      • Saito Y.
      • Takaoka M.
      • et al.
      Nurses’ and care workers’ perception of care quality in Japanese long-term care wards: A qualitative descriptive study.
      ,
      • Gleichgerrcht E.
      • Decety J.
      Empathy in clinical practice: How individual dispositions, gender, and experience moderate empathic concern, burnout, and emotional distress in physicians.
      and camaraderie that developed even under stressful conditions
      • Lai J.
      • Ma S.
      • Wang Y.
      • et al.
      Factors associated with mental health outcomes among health care workers exposed to coronavirus disease 2019.
      may be protective. During the SARS outbreak, Tam et al.
      • Tam C.W.
      • Pang E.P.
      • Lam L.C.
      • Chiu H.F.
      Severe acute respiratory syndrome (SARS) in Hong Kong in 2003: Stress and psychological impact among frontline healthcare workers.
      noted that the odds ratio of having psychiatric morbidity (defined as “case” under General Health Questionnaire) was highest in unwilling HCWs followed by HCWs without objections and last willing HCWs. Hu et al.,
      • Hu D.
      • Kong Y.
      • Li W.
      • et al.
      Frontline nurses’ burnout, anxiety, depression, and fear statuses and their associated factors during the COVID-19 outbreak in Wuhan, China: A large-scale cross-sectional study.
      however, noted that although staff dispatched voluntarily from elsewhere to Wuhan had significantly lower emotional exhaustion scores, they had significantly higher depersonalization scores compared with those assigned there. Finally, the strong association between high SAQ Percentage Agree Rates and low OLBI scores highlight the importance of a supportive work safety environment in reducing burnout.
      • Kisely S.
      • Warren N.
      • McMahon L.
      • et al.
      Occurrence, prevention, and management of the psychological effects of emerging virus outbreaks on healthcare workers: Rapid review and meta-analysis.
      • Chan A.O.
      • Huak C.Y.
      Psychological impact of the 2003 severe acute respiratory syndrome outbreak on health care workers in a medium size regional general hospital in Singapore.
      • Tam C.W.
      • Pang E.P.
      • Lam L.C.
      • Chiu H.F.
      Severe acute respiratory syndrome (SARS) in Hong Kong in 2003: Stress and psychological impact among frontline healthcare workers.
      ,
      • Nickell L.A.
      • Crighton E.J.
      • Tracy C.S.
      • et al.
      Psychosocial effects of SARS on hospital staff: Survey of a large tertiary care institution.
      Limitations to this study include the lack of a comparable pre-pandemic health care workforce burnout for direct comparison. Meaningful comparisons between different study populations can also be challenging due to adoption of different rating tools and burnout criteria in different studies and varying cultural acceptance of workplace factors. There also may be a sampling bias, as overworked HCWs may be too busy to respond to this questionnaire. However, we have attempted to mitigate this through 3 rounds of e-mails and managed to obtain a representative cross-section of the health care workforce.
      • Gupta N.
      • Diallo K.
      • Zurn P.
      • Dal Poz M.R.
      Assessing human resources for health: What can be learned from labour force surveys?.
      ,
      Ministry of Health Government of Singapore
      Healthcare workforce statistic.
      Finally, the citizenship status of HCWs was not captured. In the background of travel bans and quarantine requirements during the pandemic, prolonged time away from family and reduced domestic support may also be an independent risk factor for burnout.

      Conclusions and Implications

      Our study highlights that every level of the health care workforce is susceptible to burnout. Mitigating strategies should be deployed to both front- and second-line HCWs. Women and HCWs redeployed onsite, especially where involuntary or involving complex medical care, need special attention. This includes female-dominated HCW roles, such as nursing, AHPs, and administrative staff within our health care workforce. Modifiable workplace factors include adequate training, avoiding prolonged shifts ≥8 hours and promoting safe working environments. Future interpandemic strategies include codifying best practices in clinical care and human resource management in preparation for future pandemics as well as continual training and accreditation in infectious disease-relevant skills such as PPE usage. Coping strategies should be taught during and in-between pandemics to reduce the onset and effects of burnout as a continual priority in sustaining patient-care efforts.

      Supplementary Data

      Supplementary Table 1Health Care Institutions That Were Included in This Study
      Health InstitutionAddressBed CapacityCOVID-19 Cases at Any 1 Time During Study PeriodNumber of Health Care Workers Invited
      National University Hospital5 Lower Kent Ridge Rd, Singapore 1190741200 beds50–1004747
      Ng Teng Fong General Hospital1 Jurong East Street 21, Singapore 609606700 beds50–1002452
      Alexandra Hospital378 Alexandra Rd, Singapore 159964300 beds50–100815
      Institute of Mental Health10 Buangkok View, Buangkok Green Medical Park, Singapore 5397472000 beds1–252486
      National University PolyclinicsBukit Batok Polyclinic

      50 Bukit Batok West Avenue 3

      Singapore 659164

      Choa Chu Kang Polyclinic

      2 Teck Whye Crescent

      Singapore 688846

      Clementi Polyclinic

      Blk 451 Clementi Avenue 3 #02–307

      Singapore 120451

      Jurong Polyclinic

      190 Jurong East Avenue 1

      Singapore 609788

      Pioneer Polyclinic

      26 Jurong West Street 61

      Singapore 648201

      Queenstown Polyclinic

      580 Stirling Road

      Singapore 148958
      786
      Supplementary Table 2Oldenburg Burnout Inventory (4-Point Likert Scale)
      QuestionDomainReversed Questions
      1. I always find new and interesting aspects of my work.D
      2. There are days when I feel tired before I arrive at work.E
      3. It happens more and more often that I talk about my work in a negative way.D
      4. After work, I tend to need more time than in the past in order to relax and feel betterE
      5. I can tolerate the pressure of my work very well.E
      6. Lately, I tend to think less at work and do my job almost mechanically.D
      7. I find my work to be a positive challenge.D
      8. During my work, I often feel emotionally drained.E
      9. Over time, one can become disconnected from this type of work.D
      10. After working, I have enough energy for my leisure activities.E
      11. Sometimes I feel sickened by my work tasks.D
      12. After my work, I usually feel worn out and weary.E
      13. This is the only type of work that I can imagine myself doing.D
      14. Usually, I can manage the amount of my work well.E
      15. I feel more and more engaged in my work.D
      16. When I work, I usually feel energized.E
      D, Disengagement; E, Exhaustion.
      Supplementary Table 3Safety Attitudes Questionnaire (5-Point Likert Scale)
      QuestionDomainReversed

      Questions
      1. Nurse input is well received in this clinical area.TW
      2. In this clinical area, it is difficult to speak up if I perceive a problem with patient care.
      3. Disagreements in this clinical area are resolved appropriately (ie, not who is right, but what is best for the patient).
      4. I have the support I need from other personnel to care for patients.
      5. It is easy for personnel here to ask questions when there is something that they do not understand.
      6. The physicians and nurses here work together as a well-coordinated team.
      7. I would feel safe being treated here as a patient.SC
      8. Medical errors are handled appropriately in this clinical area.
      9. I know the proper channels to direct questions regarding patient safety in this clinical area.
      10. I receive appropriate feedback about my performance.
      11. In this clinical area, it is difficult to discuss errors.
      12. I am encouraged by my colleagues to report any patient safety concerns I may have.
      13. The culture in this clinical area makes it easy to learn from the errors of others.
      14. I like my job.JS
      15. Working here is like being part of a large family.
      16. This is a good place to work.
      17. I am proud to work in this clinical area.
      18. Morale in this clinical area is high.
      19. When my workload becomes excessive, my performance is impaired.SR
      20. I am less effective at work when fatigued.
      21. I am more likely to make errors in tense or hostile situations.
      22. Fatigue impairs my performance during emergency situations (eg, emergency resuscitation, seizure).
      23. Management supports my daily efforts.PM
      24. Management doesn't knowingly compromise patient safety.
      25. Management is doing a good job.
      26. Problem personnel are dealt with constructively by our management.
      27. I get adequate, timely info about events that might affect my work, from management.
      28. The levels of staffing in this clinical area are sufficient to handle the number of patients.WC
      29. This hospital does a good job of training new personnel.
      30. All the necessary information for diagnostic and therapeutic decisions is routinely available to me.
      31. Trainees in my discipline are adequately supervised.
      32. I experience good collaboration with nurses in this clinical area.No domain
      33. I experience good collaboration with staff physicians in this clinical area.
      34. I experience good collaboration with pharmacists in this clinical area.
      35. Communication breakdowns that lead to delays in delivery of care are common.
      36. My suggestions about safety would be acted upon if I expressed them to management.
      JS, job satisfaction; PM, perceptions of management; SC, safety culture; SR, stress recognition; TW, teamwork; WC, working conditions.
      Supplementary Table 4Hospital Anxiety and Depression Scale
      QuestionDomainResponses and Score
      1.I feel tense or “wound up”AMost of the timeA lot of the timeFrom time to time, occasionallyNot at all
      3210
      2.I still enjoy the things I used to enjoyDDefinitely as muchNot quite so muchOnly a littleHardly at all
      0123
      3.I get a sort of frightened feeling as if something awful is about to happenAVery definitely and quite badlyYes, but not too badlyA little, but it doesn't worry meNot at all
      3210
      4.I can laugh and see the funny side of thingsDAs much as I always couldNot quite so much nowDefinitely not so much nowNot at all
      0123
      5.Worrying thoughts go through my mindAA great deal of the timeA lot of the timeFrom time to time, but not too oftenOnly occasionally
      3210
      6.I feel cheerfulDNot at allNot oftenSometimesMost of the time
      0123
      7.I can sit at ease and feel relaxedADefinitelyUsuallyNot oftenNot at all
      0123
      8.I feel as if I am slowed downDNearly all the timeVery oftenSometimesNot at all
      3210
      9.I get a sort of frightened feeling like “butterflies” in the stomachANot at allOccasionallyQuite oftenVery often
      0123
      10.I have lost interest in my appearanceDDefinitelyI don't take as much care as I shouldI may not take quite as much careI take just as much care ever
      3210
      11.I feel restless as I have to be on the moveAVery much indeedQuite a lotNot very muchNot at all
      3210
      12.I look forward with enjoyment to thingsDAs much as I ever didRather less than I used toDefinitely less than I used toHardly at all
      0123
      13.I get sudden feelings of panicAVery often indeedQuite oftenNot very oftenNot at all
      3210
      14.I can enjoy a good book or radio or TV programDOftenSometimesNot oftenVery seldom
      0123
      A, Anxiety; D, Depression.
      0–7: Normal, 8–10: Borderline abnormal, 11–21: Abnormal
      Supplementary Table 5Cronbach's Alpha and Goodness-of-Fit Confirmatory Factor Analysis
      SubscaleCronbach's Alpha (> 0.7)Confirmatory Factor Analysis Model-Fit Indices
      CFI (>0.9)RMSEA (< 0.06)SRMSR (< 0.08)
      Hospital Anxiety and Depression Scale
       Depression0.800.960.0660.033
       Anxiety0.840.990.0470.020
      Oldenburg Burnout Inventory
       Disengagement0.800.890.0590.112
       Exhaustion0.830.910.1060.061
      Safety Attitudes Questionnaire
       Team work0.860.990.0550.020
       Safety climate0.830.980.0680.024
       Job satisfaction0.910.990.0640.014
       Stress recognition0.830.980.1220.026
       Perception of management0.830.990.0510.015
       Working condition0.831.000.0150.005
      CFI, Comparative Fit Indices; RMSEA, Root Mean Square Error of Approximation; SRMSR, Standardized Root Mean Square Residual.

      References

        • Liang Z.C.
        • Ooi S.B.S.
        COVID-19: A Singapore orthopedic resident’s musings in the emergency department.
        Acad Emerg Med. 2020; 27: 349-350
        • Koh D.
        Migrant workers and COVID-19.
        Occup Environ Med. 2020; 77: 634-636
        • Sadarangani S.P.
        • Lim P.L.
        • Vasoo S.
        Infectious diseases and migrant worker health in Singapore: A receiving country's perspective.
        J Travel Med. 2017; 24
        • Ministry of Manpower Government of Singapore
        Various types of housing and their specific requirements.
        (Available at:) (Published 2020. Accessed June 30, 2020)
        • Ministry of Health Government of Singapore
        29 July 2020. Daily Report on COVID-19.
        (Available at:)
        • Ministry of Manpower Government of Singapore
        Comprehensive approach to take care of the well-being of foreign workers living in dormitories.
        (Available at:)
        • Chew M.H.
        • Koh F.H.
        • Wu J.T.
        • et al.
        Clinical assessment of COVID-19 outbreak among migrant workers residing in a large dormitory in Singapore.
        J Hosp Infect. 2020; 106: 202-203
        • Ministry of Health Government of Singapore
        Comprehensive Medical Strategy for COVID-19.
        (Available at:) (Published 2020. Updated April 28, 2020. Accessed July 17, 2020)
        • Kisely S.
        • Warren N.
        • McMahon L.
        • et al.
        Occurrence, prevention, and management of the psychological effects of emerging virus outbreaks on healthcare workers: Rapid review and meta-analysis.
        BMJ. 2020; 369: m1642
        • Chan A.O.
        • Huak C.Y.
        Psychological impact of the 2003 severe acute respiratory syndrome outbreak on health care workers in a medium size regional general hospital in Singapore.
        Occup Med (Lond). 2004; 54: 190-196
        • Tam C.W.
        • Pang E.P.
        • Lam L.C.
        • Chiu H.F.
        Severe acute respiratory syndrome (SARS) in Hong Kong in 2003: Stress and psychological impact among frontline healthcare workers.
        Psychol Med. 2004; 34: 1197-1204
        • Wu P.
        • Fang Y.
        • Guan Z.
        • et al.
        The psychological impact of the SARS epidemic on hospital employees in China: Exposure, risk perception, and altruistic acceptance of risk.
        Can J Psychiatry. 2009; 54: 302-311
        • Nickell L.A.
        • Crighton E.J.
        • Tracy C.S.
        • et al.
        Psychosocial effects of SARS on hospital staff: Survey of a large tertiary care institution.
        CMAJ. 2004; 170: 793-798
        • Maslach C.
        • Jackson S.E.
        The measurement of experienced burnout.
        J Organ Behav. 1981; 2: 99-113
        • Shanafelt T.D.
        • Bradley K.A.
        • Wipf J.E.
        • Back A.L.
        Burnout and self-reported patient care in an internal medicine residency program.
        Ann Intern Med. 2002; 136: 358-367
        • Dewa C.S.
        • Loong D.
        • Bonato S.
        • Trojanowski L.
        The relationship between physician burnout and quality of healthcare in terms of safety and acceptability: A systematic review.
        BMJ Open. 2017; 7: e015141
        • McManus I.C.
        • Winder B.C.
        • Gordon D.
        The causal links between stress and burnout in a longitudinal study of UK doctors.
        Lancet. 2002; 359: 2089-2090
        • Brown S.D.
        • Goske M.J.
        • Johnson C.M.
        Beyond substance abuse: Stress, burnout, and depression as causes of physician impairment and disruptive behavior.
        J Am Coll Radiol. 2009; 6: 479-485
        • Balch C.M.
        • Freischlag J.A.
        • Shanafelt T.D.
        Stress and burnout among surgeons: Understanding and managing the syndrome and avoiding the adverse consequences.
        Arch Surg. 2009; 144: 371-376
        • Coughlan C.
        • Nafde C.
        • Khodatars S.
        • et al.
        COVID-19: Lessons for junior doctors redeployed to critical care.
        Postgrad Med J. 2020 June 24; (postgradmedj-2020–138100 [E-pub ahead of print])
        • Demerouti E.
        • Bakker A.B.
        • Vardakou I.
        • Kantas A.
        The convergent validity of two burnout instruments: A multitrait-multimethod analysis.
        Eur J Psychol Assess. 2003; 19: 12
        • Peterson U.
        • Bergström G.
        • Demerouti E.
        • et al.
        Burnout levels and self-rated health prospectively predict future long-term sickness absence: A study among female health professionals.
        J Occup Environ Med. 2011; 53: 788-793
        • Molodynski A.
        • Lewis T.
        • Kadhum M.
        • et al.
        Cultural variations in wellbeing, burnout and substance use among medical students in twelve countries.
        Int Rev Psychiatry. 2020 March 18; ([E-pub ahead of print]): 1-6
        • Collin V.
        • Toon M.
        • O'Selmo E.
        • et al.
        A survey of stress, burnout and well-being in UK dentists.
        Br Dent J. 2019; 226: 40-49
        • Lee R.T.
        • Ashforth B.E.
        On the meaning of Maslach's three dimensions of burnout.
        J Appl Psychol. 1990; 75: 743-747
        • Podsakoff P.M.
        • MacKenzie S.B.
        • Lee J.-Y.
        • Podsakoff N.P.
        Common method biases in behavioral research: A critical review of the literature and recommended remedies.
        J Appl Psychol. 2003; 88: 879-903
        • Aldrich B.
        • Price J.
        • Mueller C.
        Handbook of organizational measurement.
        Teaching Sociology. 1989; 17: 102
        • Reis D.
        • Xanthopoulou D.
        • Tsaousis I.
        Measuring job and academic burnout with the Oldenburg Burnout Inventory (OLBI): Factorial invariance across samples and countries.
        Burnout Research. 2015; 2: 8-18
        • Mahadi N.
        • Chin R.W.
        • Chua Y.
        • et al.
        Malay language translation and validation of the Oldenburg Burnout Inventory Measuring Burnout.
        Education in Medicine Journal. 2018; 10
        • Sinval J.
        • Queirós C.
        • Pasian S.
        • Marôco J.
        Transcultural adaptation of the Oldenburg Burnout Inventory (OLBI) for Brazil and Portugal.
        Front Psychol. 2019; 10: 338
        • Sexton J.B.
        • Helmreich R.L.
        • Neilands T.B.
        • et al.
        The Safety Attitudes Questionnaire: Psychometric properties, benchmarking data, and emerging research.
        BMC Health Serv Res. 2006; 6: 44
        • Profit J.
        • Etchegaray J.
        • Petersen L.A.
        • et al.
        The Safety Attitudes Questionnaire as a tool for benchmarking safety culture in the NICU.
        Arch Dis Child Fetal Neonatal. 2012; 97: F127-F132
        • Samsuri S.E.
        • Pei Lin L.
        • Fahrni M.L.
        Safety culture perceptions of pharmacists in Malaysian hospitals and health clinics: A multicentre assessment using the Safety Attitudes Questionnaire.
        BMJ Open. 2015; 5: e008889
        • Profit J.
        • Sharek P.J.
        • Amspoker A.B.
        • et al.
        Burnout in the NICU setting and its relation to safety culture.
        BMJ Qual Saf. 2014; 23: 806-813
        • Zigmond A.S.
        • Snaith R.P.
        The hospital anxiety and depression scale.
        Acta Psychiatr Scand. 1983; 67: 361-370
        • Vandenberg R.J.
        • Lance C.E.
        A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research.
        Organizational Research Methods. 2000; 3: 4-70
        • See K.C.
        • Zhao M.Y.
        • Nakataki E.
        • et al.
        Professional burnout among physicians and nurses in Asian intensive care units: A multinational survey.
        Intensive Care Med. 2018; 44: 2079-2090
        • Ang S.Y.
        • Dhaliwal S.S.
        • Ayre T.C.
        • et al.
        Demographics and personality factors associated with burnout among nurses in a Singapore tertiary hospital.
        BioMed Res Int. 2016; 2016: 6960184
        • Lee P.T.
        • Loh J.
        • Sng G.
        • et al.
        Empathy and burnout: A study on residents from a Singapore institution.
        Singapore Med J. 2018; 59: 50-54
        • Lim W.Y.
        • Ong J.
        • Ong S.
        • et al.
        The Abbreviated Maslach Burnout Inventory can overestimate burnout: A study of anesthesiology residents.
        J Clin Med. 2019; 9: 61
        • Suyi Y.
        • Meredith P.
        • Khan A.
        Effectiveness of mindfulness intervention in reducing stress and burnout for mental health professionals in Singapore.
        Explore (NY). 2017; 13: 319-326
        • Al-Dubai S.A.R.
        • Ganasegeran K.
        • Perianayagam W.
        • Rampal K.G.
        Emotional burnout, perceived sources of job stress, professional fulfillment, and engagement among medical residents in Malaysia.
        ScientificWorldJournal. 2013; 2013: 137620
        • Norlund S.
        • Reuterwall C.
        • Höög J.
        • et al.
        Burnout, working conditions and gender—results from the northern Sweden MONICA Study.
        BMC Public Health. 2010; 10: 326
        • Purvanova R.K.
        • Muros J.P.
        Gender differences in burnout: A meta-analysis.
        Journal of Vocational Behavior. 2010; 77: 168-185
        • Byron K.
        A meta-analytic review of work-family conflict and its antecedents.
        J Vocat Behav. 2005; 67: 169-198
      1. Hassan H. Malaysia bans travel abroad, shuts schools and businesses over coronavirus spread; lockdown till March 31. Straits Times. March 16, 2020.

        • Ministry of Health Government of Singapore
        Gradual re-opening of travel and changes to border measures.
        (Available at:)
        • Chou L.-P.
        • Li C.-Y.
        • Hu S.C.
        Job stress and burnout in hospital employees: Comparisons of different medical professions in a regional hospital in Taiwan.
        BMJ Open. 2014; 4: e004185
        • Rossi R.
        • Socci V.
        • Pacitti F.
        • et al.
        Mental health outcomes among frontline and second-line health care workers during the Coronavirus Disease 2019 (COVID-19) pandemic in Italy.
        JAMA Netw Open. 2020; 3: e2010185
        • Bernucci C.
        • Brembilla C.
        • Veiceschi P.
        Effects of the COVID-19 outbreak in Northern Italy: Perspectives from the Bergamo Neurosurgery Department.
        World Neurosurg. 2020; 137: 465-468.e1
        • Sarpong N.O.
        • Forrester L.A.
        • Levine W.N.
        What's important: Redeployment of the orthopaedic surgeon during the COVID-19 pandemic: Perspectives from the trenches.
        J Bone Joint Surg Am. 2020; 102: 1019-1021
        • Ong J.J.Y.
        • Bharatendu C.
        • Goh Y.
        • et al.
        Headaches associated with personal protective equipment - a cross-sectional study among frontline healthcare workers during COVID-19.
        Headache. 2020; 60: 864-877
        • Tabah A.
        • Ramanan M.
        • Laupland K.B.
        • et al.
        Personal protective equipment and intensive care unit healthcare worker safety in the COVID-19 era (PPE-SAFE): An international survey.
        J Crit Care. 2020; 59: 70-75
        • Yamamoto-Mitani N.
        • Saito Y.
        • Takaoka M.
        • et al.
        Nurses’ and care workers’ perception of care quality in Japanese long-term care wards: A qualitative descriptive study.
        Glob Qual Nurs Res. 2018; 5 (2333393618812189)
        • Gleichgerrcht E.
        • Decety J.
        Empathy in clinical practice: How individual dispositions, gender, and experience moderate empathic concern, burnout, and emotional distress in physicians.
        PLoS One. 2013; 8: e61526
        • Lai J.
        • Ma S.
        • Wang Y.
        • et al.
        Factors associated with mental health outcomes among health care workers exposed to coronavirus disease 2019.
        JAMA Netw Open. 2020; 3: e203976
        • Hu D.
        • Kong Y.
        • Li W.
        • et al.
        Frontline nurses’ burnout, anxiety, depression, and fear statuses and their associated factors during the COVID-19 outbreak in Wuhan, China: A large-scale cross-sectional study.
        EClinicalMedicine. 2020; 24: 100424
        • Gupta N.
        • Diallo K.
        • Zurn P.
        • Dal Poz M.R.
        Assessing human resources for health: What can be learned from labour force surveys?.
        Human Resources for Health. 2003; 1: 5
        • Ministry of Health Government of Singapore
        Healthcare workforce statistic.
        (Available at:) (Published 2019. Updated December 23, 2019. Accessed July 30, 2020)