AbstractBackground and Objective This study aimed to investigate the reliability and validity of the Bedtime Procrastination Scale (BPS) among Korean high school students during the COVID-19 pandemic.
Methods We conducted an online survey among a total of 300 high school students from October 18–24, 2021. We performed confirmatory factor analysis (CFA) on the two-factor model of the BPS. Psychometric properties were explored using the Graded Response Model and Rasch model. The reliability of internal consistency was assessed using Cronbach’s alpha. Convergent validity was examined regarding depression using the Patient Health Questionnaire-9 items and viral anxiety using the Stress and Anxiety to Viral Epidemics-6 items.
Results The CFA results indicated a strong model fit for the BPS (χ2/df=0.597, CFI=1.000, TLI=1.012, RMSEA=0.000, and SRMR=0.040). Additionally, the BPS demonstrated strong reliability (Cronbach’s alpha=0.824). Bedtime procrastination was significantly correlated with depression (r=0.31, p<0.001) but not with viral anxiety.
INTRODUCTIONDuring the COVID-19 pandemic, many high school students’ daily lives were disrupted. The disruptions during the school year in Korea were evident as the start of the school year was delayed by five weeks and a shift to online learning occurred [1]. This sudden change in the school environment affected students’ emotional states and routines [2]. Throughout 2021, the Centers for Disease Control and Prevention conducted the adolescent behaviors and experiences survey, revealing that since the beginning of the pandemic, 66% of students found it more challenging to complete their academic work and experienced difficulties in accessing education and healthcare [3]. Various psychological disturbances emerged as the COVID-19 pandemic caused significant changes in adolescents’ daily lives, including pressure from adjusting to online schooling, social isolation from peers, and spending excessive time with their immediate families, potentially leading to heightened tensions and increased conflicts [4,5].
Furthermore, many adolescents struggled to maintain regular eating and sleeping habits due to decreased activity and social interactions [6]. Many students reported reduced sleep quality and bedtime procrastination, with high school students particularly susceptible to excessive screen time during the pandemic due to quarantines, infections, and online classes, making them more vulnerable to sleep disturbances and further bedtime procrastination.
Bedtime procrastination is characterized as the intentional delay of bedtime without external justifications [7]. This behavior in adolescents can lead to or exacerbate sleep disturbances [8]. During the COVID-19 pandemic, bedtime procrastination became more severe and prevalent among youth [9]. The lack of a structured schedule and online learning contributed to this issue. Moreover, staying up late to watch videos or browse social media on the phone often leads to additional procrastination at bedtime, which results in poorer sleep quality and can negatively impact both physical and psychiatric health [10]. Engaging in smartphone use, video games, and online streaming before or in bed acts as an aftermath of disrupted routines, increased screen time, and heightened stress, anxiety, and feelings of isolation, with limited opportunities for physical activity due to lockdowns or social distancing [11].
During the COVID-19 pandemic, high school students experienced elevated levels of depression and anxiety. In a survey conducted two years after the onset of COVID-19, a significant number of high school students reported moderate to severe anxiety symptoms. High anxiety levels were associated with missing social events, spending time with friends at school, and students with high levels of anxiety believed these circumstances impacted their maturity and personal growth [12]. Another study also reported increased symptoms of depression, and a multivariable linear regression suggested that greater concerns about COVID-19 in school settings were significantly associated with higher depression levels [13]. The uncertainty surrounding the virus and fear of infection may have caused anxiety, leading many students to experience delayed sleep. Not only did the pandemic itself provoke viral anxiety, but the stress of disrupted daily routines and changes in classroom environments also fostered depression and distress. Preoccupation with the coronavirus is driven by anxiety, depression, and reassurance-seeking behaviors, with mediation analysis supporting the cognitive behavioral model of hypochondriasis, which can potentially lead to sleep disorders including bedtime delays and poor sleep quality [14]. A previous study on medical school students also reveals that viral anxiety and depression may affect individuals’ obsession with COVID-19, and reassurance-seeking behaviors may mediate this [15]. Similarly, anxiety and depression related to the pandemic may impact sleep hygiene among Korean high school students, ultimately leading to bedtime procrastination.
Bedtime procrastination, a concept introduced in 2014 by Kroese et al. [8], is defined as “failing to go to bed at the intended time, while no external circumstances prevent a person from doing so.” The Bedtime Procrastination Scale (BPS) was developed to assess individuals’ behaviors related to delaying sleep, such as staying up late for activities like watching TV, using a nine-item self-report questionnaire. BPS is significantly correlated with low self-regulation and is associated with poor sleep quality, psychiatric health issues, and diminished overall wellbeing [16]. One study validated the Korean version of BPS, confirming its reliability and relevance for use in the Korean general population. The results indicated that BPS strongly correlates with insomnia, perceived stress, and depression, making it an effective predictor of sleep and mental health disorders in clinical settings [17]. Subsequent studies with the Korean BPS showed that individuals with high bedtime procrastination levels exhibited significantly more depression, anxiety, and insomnia, and spent considerable time on media and leisure activities on smartphones before sleeping [18]. These findings suggest that BPS is negatively correlated with sleep and mood and should be addressed as a serious behavioral issue.
In a randomized controlled trial involving young adults in Korea, a behavioral intervention targeting BPS demonstrated promising results in reducing sleep interfering behaviors [19]. The study also seeks to validate the Korean version of BPS for high school students, since previous validations focused solely on the adult population. Given the developmental significance and unique characteristics of adolescence, such as high digital device usage, erratic sleep patterns, academic and peer pressures, it is crucial to confirm that the BPS effectively evaluates sleep behaviors in high school students. This validation will enhance our understandings and enable more targeted interventions to mitigate sleep disturbances, thereby improving the well-being of adolescents during demanding times like the COVID-19 pandemic.
METHODSParticipants and ProcedureWe conducted an online survey involving 300 high school students from October 18–24, 2021, using the services of the professional survey company EMBRAIN (www.embrain.com). Participants responded anonymously as no identifiable personal information was collected. The Institutional Review Board of Asan Medical Center approved the study protocol (2021-1361) and waived the requirement for written informed consent. The survey commenced once a participant’s parent consented for their child to participate and selected “yes” to the agreement questions at the start of the survey. Demographic information collected included age, sex, grade, school type, and living area. The survey also contained questions about COVID-19, such as experiences of being quarantined, infection status, and vaccination.
MeasuresBedtime Procrastination ScaleThe BPS is a self-report rating scale specifically designed to measure the extent of an individual’s bedtime procrastination [8]. It consists of 9 items scored on a five-point scale from 1 (never) to 5 (always), with items 2, 3, 7, and 9 being scored in reverse. The Korean version of the BPS [17], previously validated in young adult populations, was utilized.
Patient Health Questionnaire-9 itemsThe Patient Health Questionnaire-9 items (PHQ-9) is a selfreport scale designed to assess depression severity, which was validated in both adults and adolescents [20,21]. It comprises 9 items rated on a Likert scale from 0 (never ever) to 3 (almost every day). For this study, the Korean version of the PHQ-9 was employed.
Stress and Anxiety to Viral Epidemics-6 itemsThe Stress and Anxiety to Viral Epidemics-6 items (SAVE-6) is a self-report rating scale, designed to assess one’s anxiety towards viruses during a pandemic [22]. The SAVE-6, derived from the original SAVE-9 scale, was developed specifically for healthcare workers [23]. Each of the 6 items on the SAVE-6 can be rated on a five-point Likert scale ranging from 0 (never) to 4 (always). In this study, we used the original SAVE-6 scale validated among high school students [24].
Statistical AnalysisIn this study, we evaluated the reliability and validity of the BPS. We assessed sampling adequacy and data suitability using the Kaiser-Meyer-Olkin (KMO) value and Bartlett’s test of sphericity before conducting the factor analysis. The factor structure was investigated through confirmatory factor analysis (CFA), with satisfactory model fit criteria defined by a standardized root mean square residual (SRMR) ≤0.05, root mean square error of approximation (RMSEA) ≤0.10, and comparative fit index (CFI) and Tucker-Lewis index (TLI) values ≥0.90 [25,26]. Additionally, the Graded Response Model (GRM) and Rasch analysis were applied to explore the psychometric properties of the BPS. Internal consistency reliability was assessed using Cronbach’s alpha and McDonald’s omega. We also tested the convergent validity of the BPS with the existing PHQ-9 and SAVE-6 scales using Pearson’s correlation coefficients. For statistical analysis, we utilized jamovi version 1.6.23 (https://www.jamovi.org/; Sydney, Australia).
RESULTS
Table 1 presents the demographic characteristics of the participants.
Validity and Reliability of the Korean Version of the BPSSample adequacy and data suitability were evaluated using the KMO measure (0.86) and Bartlett’s test of sphericity (p<0.001). The CFA performed with the DWLS methods indicated a good model fit (χ2/df=0.597, CFI=1.000, TLI=1.012, RMSEA=0.000, SRMR=0.040) (Tables 2 and 3). Fig. 1 illustrates the CFA factor structure with factor loadings and error variances. The multigroup CFA, including configural, metric, and scalar invariance, confirmed that the Korean version of the BPS accurately measures the same construct across sex and depression levels (Supplementary Table 1 in the online-only Data Supplement).
Graded Response Model
Supplementary Table 2 (in the online-only Data Supplement) presents the GRM outputs. After controlling for the false discovery rate (FDR), all the p-values of the S-χ2 for both factors were nonsignificant at a p-value of 0.01, except for item 3 in factor II. However, all RMSEA values were below 0.080. According to these RMSEA values, all items belong to the scale. For factor I, the slope/discrimination parameters (α) ranged from 2.231 to 4.772 (mean=3.115). All items in factor I had very high slopes. For factor II, the slope/discrimination parameters (α) ranged from 1.276 to 2.024 (mean=1.661). Item 3 exhibited a moderate slope, item 9 a high slope, and items 2 and 7 very high slope coefficients. These items provide valuable information and efficiently discriminate among individuals assessed using the Korean version of the BPS. The threshold coefficients (b) for factor I indicate that a higher latent trait or theta is necessary to endorse Likert-type response options “almost always” in all items. For factor II, the threshold coefficients (b) indicate that a higher latent trait or theta is necessary to endorse Likert-type response options from “frequently” to “almost always” for all items, except item 3, which is the most challenging item in this factor. The item characteristic curves in Fig. 2 display this information. The scale information curves (Fig. 3) show that factor I provides more information on bedtime procrastination than factor II. Several peaks in the curve for factor I could result from the polytomous nature of the data.
Rasch Model
Supplementary Table 3 (in the online-only Data Supplement) presents the outputs of the Rasch model for the Korean version of the BPS. The infit and outfit mean squares of all items in both factors are within the recommended range (0.50–1.50). In factor I, item 1 is the least difficult, and item 5 is the most difficult. In factor II, item 9 is the least difficult, and item 3 is the most difficult. All subscales have an acceptable item separation index (≥2) and item and person reliability (≥0.7) (Table 3). Factor I has an acceptable person separation index, but factor II does not.
Reliability and Evidence Based on Relations to Other VariablesThe Korean version of the BPS demonstrates good internal consistency with support from Cronbach’s alpha, McDonald’s omega, and the split-half reliability for each factor (Table 3). The BPS score was significantly correlated with the PHQ-9 score (r=0.31, p<0.01), yet it showed no correlation with the SAVE-6 score (r=-0.05, p=0.56).
DISCUSSIONIn this study, we aimed to explore the reliability and validity of the BPS in high school students. We observed that the BPS is a reliable and valid rating scale for measuring high school students’ bedtime procrastination during the pandemic. Furthermore, bedtime procrastination was positively associated with depression during the pandemic.
We aimed to explore the reliability and validity of the BPS among high school students particularly during the COVID-19 pandemic. The CFA demonstrated a good model fit for the single-factor model of the BPS in this study. The original study on the BPS proposed a single-factor model [8]. In a Korean validation study involving young adults, a single-factor model was proposed, yet both single- and two-factor models proved reliable and valid [17]. In this study, we examined the validity of the BPS as a two-factor model. Consistent with previous findings, the BPS among high school students displayed good internal consistency reliability [17,27].
Another significant strength of this study is that the psychometric properties of the BPS were assessed using the modern test theory approach [28]. This is the first study to assess the psychometric properties of this scale using this approach. The results exhibited good slope and threshold parameters, which are difficulty indices. Similar to internal consistency reliability, the BPS among high school students had good item response theory reliability, item reliability, and person reliability.
We also observed that depression was significantly associated with bedtime procrastination among high school students. Previous studies primarily involving adults reported similar findings [18]. While the link between bedtime procrastination and depression among adolescents remains understudied, the association between depressive symptoms and delays in sleep time has been reported [29]. The results of this study contribute to the literature on the association between depression and bedtime procrastination during the pandemic.
Contrary to expectations, the BPS was not significantly associated with SAVE-6. During the pandemic, many students experienced viral anxiety, leading to an expectation of reluctance to attend school, which could manifest as bedtime procrastination. Further studies will examine the negative correlation between BPS and SAVE-6 to understand the impact of viral anxiety on bedtime procrastination.
This study has several limitations. First, it was conducted through an online survey using a platform that may introduce sampling bias. An anonymous online survey could also influence the reliability of participants’ responses. Despite these issues, we opted for an online survey over face-to-face interviews to prevent viral transmission. Second, the research relied on self-report questionnaires without collecting objective measures such as actual bedtime or wake-up times, thus we could not verify participants’ bedtime procrastination against objective sleep indices.
In conclusion, the BPS was found to be reliable and valid in assessing bedtime procrastination in high school students, which was significantly related to depression during the pandemic. The BPS scale is suitable for measuring bedtime procrastination in this demographic within the clinical context.
Supplementary MaterialsThe online-only Data Supplement is available with this article at https://doi.org/10.17241/smr.2024.02544.
NOTESAvailability of Data and Material
The datasets generated or analyzed during the study are available from the corresponding author on reasonable request.
Author Contributions
Conceptualization: Taeyeop Lee. Data curation: Jaeeun Song. Formal analysis: Jaeeun Song, Oli Ahmed. Methodology: all authors. Project administration: Jaeeun Song. Software: Jaeeun Song, Oli Ahmed. Supervision: Taeyeop Lee. Visualization: Jaeeun Song, Oli Ahmed. Writing—original draft: Jaeeun Song, Oli Ahmed. Writing—review & editing: Taeyeop Lee.
ACKNOWLEDGEMENTSWe would like to express our gratitude to Seockhoon Chung for his advise in statistical analysis.
REFERENCES1. Byun S, Slavin RE. Educational responses to the COVID-19 outbreak in South Korea. Best Evid Chin Edu 2020;5:665-80.
2. Thakur A. Mental health in high school students at the time of COVID-19: a student’s perspective. J Am Acad Child Adolesc Psychiatry 2020;59:1309-10.
3. Krause KH, Verlenden JV, Szucs LE, Swedo EA, Merlo CL, Niolon PH, et al. Disruptions to school and home life among high school students during the COVID-19 pandemic—adolescent behaviors and experiences survey, United States, January–June 2021. MMWR Suppl 2022;71:28-34.
4. Schlegl S, Maier J, Meule A, Voderholzer U. Eating disorders in times of the COVID-19 pandemic-results from an online survey of patients with anorexia nervosa. Int J Eat Disord 2020;53:1791-800.
5. Barendse MEA, Flannery J, Cavanagh C, Aristizabal M, Becker SP, Berger E, et al. Longitudinal change in adolescent depression and anxiety symptoms from before to during the COVID-19 pandemic. J Res Adolesc 2023;33:74-91.
6. Lee MS, Kim DJ, Lee H. Trends in health behaviors and mental health among Korean adolescents in Korea over 5 years, 2017-2021: focusing on the comparisons before and during the COVID-19 pandemic. Front Public Health 2023;11:1139110.
7. Nauts S, Kamphorst BA, Stut W, De Ridder DTD, Anderson JH. The explanations people give for going to bed late: a qualitative study of the varieties of bedtime procrastination. Behav Sleep Med 2019;17:753-62.
8. Kroese FM, De Ridder DT, Evers C, Adriaanse MA. Bedtime procrastination: introducing a new area of procrastination. Front Psychol 2014;5:611.
9. Oliveira A, Pereira B, Rosário P, Magalhães P. Bedtime procrastination during the second COVID-19 lockdown in Portugal. Sleep Sci 2022;15:105-11.
10. Wang Q, Kou Z, Du Y, Wang K, Xu Y. Academic procrastination and negative emotions among adolescents during the COVID-19 pandemic: the mediating and buffering effects of online-shopping addiction. Front Psychol 2022;12:789505.
11. Kim NH, Lee JM, Yang SH, Lee JM. Association between smartphone overdependency and mental health in Korean adolescents during the COVID pandemic; age-and gender-matched study. Front Public Health 2022;10:1056693.
12. Yin O, Parikka N, Ma A, Kreniske P, Mellins CA. Persistent anxiety among high school students: survey results from the second year of the COVID pandemic. PLoS One 2022;17:e0275292.
13. Hawes MT, Szenczy AK, Klein DN, Hajcak G, Nelson BD. Increases in depression and anxiety symptoms in adolescents and young adults during the COVID-19 pandemic. Psychol Med 2022;52:3222-30.
14. Song J, Cho E, Cho IK, Lee D, Kim J, Kim H, et al. Mediating effect of intolerance of uncertainty and cancer-related dysfunctional beliefs about sleep on psychological symptoms and fear of progression among cancer patients. Psychiatry Investig 2023;20:912-20.
15. Kim HS, Ahn J, Lee J, Hong Y, Kim C, Park J, et al. The mediating effect of reassurance-seeking behavior on the influence of viral anxiety and depression on COVID-19 obsession among medical students. Front Psychiatry 2022;13:899266.
16. Alshammari TK, Rogowska AM, Basharahil RF, Alomar SF, Alseraye SS, Al Juffali LA, et al. Examining bedtime procrastination, study engagement, and studyholism in undergraduate students, and their association with insomnia. Front Psychol 2023;13:1111038.
17. An H, Chung SJ, Suh S. [Validation of the Korean bedtime procrastination scale in young adults]. J Sleep Med 2019;16:41-7 Korean.
18. Chung SJ, An H, Suh S. What do people do before going to bed? A study of bedtime procrastination using time use surveys. Sleep 2020;43:zsz267.
19. Jeoung S, Jeon H, Yang HC, An H, Suh S. A randomized controlled trial of a behavioral intervention for decreasing bedtime procrastination using a wait-list control group in a non-clinical sample of young adults. Sleep Med 2023;108:114-23.
20. Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med 2001;16:606-13.
21. Richardson LP, McCauley E, Grossman DC, McCarty CA, Richards J, Russo JE, et al. Evaluation of the patient health questionnaire-9 item for detecting major depression among adolescents. Pediatrics 2010;126:1117-23.
22. Chung S, Ahn MH, Lee S, Kang S, Suh S, Shin YW. The stress and anxiety to viral epidemics-6 items (SAVE-6) scale: a new instrument for assessing the anxiety response of general population to the viral epidemic during the COVID-19 pandemic. Front Psychol 2021;12:669606.
23. Chung S, Kim HJ, Ahn MH, Yeo S, Lee J, Kim K, et al. Development of the stress and anxiety to viral epidemics-9 (SAVE-9) scale for assessing work-related stress and anxiety in healthcare workers in response to viral epidemics. J Korean Med Sci 2021;36:e319.
24. Lee T, Ahmed O, Akça ÖF, Chung S. Psychometric properties of the stress and anxiety to viral epidemics-6 items (SAVE-6) scale for high school students during the COVID-19 pandemic. Front Psychiatry 2022;13:815339.
25. Brown TA. Confirmatory factor analysis for applied research. 1st ed. New York: Guilford Press 2006.
26. Byrne BM. Structural equation modeling with AMOS: basic concepts, applications, and programming. 1st ed. Mahwah: Lawrence Erlbaum Associates 2001.
27. Herzog-Krzywoszanska R, Krzywoszanski L. Bedtime procrastination, sleep-related behaviors, and demographic factors in an online survey on a polish sample. Front Neurosci 2019;13:963.
Table 1.Table 2.Table 3. |
|