1. Introduction
Sleep is a physical and mental resting state in which a person becomes relatively inactive and careless of their environment. Sleep problems include the inability to fall asleep or go back to sleep and frequent waking up during the night; such problems affect not only occupational and educational functioning but also the safety and quality of life. Sleep disorders can increase tension; cause irritability, depression, and confusion; and have an adverse impact on the quality of life in general [
1].
Different instruments such as several questionnaires have been developed to assess sleep disturbances. Standardized questionnaires provide comprehensive assessments of sleep quality, but these questionnaires are few. One of the most widely used instruments in clinical and research settings is the Pittsburgh Sleep Quality Index (PSQI) questionnaire. This questionnaire was introduced by Buysse as a fast and valid instrument for determining sleep quality and sleep disorders [
2]. Different studies applied PSQI for detecting sleep disorders among the general population [
3], working people [
4], and clinical populations [
5-9]. The PSQI has been evaluated for its reliability and validity in different populations as different cultures have different perceptions of sleep and its problems. Cole examined the factor structure of the PSQI using confirmatory factor analysis in older adults. The study found that a 3-factor model was a better fit than a 1-factor model [
10].
A study done by Aloba, however, confirmed a 3-factor model generated by principal component analysis with the best cut-off score at 5 (sensitivity 0.720, specificity 0.545, and overall correct classification rate of 0.554) among Nigerian university students. The concurrent validity of the PSQI is further supported by its modest correlation with the General Health Quality (GHQ)-12 scores (r=0.252, P<0.001) [
11]. Burkhalter conducted a confirmatory factor analysis of the PSQI in renal transplant recipients and concluded that the 3-factor model had a weak fit [χ2=11.850, df=8, P=0.408; Root Mean Square Error of Approximation (RMSEA)=0.060; Weighted Root Mean square Residual (WRMR)=0.384; Confirmatory Fit Index (CFI)=0.992] [
12].
Mariman used factor analysis for validation of the PSQI in patients diagnosed with chronic fatigue syndrome and obtained a 3-factor model. All factor loadings were significant and all goodness-of-fit values were in acceptable range [χ2=14.70, df=11, P=0.20; Goodness of Fit Index (GFI)=0.99; Adjusted Goodness of Fit Index (AGFI) for Degrees of Freedom=0.97; CFI=0.99; RMSEA=0.03; The Consistent version of the Akaike Information Criterion (CAIC)=134.10]. Similarly, the 1-factor model suggested by Buysse et al. indicated a poor fit with the data (χ2=109.90, df=14, P<0.001; GFI=0.92; AGFI=0.85; CFI=0.84; RMSEA=0.13; CAIC=208.23) [
13]. Results of the study conducted by Tomfohr showed that a 3-factor model was better than 1-factor model in English speaking non-Hispanic whites and English and Spanish speaking Hispanics of Mexican descendens.
The Cronbach alpha values were stating of adequate internal consistency (Non-Hispanic Whites (NHW) α=0.775; English-speaking Hispanics of Mexican Descent (HMD) α=0.741; HMD α=0.770) [
14]. But in another study, Otte indicated a 2-factor model as the best model for breast cancer patients (χ2=89.70, df=13, P<0.05, Standardized Root Mean Square Residual (SRMR)=0.0048, Root-Mean Square Error Approximation (RMSEA)=0.075, CFI=0.98) [
15]. Cultural and demographic differences can lead to differences in factor structure results of the PSQI because sleep quality and perceptions of sleep are related to various factors such as sex, age, health, and culture. Therefore, this study aimed to assess the internal consistency, reliability, and factor structure of the PSQI for the citizens of Arak City, Iran.
2. Materials and Methods
Study subjects
A pilot study on 50 individuals was conducted to determine the internal consistency and item-total correlations of the PSQI. This pilot study confirmed the reliability of the PSQI questionnaire. Then in a cross-sectional study, 1115 Arak citizens aged 18-60 years, were selected by stratified random sampling method in 2015. In the first stage, the city was divided into three areas (S1, S2, and S3).
In the second stage, the samples were selected randomly from each area with proportional to area size (N1, N2, and N3). All participants provided verbal informed consent for using their information in this study. The participants were included in the study who were ≥18 years old, with illiterate level education, without psychotic or cognitive disorders, and not hospitalized or received outpatient treatment in the last month. All samples were interviewed face to face by a trained researcher.
They completed the Persian version of the PSQI questionnaire. Their demographic and other comparative variables were assessed, too. The variables that may affect sleep were evaluated, such as age, sex, and education level. This study was approved by the Ethics Committee of Arak University of Medical Sciences and each sample expressed his or her consent for participation in the study.
Study assessment
The PSQI questionnaire was used to survey the sleep quality of the previous month of the participants. The PSQI is a 19-item self-report questionnaire. These 19 items assess seven components: Sleep quality, sleep latency, sleep duration, habitual sleep efficiency, sleep disturbance, use of sleeping medication, and daytime dysfunction. Each component is rated on a 0-3 scale, where 0 and 3 indicate no difficulty and severe difficulty, respectively. The scores of seven component are then summed up to yield a total score which has a range of 0-21; higher scores indicate worse sleep quality [
2].
Statistical analysis
The PSQI questionnaire has a normal distribution. Thus, the results from parametric tests were proper for the PSQI. The descriptive statistics were computed for the total sample and separately for the male and female participants and stratified by age and education levels. For the PSQI, we presented the results as the Mean±SD or No. (%).
For The Pittsburgh Sleep Quality Index (PSQI), the descriptive statistics were calculated for total and subscale scores. A PSQI total score >5 was used to define clinically significant abnormalities, as has been done in studies on young and middle-aged adults [
2]. Pairwise comparisons were conducted with respect to the age groups (19-30, 31-50, and >51 years), educational level (under high school, high school, some college, college and graduate degree), and sex (male and female). The Independent samples t-test was used for quantitative sleep variables (PSQI total scores) and the Chi-square test was used for qualitative sleep variables (PSQI total score >5 vs. ≤5).
Validity
To assess the validity of the test content, the questionnaire was sent to a panel of 9 academic members consisting of experts in the fields of psychology and health education. For each item, the Item Content Validity Index (I-CVI) was calculated as the number of experts giving a rating of either 3 or 4, divided by the number of experts. For the Scale Content Validity Index (S-CVI), the calculated I-CVI for each item and then the average I-CVI were calculated across all items.
As Polit and Beck noted, for a scale to have excellent content validity, it should have items with I-CVIs of 0.78 or higher and S-CVI/Ave of 0.90 or higher [
16]. The internal consistency of the PSQI questionnaire was evaluated by the Cronbach alpha coefficient and item-scale correlation.
Reliability
To investigate the factor structure of the PSQI, the Exploratory Factor Analysis (EFA) was performed with a 2-factor solution and varimax rotation. Kaiser-Mayer-Olkin (KMO) value and Bartlett’s sphericity were reported, too. The correlations between each item and the total score of the specified factor were also calculated.
For the factorial analysis, the Kaiser-Meyer-Olkin (KMO) index and Bartlett-Test of Sphericity (BTS) were used as measures of adequacy of the sample size. Factor analysis is done to test the null hypothesis of the identity matrix, to verify no cross-correlation among variables and that all off-diagonal correlations are zero. KMO values >0.50 and P values <0.05 in Bartlett’s test are considered adequate for the factorial analysis [
17]. Principal components analysis was used to extract maximum variance (total variance explained for each factor) for decreasing a large number of variables into a smaller number of components [
18].
Confirmatory factor analysis
To test the model’s goodness of fit, we used model fit indexes, including the Chi-square test (χ2) with significance greater than 0.05, Chi-square ratio (χ2/df) with acceptable values below 2.0, Goodness of Fit Index (GFI) with acceptable values equal to or greater than 0.85, GFI Adjusted Goodness of Fit Index (AGFI) with acceptable values equal to or greater than 0.80, Root Mean square Residual (RMR) with acceptable values equal to or lower than 0.10, Root Mean Square Error of Approximation (RMSEA) with acceptable values equal to or lower than 0.08, Bentler Comparative Fit Index (CFI) with acceptable values equal to or greater than 0.90, and finally Bentler and Bonett Non-Normed Fit Index (NNFI) with acceptable values equal to or greater than 0.90.
At least three adequacy indexes with values greater than their references were considered in analyzing the goodness of fit of data to the proposed factors [
19]. To estimate factor loads, we used the maximum likelihood method with a minimum of ten observations per item that represented univariate normality of items [
20]. All analyses were done in SPSS version 16.0 (SPSS Institute, Chicago, Illinois) and AMOS for Windows. The significance level was set at 0.05.
3. Results
Of 1115 participants who completed the PSQI questionnaires, 601 (54%) were females and 511 (46%) were males. Mean±SD age of the participants was 29.93±10.22 years (range: 18-60 y). Also, almost half (48%) of the participants passed a graduate degree. The demographic characteristics of participants are presented in Table 1.
Descriptive statistics for PSQI
Table 2 presents the frequency distributions of the total scores and subscales of the PSQI by age, education, and sex. The Mean±SD PSQI total score was 7.01±3.63, and 72.40% of the total sample had a PSQI total score >5, indicating a significant abnormality in sleep quality. The participants with less education level reported worse sleep quality and usually obtained a PSQI total score >5. There was a significant difference between sex and PSQI total score (P<0.001) or PSQI >5 (P<0.001), indicating that women had worse sleep quality and usually obtained a PSQI total score>5. Age was not significantly associated with PSQI total scores or PSQI total score >5 (Table 2).
Validity
The validity of the Persian version of PSQI was evaluated by its internal consistency and factor structure. The result showed excellent I-CVI (≥0.78) and S-CVI (≥0.90) values. The Cronbach alpha coefficient was 0.65. In order to examine the validity of the PSQI, the exploratory factor analysis was determined by application of varimax rotation and 2-factor solution. The result of KMO was 0.746, and the Bartlett’s sphericity was evaluated as significant at 0.05. These two tests showed efficiency for the factor analysis in terms of structure detection on our dataset.
Two factors were extracted by factor analysis that explained 51.75% of the variance. Table 3 presents the factor loadings of each of the seven PSQI components on these two identified factors. The first factor consists of sleep quality, sleep disturbances, sleep latency, daytime dysfunction and use of sleep medication; the Cronbach alpha was obtained as 0.65. The second factor consists of habitual sleep efficiency and sleep duration and the obtained Cronbach alpha was 0.57. The correlation coefficient between the first factor and the second factor was 0.31 (P<0.001).
Reliability
The reliability coefficient (the Cronbach alpha) of the PSQI questionnaire was determined as 0.65. The Pearson correlations between component scores and the PSQI total score are presented in Table 4. The calculations showed the largest correlation coefficient for habitual sleep efficiency (r=0.90, P<0.001), and the smallest correlation coefficient for the use of sleeping medication (r=0.55, P<0.001).
Confirmatory factor analysis
Figure 1 displays the path diagram, illustrating the factor loads of the observed variables in the latent variables (sleep quality, sleep latency, sleep duration, habit
ual sleep efficiency, sleep disturbance, use of sleeping medication and daytime dysfunction), as well as the factors loading, factors covariance, and items variances.