Pramukti, Nurmala, Nadhiroh, Tung, Gan, Siaw, Yang, Griffiths, Lin, and Pakpour: Problematic Use of Internet Among Indonesia University Students: Psychometric Evaluation of Bergen Social Media Addiction Scale and Internet Gaming Disorder Scale-Short Form

Abstract

Objective

Social media addiction and internet gaming disorder may cause mental health problems among a minority of university students. The Bergen Social Media Addiction Scale (BSMAS) and the 9-item Internet Gaming Disorder Scale-Short Form (IGDS9-SF) are commonly used worldwide. However, they have not been translated or validated into Indonesian. The present study aimed to translate and validate the BSMAS and IGDS9-SF in an Indonesian context among young adults.

Methods

A multi-center, web-based cross-sectional study was conducted among 458 university students (74% female; mean age 22.5 years) in Indonesia from June to December 2021. The BSMAS and IGDS9-SF were translated into Indonesian. Internal consistency (using Cronbach’s α and McDonald’s ω) and factor structure (using confirmatory factor analysis) of the two instruments were examined. Concurrent validity of BSMAS and IGDS9-SF was examined using their correlations with two external concepts: nomophobia and psychological distress.

Results

Internal consistency of the Indonesian BSMAS and IGDS9-SF were both acceptable (Cronbach’s α=0.80 and 0.90; McDonald’s ω=0.86 and 0.92). Both instruments were unidimensional with good factor loadings (0.54–0.78 for BSMAS; 0.63–0.79 for IGDS9-SF). Moreover, BSMAS and IGDS9-SF had stronger associations with nomophobia (r=0.58 and 0.12; p<0.001) than with psychological distress (r=0.43 and 0.15; p<0.001).

Conclusion

The Indonesian versions of the BSMAS and IGDS9-SF had good psychometric properties in terms of linguistic validity, unidimensionality, and reliability. The findings indicate the tools are appropriate for assessing the risk of social media addiction and internet gaming disorder among university students in Indonesia.

INTRODUCTION

The internet is a well-known tool used for communication and providing access to information for individuals in their daily lives [1]. The internet has helped young generations to have experience of and explore global issues, such as identity and autonomy [2]. Recently, information and communication technology has expanded into various types of hardware and software including social media, smartphones, computers, and other electronic devices [2]. As a consequence, a minority of young adults are particularly vulnerable to developing internet addiction (IA) [3]. IA has been described as a prolonged, compulsive, and uncontrollable use of the internet affecting physical and mental health of users [4]. Statista [5] reported that more than five billion individuals worldwide use the internet, and nearly 205 million Indonesians (in a population of 270 million) were active internet users in 2022. IA has been found as a serious mental health issue in Asia, with relatively similar prevalence rates in South Korea (20%), China (16.4%), Philippines (21%), and Vietnam (21.2%) [6]. In Europe, and specifically among teenagers, it has been claimed that almost one in ten individuals are addicted to internet use [3,4]. IA has also been reported among Indonesian university students. In one study, 61% of 715 respondents were identified as having problem with their internet use [7]. Moreover, Indonesia has a large geographical spread with heterogenous populations. Consequently, the diverse populations in the Indonesia may differ in the prevalence of IA compared to other countries. Therefore, it is important to investigate the topic if IA among Indonesian populations.
The impact of IA has now been studied for decades, and IA is considered to be a psychological dependence on internet use with the characteristics of excessive use, tolerance, mood swings, craving, and withdrawal symptoms when quitting [8]. Such characteristics may result in poor educational and/or occupational performance and cause social withdrawal [9]. In other words, IA can have many negative impacts, such as making individuals spend more time playing online games and reducing offline social activities. There is also a lot of potentially unhealthy information on the internet, such as pornography and violence, which can negatively affect individuals’ mental health, contribute to sleep deprivation, and lower occupational/educational productivity. Furthermore, adolescents and young adults who engage in long periods of screen time may engage in less physical exercise and sports which may result in physical problems to joints, muscles, and bones [7]. Adolescence and young adulthood are characterized by a period of maturation and intense psychological changes, and are vulnerable to problematic internet use which may negatively impact on their quality of life [10]. Therefore, research examining IA is important for healthcare providers to better understand and deal with this issue [11].
Social media addiction (SMA) has been described as a subtype of IA (i.e., a specific IA as opposed to generalized IA) and has also become an important issue for research, prevention, and treatment [12]. Another type of specific IA that is much studied is online gaming addiction (also referred to by some as internet gaming disorder [IGD]) which can also cause problems in gamers’ daily live including sleep problems [13] and various health problems [14]. Early screening for IA including SMA and IGD is required to prevent individuals developing severe mental and physical health consequences. Consequently, researchers have developed various psychometric instruments to asses these disorders. Among the most widely used internationally are the Bergen Social Media Addiction Scale (BSMAS) and the 9-item Internet Gaming Disorder Scale-Short Form (IGDS9-SF) both of which have been used among various populations including young adults [15-18].
The BSMAS has been shown to be an effective tool to assess the risk of SMA among Korean young adults with a good test–retest reliability at a three-week interval (r=0.75) and very good internal consistency (Cronbach’s α=0.86) as well as showing satisfactory convergent validity [15]. It has also been shown to be a valid instrument for assessing SMA risk among Mongolian university students [16]. Examples using IGDS9-SF include a large-scale study among 2,363 Iranian adolescents, which showed that the IGDS9-SF has robust psychometric properties as evidenced in its internal consistency, construct validity, criteria-related validity, concurrent validity, and minimum floor and ceiling effects [17]. Another better example is a recently published systematic review on the psychometric properties of the IGDS9-SF showing its significant psychometric advantages [18].
Both the BSMAS and IGDS9-SF have the benefits of 1) having a theoretical underpinning that assess the underlying constructs of SMA and IGD and 2) being brief and concise (i.e., BSMAS has six items and IGDS9-SF has nine items). The BSMAS was developed by utilizing the “components model of addiction” which comprises six criteria (salience, tolerance, mood modification, relapse, withdrawal symptoms, and conflict) [19]. The IGDS9-SF, was developed using the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition criteria for IGD, which includes “preoccupation or obsession, withdrawal, tolerance, loss of control, loss of interest, continued overuse, deceiving, escape of negative feelings, and functional impairment.” [20] The brevity of both BSMAS and IGDS9-SF is a benefit in a busy clinical setting and can help minimize survey fatigue if used in data collection. Both the BSMAS and IGDS9-SF have great potential in evaluating the severity of their respective disorders.
Although the two instruments have both been translated and validated in many languages, to the best of the present authors’ knowledge, no Indonesian versions of BSMAS and IGDS9-SF have been psychometrically validated. Given that online addictions are a growing health issue among Indonesians [21], the present study translated and validated both the BSMAS and IGDS9-SF in an Indonesian context among young adults.

METHODS

Participants and data collection

Participants enrolled in the present study were all Indonesian students from two public universities, one each in the Eastern and Western part of the Java region (i.e., the Universitas Padjadjaran in West Java and the Universitas Airlangga in East Java). The students were recruited through university databases from June 1 to December 1, 2021. The invitation for participation were sent through personal email. To obtain a sufficient sample size for confirmatory factor analysis (CFA), a total of 458 participants were recruited. According to the rule of thumb in CFA, a sample size of 50 is very poor, 100 is poor, 200 is fair, 300 is good, and 500 is very good [22]. Therefore, the size of 458 participants in the present study is considered to be acceptable for the CFA. University students aged 18 years and above were eligible to be recruited. The institutional review board (IRB) approval was obtained from the Health Research Ethics Commission, Faculty of Nursing, Universitas Airlangga (registration number: 2318-KEPK) before the data collection was conducted. Participants were given informed about the study details using Google Forms. Once informed consent was obtained, the participants were asked to complete the survey. To avoid the duplication, each participant was asked to login using their personal email. In addition, the study was designed to ensure the participants could only the survey once.

Measures

Demographic data

The instruments addressed to students included a background information sheet assessing age, sex, university, grade, and study major.

BSMAS

The BSMAS [23] was used to assess SMA. It contains six items (e.g., “How often have you felt an urge to use social media more and more?”) rated on a 5-point scale ranging from 1 (very rarely) to 5 (very often). The total score ranges from 6 to 30 and a higher score indicates a greater risk of addiction to social media.

IGDS9-SF

The IGDS9-SF [24] was used to assess IGD. It contains nine items (e.g., “Do you feel preoccupied with your gaming behavior?”) rated on a 5-point scale ranging from 1 (never) to 5 (very often). The total score ranges from 9 to 45 and a higher score indicates a greater risk of IGD.

Nomophobia Questionnaire

The Nomophobia Questionnaire (NMPQ) [25] was used to assess the risk of fear of being without a mobile phone (“no mobile phobia”). It contains 20 items (e.g., “Running out of battery in my smartphone would scare me”) comprising four factors (being able to communicate, losing connectedness, not being able to access information, and giving up convenience). Items are rated on a 7-point scale ranging from 1 (strongly disagree) to 7 (strongly agree). The total score ranges from 20 to 140 and a higher score indicates greater nomophobia. The internal consistency of this scale showed a very good reliability (Cronbach’s α=0.92; McDonald’s ω=0.94).

Depression, Anxiety, Stress Scale

The Depression, Anxiety, Stress Scale (DASS-21) [26] was used to assess the level of psychological distress, including depression, anxiety, and stress. It contains 21 items (e.g., “I found it hard to wind down”) rated on a 4-point scale ranging from 0 (did not apply to me at all) to 3 (applied to me very much, or most of the time). The total score of the entire DASS-21 ranges from 0 to 63 for each subscale and higher scores indicate greater depression, anxiety, or stress. The internal consistency of this scale showed a very good reliability (Cronbach’s α=0.94; McDonald’s ω=0.93).

Translation procedure for BSMAS and IGDS9-SF

The translation procedure in the present study followed the existing guidelines and recommendation for health and medicine cross-cultural research [27].

Step 1: recruit translation team

The first step was the recruitment of a translation team. The team comprised four translators divided into mixed-pairs based on their expertise and educational background. The first pair (translation Team A), consisted of two translators (A1 and A2) from the East Java province. Translator A1 understood issues related to SMA and internet gaming addiction, and translator A2 was an expert in English translation. The second pair (translation Team B), also consisted of two translators (B1 and B2) from the West Java province. Translator B1 understood the related issues of SMA and internet gaming addiction, and translator B2 was also an expert in English translation.

Step 2: forward translation

In this stage, only Team A was involved. Each translator from the translation Team A, namely translator A1 (who understood the issue) and translator A2 (English expert) translated the two scales in the original English version, namely the original document (Document 0), into the Indonesian version. After one week, the translated documents from translator A1 (Document 1) and from translator A2 (Document 2) were completed. After that, a committee was used to evaluate the differences and an agreement was reached to produce a combined document (Document 3).

Step 3: back-translation

The back-translation was performed by Team B consisting of translator B1 and translator B2. The team translated the document back into English independently. One document was produced by translator B1 (Document 4), and another document produced by translator B2 (Document 5). The two translators were not given access to the original scale at this stage. Next, a comparison was made between the two documents (4 and 5) to identify differences and the evaluation to be carried out.

Step 4: committee consolidation

At this stage, a committee consisting of researchers and the entire translation team came together to examine similarities and differences between instrument sources and back-translation documents. The documents examined were Document 0 (English version), Documents 1, 2, and 3 (forward translations), and Documents 4 and 5 (back-translations). To overcome the differences in the back-translation stage, the researchers and all translators agreed to accept the translation and retained it according to the original concept of the scale. As a result, a consolidated document was produced which was used for the psychometric testing.

Step 5: pilot test and confirming Indonesian BSMAS and IGDS9-SF

Trials were carried out to correct errors in the scales and ensure that the final translations had maintained equivalence before the researchers deployed the instruments in the field. In the present study, trials were conducted with 33 students who were willing to be participants from selected universities in Indonesia on July 14, 2021, and which were distributed online using Google Forms. After distributing the scales online, the validity and reliability of the translated BSMAS and IGDS9-SF was tested using R software (version 4.2.1; R Core Team, Vienna, Austria). The internal consistencies of the Indonesian BSMAS and IGDS9-SF were acceptable, which means the scales are reliable. The scales were then sent out for formal psychometric testing.

Statistical analysis

Aside from using descriptive statistics to understand the instruments and participants’ characteristics, the present study examined the psychometric properties of the two scales (BSMAS and IGDS9-SF). More specifically, internal consistency, construct validity, and concurrent validity were examined for the two scales. Cronbach’s α and McDonald’s ω were used to examine the internal consistency reliability of the two instruments, with a recommended cutoff for good internal consistency is that both Cronbach’s α and McDonald’s ω should exceed 0.7 [28]. CFA with a diagonally weighted least squares estimator was used to examine the construct validity of the two instruments. Prior research indicated that both instruments had a unidimensional factor structure [17,18,29-31]. Therefore, two CFAs were used to examine whether the unidimensionality was supported for each scale. Fit indices were then adopted to evaluate whether the unidimensionality was supported: a nonsignificant χ2 test, a comparative fit index (CFI) >0.9, a Tucker-Lewis index (TLI) >0.9, a root mean square error of approximation (RMSEA) <0.08, and a standardized root mean square residual (SRMR) <0.08 [32,33]. Additionally, the CFA factor loadings were used to examine whether the item is needed in each instrument, and a loading higher than 0.4 indicates necessary inclusion [34]. Structural equation modeling with a diagonally weighted least squares estimator was used to examine the concurrent validity of the two instruments. More specifically, each of the two instruments was proposed to be regressed on both nomophobia (assessed using NMPQ) and psychological distress (assessed using DASS-21). It was hypothesized that the NMPQ would have stronger associations with the two instruments than the DASS-21 given that the NMPQ assesses more internet-related psychological distress (i.e., being afraid of having no access to internet) than the DASS-21. However, given that prior evidence and theory (e.g., Interaction of Person-Affect-Cognition-Execution model) [35-39] supports the associations between problematic use of internet and psychological distress, it was hypothesized to be associated with both SMA and IGD. R software workplace, psych package [40] and lavaan package [41] were used to test all the statistical analyses.

RESULTS

The sample was relatively young (mean [M] age=22.46 years; standard deviation [SD]=8.07) with nearly three-quarters being female participants (n=339; 74.0%). Slightly over half of the participants were majoring in health-related academic programs (n=251; 54.8%) and the majority of the participants were undergraduate students (n=376; 82.1%). On average, their daily social media use was 5.19 hours (SD=4.15), and daily gaming use was 0.87 hours (SD=1.42). Moreover, 456 participants were social media users and 211 were gamers. They showed relatively high levels of nomophobia (M=91.69 [out of 140]; SD=20.41) and low levels of psychological distress (M=18.90; SD=10.35) (Table 1).
Table 2 reports the item and total scores of the BSMAS and IGDS9-SF. The two instruments demonstrated relatively normal distributions as indicated by the skewness (range between -0.33 and 0.56 for BSMAS and between 0.42 and 2.26 for IGDS9-SF) and kurtosis (range between -0.84 and 0.02 for BSMAS and between -0.91 and 4.94 for IGDS9-SF). In addition, the two instruments had good internal consistency shown by both Cronbach’s α (0.80 for BSMAS and 0.90 for IGDS9-SF) and McDonald’s ω (0.86 for BSMAS and 0.92 for IGDS9-SF).
The unidimensional factor structure of the both two instruments was supported by the CFA results in terms of the good factor loadings (range between 0.54 and 0.78 for BSMAS and between 0.63 and 0.79 for IGDS9-SF) and satisfactory fit indices (p-values of χ2 were both nonsignificant; CFI=1.000 for both BSMAS and IGDS9-SF; TLI=1.003 for BSMAS and 1.004 for IGDS9-SF; RMSEA=0.000 for both BSMAS and IGDS9-SF; and SRMR=0.031 for BSMAS and 0.050 for IGDS9-SF) (Table 3).
The concurrent validity of the two instruments was supported by the significant correlations with both nomophobia and psychological distress (Figure 1). The structural equation modeling showed that problematic social media use (assessed using BSMAS) and IGD (assessed using the IGDS9-SF) had stronger associations than with nomophobia (r=0.58 and 0.12; p<0.001) than with psychological distress (r=0.43 and 0.15; p<0.001). Although problematic gaming was significantly associated with both nomophobia and psychological distress, the magnitudes of the associations were somewhat weak (r=0.12 and 0.15; p<0.001).

DISCUSSION

Assessing the risk of SMA and IGD is important for healthcare providers to prevent at-risk individuals from further complication due to mental health issues caused by online addictions. Appropriate instruments with a local language (e.g., Bahasa Indonesian in the present study) are needed to help researchers and healthcare providers to assess health information appropriately.
In the present study, instrument translations of the BSMAS and IGDS9-SF were carried out using local cross-culture translational and validation procedures. The present study is the first to be conducted in Indonesia related to the translation and validation of these two widely used psychometric scales. The participants were recruited from two public universities representing students in the Eastern and Western parts of Indonesia. A systematic translation method was applied during the translation process from English to Indonesian language and adapted to Indonesian culture [27]. This process required translators who were knowledgeable in SMA and IGD as well as the two languages. The translation method used here has been used to translate other similar psychometric scales such as Smartphone Application-Based Addiction Scale and has been shown to be a valid and reliable instrument for young adults in Indonesia [21].
A standardized cross-cultural approach [42] was used during the linguistic validity of the Indonesian BSMAS and IGDS9-SF. The psychometric testing of the BSMAS demonstrated acceptable internal consistency values (Cronbach’s α=0.80 and McDonald’s ω=0.86). This is in line with an earlier study where each of the six BSMAS items significantly correlated with all other items in the scale (Cronbach’s α=0.88) [23]. In the present study, SMA was significantly associated with both nomophobia and psychological distress. This is in line with a study in Türkiye showing that SMA was associated with nomophobia among college students [43]. The present study also in line with an earlier large population-based cohort study conducted among 15,398 Canadian university students showing that SMA was associated with psychological distress [44]. Furthermore, the present study demonstrated that BSMAS had a unidimensional structure which in line with other language versions including English used in Malaysia [45], Italian [46], Persian [47], Hungarian [48], Chinese [31], Romanian [49], and American English [50]. Therefore, the BSMAS appears to be valid in assessing a single latent construct (i.e., addiction to social media) among university students from many different countries.
The IGDS9-SF demonstrated excellent internal consistency values (Cronbach’s α=0.90 and McDonalds’ ω=0.92). This is in line with a recent systematic review, which reported that all psychometric testing papers on IGDS9-SF report excellent internal consistency [18]. Moreover, a recent study among Malaysian students that was not included in the systematic review also showed excellent internal consistency of the IGDS9-SF (Cronbach’s α=0.95 and McDonald’s ω=0.96) [45]. In the present study, IGD was significantly associated with both nomophobia and psychological distress (although much weaker than SMA). This finding is also in line with a study among 300 Chinese university students in Hong Kong showing that higher IGD scores were associated with greater psychological distress [51]. Moreover, because many online games are played via smartphone, this may explain the association between IGD and nomophobia. That is, individuals having higher levels of IGD may worry about not having their smartphone to play online videogames.
Earlier studies have also found that SMA is associated with depression, anxiety, and stress [31,45,52-54]. Furthermore, both IGDS9-SF and BSMAS were associated with nomophobia and psychological distress. The correlation between IGD and psychological distress indicated the potential problematic consequences of online gaming on mental health among university students. This is in line with the study conducted Italian young adults showing IGD may facilitate the development of mental health distress [55].
The present study has three key strengths. First, the translation procedure was conducted using a robust and standardized method that ensured the robustness of the linguistic validity. Second, advanced statistical analysis (i.e., CFA) was used in the present study to understand the factor structures for both BSMAS and IGDS9-SF. Third, relevant instruments (i.e., DASS-21, NMPQ) assessing concepts associated with online addictions (i.e., nomophobia and psychological distress) were used to examine the concurrent validity for both BSMAS and IGDS9-SF.

Limitations

There were several limitations in the present study. First, the convenience sampling technique used in the present study means the sample was not representative of all Indonesian university students. Moreover, due to convenience sampling, sampling bias was not controlled for because the sample was predominantly female with relatively small sample of gamers. Further study recruiting participants with heterogeneity across different features with sufficient sample size among the students is needed. More specifically, a large-scale study recruiting university students from different universities in Indonesia would be helpful in improving the external validity and resolving the problems of small sample sizes in males and gamers in the present study. Second, data for the present study were collected from university students from two regions of Indonesia (i.e., Eastern and Western Java). Considering the widespread nature of the Indonesia’s geography (comprising over 17,000 islands), the present sample was not representative of the entire Indonesian population. Therefore, the generalizability of the present findings is restricted to specific regions and cohorts of the Indonesia. Third, all the instruments used in the present study (i.e., BSMAS, IGDS9-SF, NMPQ, and DASS-21) were self-report, and there is possibility that the responses may be biased due to social desirability. In addition, the self-report nature of the scales may result in single rater bias. Fourth, the present study did not examine the test–retest reliability of the Indonesian versions of the BSMAS and IGDS9-SF. Therefore, additional psychometric evidence is needed to ensure that Indonesian versions of the BSMAS and IGDS9-SF have good reproducibility.

Conclusion

Psychometric testing in the present study supported the linguistic validity, unidimensionality, and reliability for both Indonesian version of BSMAS and IGDS9-SF. However, additional different psychometric testing methods (e.g., Rasch analysis to get more in-depth information for each item; network analysis to visualize the relationships between the BSMAS/IGDS9-SF items) are needed to strengthen the validity and reliability of the Indonesian versions of the BSMAS and IGDS9-SF. Overall, the results showed that the Indonesian version of BSMAS and IGDS9-SF are valid and reliable. Therefore, these two scales can be confidently used for assessing the risk of SMA and IGD among university students in Indonesia.

Notes

Availability of Data and Material

The datasets generated or analyzed during the study are not publicly available due to the privacy concerns raised by the Health Research Ethics Commission, Faculty of Nursing, Universitas Airlangga but are available from the corresponding authors on reasonable request.

Conflicts of Interest

The authors have no potential conflicts of interest to disclose.

Author Contributions

Conceptualization: Iqbal Pramukti, Ira Nurmala, Yung-Ning Yang, Chung-Ying Lin. Data curation: Iqbal Pramukti, Ira Nurmala, Siti R. Nadhiroh. Formal analysis: Chung-Ying Lin. Funding acquisition: Iqbal Pramukti, Ira Nurmala, Siti R. Nadhiroh, Serene En Hui Tung, Wan Ying Gan, Chung-Ying Lin. Investigation: Iqbal Pramukti, Ira Nurmala, Siti R. Nadhiroh, Yung-Ning Yang, Chung-Ying Lin. Methodology: Siti R. Nadhiroh, Serene En Hui Tung, Wan Ying Gan, Yan-Li Siaw, Yung-Ning Yang, Mark D. Griffiths, Chung-Ying Lin, Amir H. Pakpour. Project administration: Chung-Ying Lin. Resources: Iqbal Pramukti, Ira Nurmala, Siti R. Nadhiroh, Yung-Ning Yang, Chung-Ying Lin. Software: Chung-Ying Lin. Supervision: Mark D. Griffiths, Chung-Ying Lin, Amir H. Pakpour. Validation: Mark D. Griffiths, Chung-Ying Lin, Amir H. Pakpour. Visualization: Chung-Ying Lin. Writing—original draft: Iqbal Pramukti, Ira Nurmala, Chung-Ying Lin. Writing—review & editing: Siti R. Nadhiroh, Serene En Hui Tung, Wan Ying Gan, Yan-Li Siaw, Yung-Ning Yang, Mark D. Griffiths, Chung-Ying Lin, Amir H. Pakpour.

Funding Statement

This project was funded by the National Science and Technology Council, Taiwan (NSTC 112-2410-H-006-089-SS2), the Higher Education Sprout Project, Ministry of Education to the Headquarters of University Advancement at National Cheng Kung University (NCKU).

Figure 1.
Concurrent validity of the two instruments with nomophobia and psychological distress via structural equation modeling; for Bergen Social Media Addiction Scale (A); for Internet Gaming Disorder Scale-Short Form (B). *p<0.001. CFI, comparative fit index; TLI, Tucker-Lewis index; RMSEA, root mean square error of approximation; SRMR, standardized root mean square residual.
pi-2022-0304f1.tif
Table 1.
Characteristics of the participants
Characteristic Value (N=458)
Age (yr) 22.46±8.07
Sex
 Male 119 (26.0)
 Female 339 (74.0)
Study major
 Health-related 251 (54.8)
 Non-health-related 207 (45.2)
Study program
 Undergraduate 376 (82.1)
 Postgraduate 82 (17.9)
Marital status
 Single 387 (84.6)
 Married 68 (14.8)
 Other 3 (0.6)
Daily hours on social media (h) 5.19±4.15
Daily hours on gaming (h) 0.87±1.42
NMPQ total score* 91.69±20.41
DASS-21 total score* 18.90±10.35

Values are presented as mean±standard deviation or number (%).

* NMPQ score range between 20 and 140 (Cronbach’s α=0.92; Mc-Donald’s ω=0.94), DASS-21 score range between 0 and 63 (Cronbach’s α=0.94; McDonald’s ω=0.93).

NMPQ, Nomophobia Questionnaire; DASS-21, Depression, Anxiety, Stress Scale

Table 2.
Score distributions and internal consistency for the internet-related instruments
Mean (SD) Skewness Kurtosis α* ω
BSMAS 16.68 (4.50) 0.08 0.02 0.80 0.86
 Item B1 3.04 (0.99) -0.13 -0.56
 Item B2 3.31 (1.02) -0.33 -0.34
 Item B3 3.02 (1.23) -0.11 -0.84
 Item B4 2.78 (1.00) 0.11 -0.42
 Item B5 2.26 (1.06) 0.49 -0.46
 Item B6 2.27 (1.06) 0.56 -0.26
IGDS9-SF 14.07 (5.49) 1.32 2.01 0.90 0.92
 Item I1 1.62 (0.88) 1.42 1.64
 Item I2 1.49 (0.76) 1.67 2.87
 Item I3 1.65 (0.88) 1.22 0.70
 Item I4 1.52 (0.82) 1.66 2.44
 Item I5 1.48 (0.80) 1.81 3.20
 Item I6 1.36 (0.67) 2.00 4.04
 Item I7 1.34 (0.67) 2.17 5.13
 Item I8 2.25 (1.18) 0.42 -0.91
 Item I9 1.36 (0.73) 2.26 4.94

* Cronbach’s α;

McDonald’s ω.

SD, standard deviation; BSMAS, Bergen Social Media Addiction Scale; IGDS9-SF, 9-item Internet Gaming Disorder Scale-Short Form

Table 3.
Psychometric results derived from confirmatory factor analysis on the BSMAS and IGDS9-SF
BSMAS IGDS9-SF
Factor loading
 Item 1 0.64 0.65
 Item 2 0.78 0.72
 Item 3 0.54 0.79
 Item 4 0.67 0.75
 Item 5 0.59 0.71
 Item 6 0.59 0.74
 Item 7 -- 0.64
 Item 8 -- 0.63
 Item 9 -- 0.67
Fit indices
 χ2 (df) 7.26 (9) 21.41 (27)
 p 0.61 0.77
 CFI 1.000 1.000
 TLI 1.003 1.004
 RMSEA 0.000 0.000
 95% CI of RMSEA 0.000, 0.045 0.000, 0.026
 SRMR 0.031 0.050

BSMAS, Bergen Social Media Addiction Scale; IGDS9-SF, 9-item Internet Gaming Disorder Scale-Short Form; CFI, comparative fit index; TLI, Tucker-Lewis index; RMSEA, root mean square error of approximation; CI, confidence interval; SRMR, standardized root mean square residual

REFERENCES

1. Kakul F, Javed S. Internet gaming disorder: an interplay of cognitive psychopathology. Asian J Soc Health Behav 2023;6:36–45.
crossref
2. Ruckwongpatr K, Chirawat P, Ghavifekr S, Gan WY, Tung SE, Nurmala I, et al. Problematic internet use (PIU) in youth: a brief literature review of selected topics. Curr Opin Behav Sci 2022;46:101150
crossref
3. Lozano-Blasco R, Robres AQ, Sánchez AS. Internet addiction in young adults: a meta-analysis and systematic review. Comput Hum Behav 2022;130:107201
crossref
4. Pontes HM, Macur M, Griffiths MD. Internet gaming disorder among Slovenian primary schoolchildren: findings from a nationally representative sample of adolescents. J Behav Addict 2016;5:304–310.
crossref pmid pmc
5. Statista. Number of internet and social media users worldwide as of May 2023 [Internet]. Available at: https://www.statista.com/statistics/617136/digital-population-worldwide/. Accessed May 13, 2022.

6. Li YY, Sun Y, Meng SQ, Bao YP, Cheng JL, Chang XW, et al. Internet addiction increases in the general population during COVID-19: evidence from China. Am J Addict 2021;30:389–397.
crossref pmid pmc
7. Pratama GB, Widyanti A. Internet addiction among Indonesia university students: musculoskeletal symptoms, physical and psychosocial behavior problems. IOP Conf Ser Mater Sci Eng 2019;528:012015
crossref
8. Griffiths M. Does internet and computer “addiction” exist? Some case study evidence. Cyberpsychol Behav 2000;3:211–218.
crossref
9. Procházka R, Suchá J, Dostál D, Dominik T, Dolejš M, Šmahaj J, et al. Internet addiction among Czech adolescents. Psych J 2021;10:679–687.
crossref pmid
10. Marin MG, Nuñez X, de Almeida RMM. Internet addiction and attention in adolescents: a systematic review. Cyberpsychol Behav Soc Netw 2021;24:237–249.
crossref pmid
11. Cash H, Rae CD, Steel AH, Winkler A. Internet addiction: a brief summary of research and practice. Curr Psychiatry Rev 2012;8:292–298.
crossref pmid pmc
12. Huang PC, Chen JS, Potenza MN, Griffiths MD, Pakpour AH, Chen JK, et al. Temporal associations between physical activity and three types of problematic use of the internet: a six-month longitudinal study. J Behav Addict 2022;11:1055–1067.
crossref pmid pmc
13. Alimoradi Z, Lin CY, Broström A, Bülow PH, Bajalan Z, Griffiths MD, et al. Internet addiction and sleep problems: a systematic review and meta-analysis. Sleep Med Rev 2019;47:51–61.
crossref pmid
14. Purwaningsih E, Nurmala I. The impact of online game addiction on adolescent mental health: a systematic review and meta-analysis. Open Access Maced J Med Sci 2021;9:260–274.
crossref
15. Shin NY. Psychometric properties of the Bergen social media addiction scale in Korean young adults. Psychiatry Investig 2022;19:356–361.
crossref pmid pmc
16. Yue H, Zhang X, Cheng X, Liu B, Bao H. Measurement invariance of the Bergen social media addiction scale across genders. Front Psychol 2022;13:879259
crossref pmid pmc
17. Wu TY, Lin CY, Årestedt K, Griffiths MD, Broström A, Pakpour AH. Psychometric validation of the Persian nine-item internet gaming disorder scale - short form: does gender and hours spent online gaming affect the interpretations of item descriptions? J Behav Addict 2017;6:256–263.
crossref pmid pmc
18. Poon LYJ, Tsang HWH, Chan TYJ, Man SWT, Ng LY, Wong YLE, et al. Psychometric properties of the internet gaming disorder scale-short-form (IGDS9-SF): systematic review. J Med Internet Res 2021;23:e26821
crossref pmid pmc
19. Griffiths M. A ‘components’ model of addiction within a biopsychosocial framework. J Subst Use 2005;10:191–197.
crossref
20. Vahia VN. Diagnostic and statistical manual of mental disorders 5: a quick glance. Indian J Psychiatry 2013;55:220–223.
crossref pmid pmc
21. Nurmala I, Nadhiroh SR, Pramukti I, Tyas LW, Zari AP, Griffiths MD, et al. Reliability and validity study of the Indonesian smartphone application-based addiction scale (SABAS) among college students. Heliyon 2022;8:e10403
crossref pmid pmc
22. Comrey AL, Lee HB. A first course in factor analysis (2nd ed). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc; 1992.

23. Schou Andreassen C, Billieux J, Griffiths MD, Kuss DJ, Demetrovics Z, Mazzoni E, et al. The relationship between addictive use of social media and video games and symptoms of psychiatric disorders: a large-scale cross-sectional study. Psychol Addict Behav 2016;30:252–262.
crossref pmid
24. Pontes HM, Griffiths MD. Measuring DSM-5 internet gaming disorder: development and validation of a short psychometric scale. Comput Hum Behav 2015;45:137–143.
crossref
25. Lin CY, Griffiths MD, Pakpour AH. Psychometric evaluation of Persian nomophobia questionnaire: differential item functioning and measurement invariance across gender. J Behav Addict 2018;7:100–108.
crossref pmid pmc
26. Lovibond PF, Lovibond SH. The structure of negative emotional states: comparison of the depression anxiety stress scales (DASS) with the Beck depression and anxiety inventories. Behav Res Ther 1995;33:335–343.
crossref pmid
27. Cheung H, Mazerolle L, Possingham HP, Tam KP, Biggs D. A methodological guide for translating study instruments in cross-cultural research: adapting the ‘connectedness to nature’ scale into Chinese. Methods Ecol Evol 2020;11:1379–1387.
crossref
28. Nunnally JC. Psychometric theory (2nd ed). New York: McGraw-Hill; 1978.

29. Yam CW, Pakpour AH, Griffiths MD, Yau WY, Lo CM, Ng JMT, et al. Psychometric testing of three Chinese online-related addictive behavior instruments among Hong Kong university students. Psychiatr Q 2019;90:117–128.
crossref pmid
30. Leung H, Pakpour AH, Strong C, Lin YC, Tsai MC, Griffiths MD, et al. Measurement invariance across young adults from Hong Kong and Taiwan among three internet-related addiction scales: Bergen social media addiction scale (BSMAS), smartphone application-based addiction scale (SABAS), and internet gaming disorder scale-short form (IGDS-SF9) (study part A). Addict Behav 2020;101:105969
crossref pmid
31. Chen IH, Strong C, Lin YC, Tsai MC, Leung H, Lin CY, et al. Time invariance of three ultra-brief internet-related instruments: smartphone application-based addiction scale (SABAS), Bergen social media addiction scale (BSMAS), and the nine-item internet gaming disorder scale- short form (IGDS-SF9) (study part B). Addict Behav 2020;101:105960
crossref pmid
32. Nejati B, Fan CW, Boone WJ, Griffiths MD, Lin CY, Pakpour AH. Validating the Persian intuitive eating scale-2 among breast cancer survivors who are overweight/obese. Eval Health Prof 2021;44:385–394.
crossref pmid
33. Lin CY, Broström A, Griffiths MD, Pakpour AH. Psychometric evaluation of the Persian eHealth literacy scale (eHEALS) among elder Iranians with heart failure. Eval Health Prof 2020;43:222–229.
crossref pmid
34. Chen X, Hu W, Hu Y, Xia X, Li X. Discrimination and structural validity evaluation of Zung self-rating depression scale for pregnant women in China. J Psychosom Obstet Gynaecol 2022;43:26–34.
crossref pmid
35. Brand M, Young KS, Laier C, Wölfling K, Potenza MN. Integrating psychological and neurobiological considerations regarding the development and maintenance of specific internet-use disorders: an interaction of person-affect-cognition-execution (I-PACE) model. Neurosci Biobehav Rev 2016;71:252–266.
crossref pmid
36. Chen IH, Chen CY, Liu CH, Ahorsu DK, Griffiths MD, Chen YP, et al. Internet addiction and psychological distress among Chinese schoolchildren before and during the COVID-19 outbreak: a latent class analysis. J Behav Addict 2021;10:731–746.
crossref pmid pmc
37. Chen IH, Chen CY, Pakpour AH, Griffiths MD, Lin CY, Li XD, et al. Problematic internet-related behaviors mediate the associations between levels of internet engagement and distress among schoolchildren during COVID-19 lockdown: a longitudinal structural equation modeling study. J Behav Addict 2021;10:135–148.
crossref pmid pmc
38. Chang YH, Chang KC, Hou WL, Lin CY, Griffiths MD. Internet gaming as a coping method among schizophrenic patients facing psychological distress. J Behav Addict 2020;9:1022–1031.
crossref pmid pmc
39. Chen IH, Pakpour AH, Leung H, Potenza MN, Su JA, Lin CY, et al. Comparing generalized and specific problematic smartphone/internet use: longitudinal relationships between smartphone application-based addiction and social media addiction and psychological distress. J Behav Addict 2020;9:410–419.
crossref pmid pmc
40. Revelle W. Psych: procedures for psychological, psychometric, and personality research [Internet]. Available at: https://CRAN.R-project.org/package=psych. Accessed May 13, 2022.

41. Rosseel Y. lavaan: an R package for structural equation modeling. J Stat Softw 2012;48:1–36.

42. Nadhiroh SR, Nurmala I, Pramukti I, Tivany ST, Tyas LW, Zari AP, et al. Weight stigma in Indonesian young adults: validating the indonesian versions of the weight self-stigma questionnaire and perceived weight stigma scale. Asian J Soc Health Behav 2022;5:169–179.
crossref
43. Ayar D, Özalp Gerçeker G, Özdemir EZ, Bektaş M. The effect of problematic internet use, social appearance anxiety, and social media use on nursing students’ nomophobia levels. Comput Inform Nurs 2018;36:589–595.
crossref pmid
44. Cook S, Hamilton HA, Montazer S, Sloan L, Wickens CM, Cheung A, et al. Increases in serious psychological distress among Ontario students between 2013 and 2017: assessing the impact of time spent on social media. Can J Psychiatry 2021;66:747–756.
crossref pmid pmc
45. Tung SEH, Gan WY, Chen JS, Ruckwongpatr K, Pramukti I, Nadhiroh SR, et al. Internet-related instruments (Bergen social media addiction scale, smartphone application-based addiction scale, internet gaming disorder scale-short form, and nomophobia questionnaire) and their associations with distress among Malaysian university students. Healthcare (Basel) 2022;10:1448
crossref pmid pmc
46. Monacis L, de Palo V, Griffiths MD, Sinatra M. Social networking addiction, attachment style, and validation of the Italian version of the Bergen social media addiction scale. J Behav Addict 2017;6:178–186.
crossref pmid pmc
47. Lin CY, Broström A, Nilsen P, Griffiths MD, Pakpour AH. Psychometric validation of the Persian Bergen social media addiction scale using classic test theory and Rasch models. J Behav Addict 2017;6:620–629.
crossref pmid pmc
48. Bányai F, Zsila Á, Király O, Maraz A, Elekes Z, Griffiths MD, et al. Problematic social media use: results from a large-scale nationally representative adolescent sample. PLoS One 2017;12:e0169839
crossref pmid pmc
49. Stănculescu E. The Bergen social media addiction scale validity in a Romanian sample using item response theory and network analysis. Int J Ment Health Addict 2022 Jan 15 [Epub]. https://doi.org/10.1007/s11469-021-00732-7.
crossref
50. Watson JC, Prosek EA, Giordano AL. Investigating psychometric properties of social media addiction measures among adolescents. J Couns Dev 2020;98:458–466.
crossref
51. Wong HY, Mo HY, Potenza MN, Chan MNM, Lau WM, Chui TK, et al. Relationships between severity of internet gaming disorder, severity of problematic social media use, sleep quality and psychological distress. Int J Environ Res Public Health 2020;17:1879
crossref pmid pmc
52. Hussain Z, Griffiths MD. Problematic social networking site use and comorbid psychiatric disorders: a systematic review of recent large-scale studies. Front Psychiatry 2018;9:686
crossref pmid pmc
53. Stavropoulos V, Vassallo J, Burleigh TL, Gomez R, Colder Carras M. The role of internet gaming in the association between anxiety and depression: a preliminary cross-sectional study. Asia Pac Psychiatry 2022;14:e12474
crossref pmid
54. Lee ZH, Chen IH. The association between problematic internet use, psychological distress, and sleep problems during COVID-19. Sleep Epidemiol 2021;1:100005
crossref pmid pmc
55. De Pasquale C, Sciacca F, Martinelli V, Chiappedi M, Dinaro C, Hichy Z. Relationship of internet gaming disorder with psychopathology and social adaptation in Italian young adults. Int J Environ Res Public Health 2020;17:8201
crossref pmid pmc