Visuo-Haptic-Based Multimodal Feedback Virtual Reality Solution to Improve Anxiety Symptoms: A Proof-of-Concept Study
Article information
Abstract
With proper guidance, virtual reality (VR) can provide psychiatric therapeutic strategies within a simulated environment. The visuo-haptic-based multimodal feedback VR solution has been developed to improve anxiety symptoms through immersive experience and feedback. A proof-of-concept study was performed to investigate this VR solution. Nine subjects recently diagnosed with panic disorder were recruited, and seven of them eventually completed the trial. Two VR sessions were provided to each subject. Depression, anxiety, and VR sickness were evaluated before and after each session. Although there was no significant effect of the VR sessions on psychiatric symptoms, we could observe a trend of improvement in depression, anxiety, and VR sickness. The VR solution was effective in relieving subjective anxiety, especially in panic disorder without comorbidity. VR sickness decreased over time. This study is a new proof-of-concept trial to evaluate the therapeutic effect of VR solutions on anxiety symptoms using visuo-haptic-based multimodal feedback simultaneously.
INTRODUCTION
Virtual reality (VR) can offer an interactive and immersive experience within an environment simulated by a computer, and create a computer-generated virtual situation which can be used for psychological treatment and psychoeducation [1,2]. The sense of presence or “being there” in VR is important for the stimulation of multiple senses and the active exploration of the virtual environment, and it can be facilitated through the use of technology such as head-mounted displays, synthesized sounds, and vibrotactile platforms [3]. A participant can be engaged with the VR environment in a more naturalistic and intuitive way [4,5].
Anxiety disorder is one of the common mental health problems [6]. Cognitive behavioral therapy (CBT), and specifically exposure therapy, is an effective treatment of anxiety disorders [7-9]. VR-based techniques can be applied to exposure therapy, as the sense of presence experienced in VR provides the opportunity to immerse the patient in the feared environment, tailored to match specific aspects of his or her fear structures, thereby activating those structures and allowing them to be modified [10]. Exposure therapy typically involves a patient repeatedly confronting the feared stimulus in a graded way, either in imagination or in vivo [11]. Although in vivo therapy can be expensive and impractical to conduct, VR allows the possibility of constructing inexpensive approaches and exposures that might be difficult to perform in vivo [10].
VR technology could thus offer an alternative way of performing exposure treatment [11]. CBT using VR exposure therapy has been shown to be effective in the treatment of anxiety disorders [12]. It allows the patient to be exposed to anxiety-generating stimuli and confront a feared experience in a safe and controlled way [13-15]. A situation simulated by VR, physically impossible to recreate in real life, can be therapeutically helpful, provided it is administered with proper guidance. It can be repeated many times, is available without time limits, and allows powerful adjustments of the treatment input. Various studies have applied VR in various ways: Not all have succeeded, but the consensus about the usefulness of VR-based therapy is increasing [16]. The feedback of physiological changes due to anxiety and psychological interventions through VR could constitute an immersive therapeutic method. VR could also be used to make relaxation easier in stressed or anxious patients, by visually presenting key relaxing images [17,18].
VR systems can merge visual, auditory and tactile perceptions of both virtual and real objects. The experiential effects can be maximized by simultaneously applying various types of visual, auditory, and tactile perceptions. In addition, using these techniques, it is possible to increase the possibility of achieving therapeutic effect through interactions within the VR environment, by measuring the user’s physiological changes and giving appropriate feedback in real time. This can be called a ‘visuo-haptic based multimodal feedback VR solution’ [19]. The aim of this pilot study was to develop a visuohaptic-based multimodal feedback VR solution and investigate, in a proof-of-concept study, the effectiveness of the system, especially on anxiety symptoms.
METHODS
Subjects
Subjects were recruited from the Psychiatry Clinic of the Korea University Hospital according to the following inclusion criteria: 1) recent diagnosis (within 6 months) of panic disorder according to the Mini-International Neuropsychiatric Interview [20]; 2) older than 19 years of age; 3) no evidence of organic mental disorders, intellectual disability, schizophrenia spectrum disorders, or substance use disorders; 4) no seizure or vestibular abnormalities. Among the nine subjects selected for the study, two dropped out due to personal reasons, and seven completed the study. The subjects signed a written informed consent. The study was approved by the Institutional Review Board of Korea University Hospital (2017 AN0126).
Study protocol of a visuo-haptic-based multimodal feedback VR solution
The visuo-haptic-based multimodal feedback VR solution system [19] consists of a computer to drive VR contents, an Oculus CV1 head-mounted display (Facebook Inc., Menlo Park, CA, USA), Leap Motion hand/finger tracking (Leap Motion Inc., San Francisco, CA, USA), a PSL-iECG2 heart rate monitor (Physiolab Co., Busan, South Korea), and a Falcon device for haptic feedback (Novint Technologies Inc., Albuquerque, NM, USA). The content was developed using Unity 3D (Unity Technologies, San Francisco, CA, USA).
The protocol was based on two VR sessions, one session per week. This VR solution consists of 1) an introductory part, to select one out of two scenarios: one shows a virtual party, while the other is set in an elevator; 2) a scenario part to mildly increase anxiety; 3) an intervention part with real-time heartbeat visuo-haptic feedback, with a breathing guide provided by narration, where the subjects can visually see their own heart beating and feel it through the haptic machine which synchronizes in real time with the subjects’ heart rate (https://youtu.be/0A2JLYjeEmw) [20]. Subjects were instructed to experience both VR scenarios.
Psychiatric assessment
The following psychometric questionnaires were administered at baseline and immediately after each VR session: Montgomery–Åsberg Depression Rating Scale, Korean version [21], for measuring depressive mood; Hamilton Anxiety Rating Scale [22], Beck Anxiety Inventory (BAI) [23], and State-Trait Anxiety Inventory [24] for measuring objective or subjective anxiety; Simulator Sickness Questionnaire (SSQ) [25] for measuring the subjective discomfort caused by the VR experience. In addition, the subjects stated whether they had prior experience in VR.
Physiological measurement
Real-time heart rate was measured by a sensor in both forearms during the whole VR experience. Unfortunately, we found out that the heart rate log data of four subjects were not recorded properly, due to system errors.
Statistical analysis
The Wilcoxon signed-rank test, a non-parametric statistical test, was used to investigate the effect of VR sessions, by comparing psychiatric assessment scores between, before and after the VR sessions. Using repeated measures analysis of variance (ANOVA) on psychiatric assessments after VR sessions, the effect of the VR solutions was analyzed across groups and sessions. For the statistical analysis the subjects were classified by gender, comorbid psychiatric disease, and previous VR experience. All statistical tests were performed using SPSS, version 16 (SPSS Inc., Chicago, IL, USA).
RESULTS
The basic information and the raw data of several assessments for each subject are presented in Supplementary Table 1 (in the online-only Data Supplement). The mean age of the seven participants was 23.3 years [standard deviation (SD)=4.5]. Two of the seven participants were women. Although there was no significant effect of the VR sessions on the assessment scores, we could detect a trend of improvement in K-MADRS, HAM-A, and SSQ scores when compared before and after the VR sessions (Table 1). Comparing the groups with and without comorbid psychiatric disorders [n=5 and n=2, respectively, Supplementary Table 2 (in the online-only Data Supplement)], there was a significant decrease in the BAI score between sessions, and there was a significant interaction effect between the session and group factors. The comparison of the groups with and without previous VR experience [n=3 and n=4, respectively, Supplementary Table 2 (in the online-only Data Supplement)], showed a significant reduction of the SSQ score between sessions in both groups.
Results of comparison of psychiatric scales across haptic-based multimodal feedback VR sessions
Due to the inadequacy of the heart rate recorded data, it was difficult to find meaningful systematic results. Instead, a sample graph of measured heart rate changes in one patient during the VR session is shown in Figure 1.
A sample graph of measured heart rate changes of one subject during a VR session. A: HR of one subject during a VR treatment session: the first 20 seconds represent the baseline HR before the start of the VR session (baseline HR), “Elevator” represents the experience of the VR elevator scenario, and MF represents the breathing guide with the visuo-haptic-based multimodal feedback system. There is a clear jump between baseline HR and Elevator. The heart rate decreases between Elevator and MF, and the heart rate variability is wider at MF. B: The dot represents the mean value of the heart rate, and the arrow represents its SD. Point 1 represents the mean and SD of heart rate at baseline, point 2 represents the same data at Elevator, and point 3 at MF. VR: virtual reality, HR: heart rate, MF: multimodal feedback, SD: standard deviation.
DISCUSSION
From this study, we were able to observe a tendency towards improvement of scales measuring depression (K-MADRS) and anxiety (HAM-A) as an effect of VR sessions. Although there were limitations such as the small sample size and the insufficient number of VR sessions, the present study is meaningful in showing that an immersive experience using a visuohaptic based multimodal feedback VR solution could have a therapeutic effect in controlling psychological discomfort. The subjective anxiety decreased after the VR session for panic patients both with and without comorbid psychiatric disorders, but in particular the group without comorbidities showed a more significant decrease than the comorbid group. This result suggests that the developed VR solution may be effective to relieve subjective anxiety, especially in the absence of other mood disorders. This is due to the fact that our VR solution was developed specifically for anxiety symptoms. Therefore, it can be assumed to be more effective in patients who had anxiety symptoms alone, rather than in those who had comorbid psychiatric disorders, in agreement with a previous study that reported insufficient treatment response in the comorbid groups [26].
VR sickness is the most common complaint related to VR use, and there have been various efforts to improve it [27]. Sometimes, such discomfort may be fatal to the therapeutic program, especially for people experiencing anxiety symptoms. In this study, we found that the subjective discomfort due to VR was decreased over time as the VR session progressed, according to the somatic symptoms questionnaire (SSQ) results. VR sickness can be somewhat problematic at first, but it could be gradually adapted to as the VR experience progresses [28,29]. VR sickness, of course, will vary depending on the each person’s susceptibility [30], but VR sessions are expected to become more tolerable and effective over time as VR sessions are repeated.
This study is a new trial to evaluate, as a proof-of-concept, the effectiveness of VR therapy by using physiological information and multimodal feedback simultaneously. Until now, most research related to the physiological information gained from VR was aimed only towards data acquisition and analysis. However, in this study, physiological (heart rate) information for simultaneous feedback was used as a part of the VR treatment system, through a visuo-haptic-based implementation.
There are several studies on VR treatment for mental health: For example, treatments for post-traumatic stress disorder (PTSD) and specific phobias are well-known. It is however much more challenging to develop a VR system for panic symptom than for PTSD and specific phobias. When an effective VR treatment system for anxiety disorder is developed, it will be effectively and powerfully used in many patients. Overall, almost all participants were satisfied with the VR solution, according to their subjective reports, and they reported willingness to use the VR solution in the future. Particularly, they mentioned that it was meaningful to experience visuo-haptically the decrease in their own heart rate obtained by following the breathing guide. Moreover, all participants were clinical patients, and the analysis of the therapeutic effects of VR sessions on these patients is the main strength of this study.
There are a few limitations to this study. Firstly, the sample size was too small. The results must be assessed while considering that it is a proof-of-concept study. The effectiveness of the VR sessions could become statistically reliable with a larger sample size. Secondly, the number of sessions was relatively small compared to traditional CBT treatment, which is designed to be carried out in 12–18 sessions of approximately 50–60 minutes [31]. This proof-of-concept study included only two sessions, which might not be enough to evaluate the effectiveness of the VR therapeutic intervention. Lastly, there were technical issues on the hardware system, so that the heart rate information was not fully recorded and thus could not be statistically analyzed.
It is necessary to devise a therapeutic approach fully exploiting those unique features of VR, which cannot be reproduced by any other approach. Far from being simply an application of new technologies, VR will be able to fill areas that are difficult or impossible to implement with other therapeutic approaches. In this regard, the visuo-haptic based multimodal feedback VR solution implemented and applied in this study will be relevant to future psychiatric applications. In the future, the development of a more complete and technically sound psychiatric VR solution, and related clinical research with a sufficient number of subjects and VR sessions, may suggest the possibility of new immersive therapeutic options.
Supplementary Materials
The online-only Data Supplement is available with this article at https://doi.org/10.30773/pi.2018.12.25.1
Acknowledgements
This research was supported by the Brain Research Program through the National Research Foundation of Korea (NRF), funded by the Ministry of Science, ICT & Future Planning (NRF-2016M3C7A1914448) and ICT & Future Planning for convergent research in Development program for convergence R&D over Science and Technology Liberal Arts (NRF2017M3C1B6070978).