Radiomics; A Potential Next “Omics” in Psychiatric Disorders; An Introduction

Article information

Psychiatry Investig. 2023;20(7):583-592
Publication date (electronic) : 2023 July 7
doi :
1Physiology Research Center, Iran University of Medical Sciences, Tehran, Iran
2Department of Radiology, Heersink School of Medicine, University of Alabama at Birmingham (UAB), Birmingham, AL, USA
3Department of Radiology, Division of Pediatric Radiology, Lucile Packard Children’s Hospital, Stanford University, Stanford, CA, USA
4School of Medicine, Bushehr University of Medical Sciences, Bushehr, Iran
5Department of Radiology and Neurology, Heersink School of Medicine, University of Alabama at Birmingham (UAB), Birmingham, AL, USA
Correspondence: Houman Sotoudeh, MD Department of Radiology and Neurology, Heersink School of Medicine, University of Alabama at Birmingham (UAB), 619 19th St S, Birmingham, AL 35294, USA Tel: +1-205-934-3933, Fax: +1-205-975-9262, E-mail:
Received 2022 November 21; Revised 2023 March 7; Accepted 2023 March 26.


Psychiatric disorders remain one of the most debilitating conditions; however, most patients are never diagnosed and do not seek treatment. Despite its massive burden on modern society and the health system, many hurdles prevent proper diagnosis and management of these disorders. The diagnosis is primarily based on clinical symptoms, and efforts to find appropriate biomarkers have not been practical. Through the past years, researchers have put a tremendous effort into finding biomarkers in “omics” fields: genomics, transcriptomics, proteomics, metabolomics, and epigenomics. This article reviews the evolving field of radiomics and its role in diagnosing psychiatric disorders as the sixth potential “omics.” The first section of this paper elaborates on the definition of radiomics and its potential to provide a detailed structural study of the brain. Following that, we have provided the latest promising results of this novel approach in a broad range of psychiatric disorders. Radiomics fits well within the concept of psychoradiology. Besides volumetric analysis, radiomics takes advantage of many other features. This technique may open a new field in psychiatry for diagnosing and classifying psychiatric disorders and treatment response prediction in the era of precision and personalized medicine. The initial results are encouraging, but radiomics in psychiatry is still in its infancy. Despite the extensive burden of psychiatric disorders, there are very few published studies in this field, with small patient populations. The lack of prospective multi-centric studies and heterogeneity of studies in design are the significant barriers against the clinical adaptation of radiomics in psychoradiology.


Importance of psychiatric disease and diagnostic limitations

Psychiatric disorders are mental health conditions constituting abnormal alterations in thinking, emotion, and behavior leading to distress and interference with normal social functioning [1]. World Health Organization recognizes mental illnesses as one of the most prevalent health conditions with catastrophic mortality, morbidity, and disability rates. A severe type of psychiatric illness may decrease 13 to 32 years of average life expectancy [2,3]. Approximately one in five U.S. adults lives daily with these ailments [4]. These conditions account for 30%–40% of chronic sick leave and nearly 4% of western countries’ gross domestic product cost [5].

Modern individualistic society increasingly suffers from these disorders, accounting for nearly 655 million estimated cases in 1990 and 970 million cases in 2019, demonstrating an increase of 48.1%. They were the 13th leading cause of disability-adjusted life years in 1990. However, they rose to the 7th rank in 2019 [6]. Despite the increasing burden and associated clinical and social implications around them, little has improved our clinical diagnostic abilities. Psychiatrists rely on patients’ descriptions of symptoms, mental status examinations, and clinical behavioral observations in their diagnostic, management, and follow-up approaches [7]. Moreover, unlike other medical conditions, psychiatric disorders are classified by diagnostic categories with a broad list of symptoms. Therefore, patients diagnosed with the same class type may have substantial heterogeneity in their clinical manifestation. Lastly, the lack of neurochemical and neuroimaging knowledge put additional hurdles in our diagnostic and therapeutic approaches. Through the past couple of years, researchers have put a tremendous effort into finding new biomarkers to support diagnosis, prevention, further substratification of major categories, and new methods to assess follow-up treatment response in psychiatric patients [8].

Experts categorize these advances in precision and personalized medicine into five major “omics” fields: genomics, transcriptomics, proteomics, metabolomics, and epigenomics [9-12]. This article reviews the evolving field of radiomics and its role in diagnosing psychiatric disorders as the sixth potential “omics.” In this respect, the PubMed dataset was searched for [Ramiomic, OR Radiomics, OR texture analysis, OR Omics], and different psychiatric disorders based on the Diagnostic and Statistical Manual of Mental Disorders and the current applications of radiomics in psychiatry is being reviewed here. Neurology disorders and neurodegenerative diseases are beyond the scope of this review.


Radiomics is a rapidly evolving medical research field, most implemented and tested in oncology using radiology and pathology images. Radiomics aims to capture the hidden features within medical images that are beyond the ability of human eyes. Radiomics has been implemented to predict histopathology characteristics, genomics, proteomics, disease progression, treatment response, survival, and many more clinical parameters which are not evident in the standard evaluation of medical images by a human expert [13]. Radiomics analysis can be performed on many types of radiologic imaging, including computed tomography (CT) scan, magnetic resonance imaging (MRI), positron emission tomography (PET), and single-photon emission computed tomography (SPECT) imaging.

The radiomics analysis begins with segmenting the regions of interest (ROI) or lesions which can be done on 2D or 3D images. Traditionally the ROIs are being segmented by radiologists, and the segmentation task is the most time and cost-consuming part of the process. Achievements in artificial intelligence (AI) now enable us to take advantage of automated and semi-automated AI-based segmentation. Subsequently, specific software will extract hundreds or thousands of features from the ROI in a few seconds. These features are essentially complex mathematical representations of pixels and voxels with ROI or lesion. The most commonly used features are shape-based, histogram-based, and texture-based features (Figure 1) [14].

Figure 1.

Simplified radiomics pipeline. The region of interest (ROI) is segmented on images that can be done manually, automated, or semiautomated (left hippocampus in this example). Next, radiomics features from different classes (shape, histogram, and texture in this example) are extracted from ROI. From hundreds of features, only the most predictive features are selected. Finally, different machine learning models are built based on the selected features to predict various clinical psychiatric questions.

Shape features

The shape features are the simplest form of the radiomics features, describing the two- or three-dimensional size and shape of the ROI and include volume, surface area, sphericity, etc [14].

Histogram features

These features belong to the first-order radiomics features given that they are based on analysis of the single voxel or pixel. The mean, maximum, minimum, variance, and percentiles of densities (CT scan), intensities (MRI), and standardized uptake value (PET) are examples of histogram features.

Texture features

Texture features are the essential form of radiomics features. These features essentially are a computational representation of the heterogeneity of the signal intensity (MRI), density (CT), or standardized uptake value (PET) of pixels/voxels within the ROI [14].

The “psychoradiology” consists of using radiologic approaches in patients with major psychiatric disorders for diagnosis, treatment planning, and monitoring (Figure 2) [15]. The concept of psychoradiology fits very well in radiomics, given that many psychoradiologic techniques constitute volumetric analysis, one of the principal radiomics features (shape features).

Figure 2.

The relationship between psychiatry, radiology, and artificial Intelligence (AI). Psychoradiology includes the techniques taking advantage of radiology to diagnose, classify, and treat psychiatric disorders. A part of psychoradiology that takes advantage of classical AI models is radiomics.


Major depressive disorder

It is well-known that major depressive disorder (MDD) is caused by abnormal function of several cerebral neurotransmitters, mainly norepinephrine, and serotonin [16]. However, the physiopathology of MDD is not limited to the neurons, and cerebral structural changes can be detected on gross anatomy/medical imaging. Traditional structural brain imaging in MDD describes abnormalities in multiple brain regions, especially in prefrontal-limbic circuits. In MDD, decreased gray matter in the prefrontal lobe, limbic system, striatum, cerebellum, temporal lobe, and bilateral lingual gyri have been reported [17]. White matter changes in MDD have also been described, with diffusion tensor imaging (DTI) studies showing lower fractional anisotropy values in the white matter of the right middle frontal gyrus, left lateral occipitotemporal gyrus, and angular gyrus of the right parietal lobe when compared to healthy subjects [18].

Ma et al. [19] implemented radiomics analysis on T1 and DTI MRI sequences to differentiate the healthy control (HC) adolescents from adolescents with MDD and subthreshold depression (StD). They found ten features to be most predictive in differentiating MDD from HC, eight features in differentiating StD from HC, and seven features in differentiating MDD from StD using random forest (RF) machine learning. They achieved accuracies and area under the curve (AUC) of 86.75%, 0.93 for differentiation of MDD from HC (most predictive anatomic locations: left medial orbitofrontal cortex, right superior, middle temporal regions, right anterior cingulate, left cuneus, and hippocampus), and 70.51%, 0.69 for differentiation of StD from HC (most predictive anatomic locations: left cuneus, medial orbitofrontal cortex, cerebellar vermis, hippocampus, anterior cingulate and amygdala, right superior and middle temporal regions), and 59.15%, 0.66 for differentiation of MDD from StD (most predictive anatomic locations: left medial orbitofrontal cortex, middle temporal and cuneus, right superior frontal, superior temporal regions and hippocampus, and anterior cingulate).

Furthermore, Zhang et al. [20] used radiomics analysis to differentiate isolated Parkinson’s disease from Parkinson’s disease with depression versus healthy volunteers. They extracted 6,557 features from frontotemporal lobes on resting-state functional MRI (fMRI; resting-state functional connectivity [RSFC], amplitude of low-frequency fluctuation [ALFF], regional homogeneity [ReHo], and voxel-mirrored homotopic connectivity [VMHC]). Subsequent least absolute shrinkage and selection operator (LASSO), RF, and support vector machine (SVM) analysis selected the most predictive features. All three classifier models (LASSO, RF, and SVM) have accuracy above 90% in differentiating the isolated Parkinson’s disease versus Parkinson’s disease with depression versus healthy volunteers.

Radiomic analysis can predict treatment response to repetitive transcranial magnetic stimulation (rTMS) in neurocognitive disorders. In one study by Lu et al. [21], the patients with higher cortical thickness in the left dorsolateral prefrontal cortex had a higher chance of remission after rTMS. Since volumetry is one of the radiomics features, it is possible that radiomics can predict rTMS treatment response in MDD as well.


Schizophrenia (SZ) is a complex neuropsychiatric syndrome with a heterogeneous genetic, neurobiological, and phenotypic profile. Some abnormalities can be detected by anatomic MRI imaging including: 1) decrease in gray matter volume, 2) superior temporal gyrus volume loss (more common in an auditory hallucination), and 3) prefrontal lobe volume loss (more common in negative symptoms); MR spectroscopy (low N-acetyl aspartate in hippocampal gray and white matter and prefrontal cortices), and fMRI (abnormal activation in “default mode network” which includes bilateral precuneus and inferior-lateral temporal cortices, posterior cingulate and inferior parietal gyri [right sided] and right medial prefrontal cortex) [22].

It has been shown that the radiomics analysis on T1 MRI (posterior cingulate cortex) and PET images (frontal cortex) could differentiate SZ patients from normal volunteers with an AUC of 0.89 and 0.82, respectively [23].

Furthermore, radiomics analysis has been used for response prediction in electroconvulsive therapy in patients with SZ. Fifteen first-order radiomics features from 19 regions of the white matter on the T1 MRI images based on a logistic regression model achieved an accuracy of 90.91% in the training dataset and 87.59% in the test dataset in the differentiation of the responders from non-responders. The accuracy of the SVM was reported as 90.91% for the training dataset and 91.78% for the test dataset [24].

The utility of radiomics features from the bilateral hippocampi on the T1 sequence has also been studied to differentiate patients with SZ versus volunteer cases. Among different combinations of feature selection and machine learning models, the “mutual information feature selection” associated with logistic regression had the best overall performance with an AUC of 0.82, an accuracy of 82%, a sensitivity of 76%, and a specificity of 70% for differentiating schizophrenic patients from the volunteers [25].

In another study, by combining structural and fMRI with radiomics, Cui et al. [26] achieved an overall accuracy of 85.03% (92.04% responders and 80.23% non-responders) in treatment prediction in patients with SZ. This study’s structural features were extracted from the right precuneus, cuneus, and inferior parietal lobule, and the functional features predominately included interhemispheric connectivity. The curvature of the right inferior parietal lobule and functional connectivity between the right inferior frontal gyrus and the left putamen mainly contributed to the prediction performance.

Latha and Kavitha [27] utilized the radiomics features from ventricles and cerebellum on the T1 sequence to differentiate schizoaffective patients from SZ cases. A combination of radiomics features extracted from the cerebellum region reached high classification accuracy of 90.09% for this task.

Bipolar disorders

Patients with bipolar disorders (BD) differ from healthy volunteers on anatomic MRI, including: 1) decreased gray matter volume, decreased white matter volume, and decreased cortical thickness in prefrontal, anterior temporal, and insula cortices; 2) decreased volume of amygdala and hippocampus, and altered striatal volumes; and 3) abnormal fMRI (abnormally elevated activity in the ventral striatum and left prefrontal cortex, in particular, left orbitofrontal cortex, and left ventrolateral prefrontal cortex, during the reward processing) [28,29].

Using fMRI, Wang et al. [30] extracted 7,018 features from the preprocessing resting-state fMRI (mean regional homogeneity [mReHo], mean amplitude of low-frequency fluctuation [mALFF], RSFC, and VMHC). Their dataset constituted 90 patients with unmedicated BD II and 117 HCs. The subsequent LASSO model selected 65 most predictive features, and the final SVM model achieved accuracy and AUC of 87.3% and 0.919 in the training dataset and 80.5% and 0.838 in the validation dataset, respectively, in the differentiation of BD from normal volunteers.

Attention deficit hyperactivity disorder

Patients with attention deficit hyperactivity disorder (ADHD) can be different from controls on anatomic MRI (total brain volume, caudate nucleus, putamen, nucleus accumbens, amygdala, and hippocampus are found to be smaller in ADHD compared to normal subjects) [31].

Sun et al. [32] used radiomics for diagnosing and subtyping ADHD on T1 sequence and DTI. The features related to cortical shape in the left temporal lobe, bilateral cuneus, and regions around the left central sulcus contributed significantly to discrimination of patients with ADHD from control subjects. In contrast, features involved in the default mode network and insular cortex primarily contributed to ADHD subtype discrimination (the RF classifier achieved an average accuracy of 73.7% for identifying individuals with ADHD and 80.1% for discriminating between ADHD-inattentive and ADHD-combined).

Anxiety disorders

Social anxiety is a highly disabling disorder defined as a “marked and persistent fear of social or performance situations.” [33] Kim et al. [34] conducted a study to predict the level of social anxiety in young adults by resting-state brain functional radiomics features. These features included ReHo, the fractional ALFF, fractional resting-state physiological fluctuation amplitude, and degree centrality. From extracted features, the fractional resting-state physiological fluctuation amplitude of the left orbitofrontal cortex, the degree centrality of the left orbitofrontal cortex, and the degree centrality of the left amygdala were the most predictive. Among the different models, the eXtreme Gradient Boosting (XGBoost) model achieved the best performance with a balanced accuracy of 77.7%.

Panic disorder

Panic disorder is a debilitating disorder that seriously impacts adolescents’ social and academic functioning and general well-being [35]. Agoraphobia is characterized by fear or anxiety about multiple situations in which escape might be difficult, or panic-like symptoms may develop [36]. Recent literature suggests that agoraphobia is frequently accompanied by panic disorder [37]. Early and accurate diagnosis of panic disorder with or without agoraphobia (PDA) is crucial in reducing the disease burden. Therefore, Bang et al. [38] investigated the usability of 29 different radiomics features extracted from major fearcircuit structures (amygdala, insula, and anterior cingulate cortex) on T1-weighted MRI images in differentiating patients with PDA from HCs. The AUC and accuracy of the best-performing radiomics model in the test set were 0.84 and 81.3%, respectively.

Internet gaming disorder

In another study, Han et al. [39] investigated T1 and DTI radiomics features in the context of a diagnosis of Internet gaming disorder (IGD) by establishing a radiomics-based machine-learning model. In this study, the features associated with the cortical shape of bilateral fusiform, left rostral middle frontal, left cuneus, left pars opercularis, and regions around the right uncinate fasciculus, and left internal capsule regions were the most predictive features. The final models could differentiate IGD from the control group with an accuracy of 73%.

Autism spectrum disorder

Traditional MRI in patients with autism spectrum disorder (ASD) demonstrates increased total cerebral and amygdala volume, and an increase in cerebral gray and white matter, specifically in the frontal, temporal, and cingulate cortices [40,41].

In one radiomics study on 36 patients with autism and 30 healthy subjects, texture features were extracted from the hippocampus and amygdala on the T1 sequence. Feature selection analysis demonstrated that preliminary results show that 11 features from the hippocampus and four features from the amygdala were different in ASD and normal controls. The subsequent SVM could differentiate these groups with moderate performance (AUC of 0.76) [42].

In another study by Chaddad et al. [43], multiple features were extracted from different brain regions, which revealed asymmetry in the right hippocampus, left choroid-plexus, and corpus callosum, and symmetry in the cerebellar white matter between patients with ASD and normal controls, indicating that radiomics can be used for diagnosis of ASD.


Radiomics was first developed in oncologic imaging as a bridge for personalized medicine using imaging biomarkers. However, it can be implemented for any pathology and can analyze any digital images (CT, MRI, SPECT, and PET). It is well known that psychiatric disorders can be associated with structural alterations in the brain, which may not be visible by bare eyes. These structural alterations can be captured by radiomics analysis and be used for clinical prediction. Our review shows that psychiatric radiomics is in evolution. It can be used on the most common psychiatric disorders for diagnosis, prognosis, and treatment response prediction. It can also classify psychiatric patients into more homogenous subtypes, eventually facilitating more effective clinical trials. There are more abundant data about radiomics in SZ and major depression.

Based on our review (Table 1), we know that:

Published studies about the role of radiomics in psychiatric disorders

1) The T1-weighted MRI and fMRI are the most common imaging modalities in psychiatric radiomics. However, no data is available regarding other MRI sequences (T2, FLAIR, post-contrast T1, ect.) in this field. Adding other MRI sequences and imaging modalities can potentially improve the performance of this technique.

2) There is heterogenicity in the radiomics pipelines. There is no agreement about the number of extracted features, the number of selected features, and the feature extraction and selection techniques. As a result, other researchers can not easily repeat these studies. A uniform approach is needed to address this limitation.

3) So far, most of the published studies are about small datasets. Also, patients in these datasets are heterogenous in treatment and severity. Therefore, larger, more homogenous, and prospective datasets are needed for more reliable results.

4) Our knowledge in psychoradiology is mainly about the association between the volume changes in different brain regions and psychiatric disorders. Very little is known about the texture alteration in the brain regions without volume alteration. Radiomics analysis from normal-volume brain regions can open a new window to radiopsychiatry.

5) The number of the selected features is often too high, which may cause an overestimation of model performance. In radiomics, the acceptable number of the selected features should be about 10% of the number of samples within the dataset.

6) So far, different machine learning models have been used; however, the RF and SVM are among the most common models.

7) Given the small sample size, most studies evaluated the model performance by cross-validation, which can overestimate the performance. Having a test dataset and especially using an external dataset, can improve the reliability of the studies.

8) In most of the studies, the data, datasets, and trained models were not publicly shared, so the other researchers could not regenerate the studies. Sharing the data and the trained models is critical in radiomics studies.

9) So far, many of the psychiatric disorders have not been studied by radiomics. These include: conduct disorders, disruptive mood dysregulation disorder, feeding and eating disorders, gender dysphoria, intellectual disability, obsessive-compulsive and related disorders, paraphilic disorders, personality disorders, posttraumatic stress disorder, sleep-wake disorders, specific learning disorders, social (pragmatic) communication disorder, somatic symptom and related disorders, and substance-related and addictive disorders.

They are several radiomics guidelines that can improve the study design in this field. These guidelines are about oncologic applications but can be easily adopted in psychiatry. Therefore, the readers are encouraged to review them before conducting radiomics psychiatric study [44-46].


Radiomics fits well within the concept of psychoradiology. Besides volumetric analysis, which is currently the most common psychoradiology approach, radiomics, takes advantage of many other features (e.g., histogram and texture). In the era of precision and personalized medicine, radiomics may open new fields in psychiatry for diagnosing and classifying psychiatric disorders as well as treatment response prediction. However, despite the extensive burden of psychiatric disorders, there are very few published studies in this field, and with small subjects size. In this respect, the initial studies about neuropsychiatric radiomics are promising, with possibilities of radiomics analysis implementation in diagnosis, classification, treatment response, and prognosis prediction in psychiatry. However, several challenges should be addressed before clinical adaptation. So far, the published data in this field have been based on retrospective, single institutional studies on small patient sizes. Prospective multi-institutional studies are needed to evaluate these techniques. Furthermore, the included patients in these studies were selected based on the clinical psychiatric criteria as the gold standard [47]. Given the heterogeneity of psychiatric disorders in terms of presentation, this approach may not be optimal. Besides MRI, there is a lack of data about other imaging modalities which can be potentially used for psychiatric disorders (CT, SPECT, and PET). The heterogeneity of study design is another challenge in radiomics studies. Studies have been conducted using different MRI scanners/protocols/reconstructions, variable software for feature extraction, varying numbers of extracted and selected features, and different machine learning models. Radiomics can not be used for daily clinical practice without a uniform pipeline.


Availability of Data and Material

Data sharing not applicable to this article as no datasets were generated or analyzed during the study.

Conflicts of Interest

The authors have no potential conflicts of interest to disclose.

Author Contributions

Conceptualization: Houman Sotoudeh. Data curation: all authors. Investigation: all authors. Methodology: all authors. Project administration: Mohammadreza Alizadeh. Supervision: Houman Sotoudeh. Validation: Houman Sotoudeh. Visualization: Houman Sotoudeh. Writing—original draft: all authors. Writing—review & editing: all authors.

Funding Statement



1. Stein DJ, Palk AC, Kendler KS. What is a mental disorder? An exemplar-focused approach. Psychol Med 2021;51:894–901.
2. Ilyas A, Chesney E, Patel R. Improving life expectancy in people with serious mental illness: should we place more emphasis on primary prevention? Br J Psychiatry 2017;211:194–197.
3. Chesney E, Goodwin GM, Fazel S. Risks of all-cause and suicide mortality in mental disorders: a meta-review. World Psychiatry 2014;13:153–160.
4. Merikangas KR, He JP, Burstein M, Swanson SA, Avenevoli S, Cui L, et al. Lifetime prevalence of mental disorders in U.S. adolescents: results from the national comorbidity survey replication–adolescent supplement (NCS-A). J Am Acad Child Adolesc Psychiatry 2010;49:980–989.
5. Santos JV, Souza J, Valente J, Alonso V, Ramalho A, Viana J, et al. The state of health in the European Union (EU-28) in 2017: an analysis of the burden of diseases and injuries. Eur J Public Health 2020;30:590–595.
6. GBD 2019 Mental Disorders Collaborators. Global, regional, and national burden of 12 mental disorders in 204 countries and territories, 1990-2019: a systematic analysis for the Global Burden of Disease Study 2019. Lancet Psychiatry 2022;9:137–150.
7. Tlotlego N, Nonvignon J, Sambo LG, Asbu EZ, Kirigia JM. Assessment of productivity of hospitals in Botswana: a DEA application. Int Arch Med 2010;3:27.
8. García-Gutiérrez MS, Navarrete F, Sala F, Gasparyan A, Austrich-Olivares A, Manzanares J. Biomarkers in psychiatry: concept, definition, types and relevance to the clinical reality. Front Psychiatry 2020;11:432.
9. Kim SH, Weiß C, Hoffmann U, Borggrefe M, Akin I, Behnes M. Advantages and limitations of current biomarker research: from experimental research to clinical application. Curr Pharm Biotechnol 2017;18:445–455.
10. Jiang D, Armour CR, Hu C, Mei M, Tian C, Sharpton TJ, et al. Microbiome multi-omics network analysis: statistical considerations, limitations, and opportunities. Front Genet 2019;10:995.
11. Misra BB, Langefeld C, Olivier M, Cox LA. Integrated omics: tools, advances and future approaches. J Mol Endocrinol 2019;62:R21–R45.
12. Liang Y, Kelemen A. Dynamic modeling and network approaches for omics time course data: overview of computational approaches and applications. Brief Bioinform 2018;19:1051–1068.
13. Lee G, Lee HY, Ko ES, Jeong WK. Radiomics and imaging genomics in precision medicine. Precis Future Med 2017;1:10–31.
14. Mayerhoefer ME, Materka A, Langs G, Häggström I, Szczypiński P, Gibbs P, et al. Introduction to radiomics. J Nucl Med 2020;61:488–495.
15. Huang X, Gong Q, Sweeney JA, Biswal BB. Progress in psychoradiology, the clinical application of psychiatric neuroimaging. Br J Radiol 2019;92:20181000.
16. Girardi P, Pompili M, Innamorati M, Mancini M, Serafini G, Mazzarini L, et al. Duloxetine in acute major depression: review of comparisons to placebo and standard antidepressants using dissimilar methods. Hum Psychopharmacol 2009;24:177–190.
17. Zhang Y, Yang Y, Zhu L, Zhu Q, Jia Y, Zhang L, et al. Volumetric deficit within the fronto-limbic-striatal circuit in first-episode drug naïve patients with major depression disorder. Front Psychiatry 2021;11:600583.
18. Hermesdorf M, Berger K, Szentkirályi A, Schwindt W, Dannlowski U, Wersching H. Reduced fractional anisotropy in patients with major depressive disorder and associations with vascular stiffness. Neuroimage Clin 2017;14:151–155.
19. Ma H, Zhang D, Sun D, Wang H, Yang J. Gray and white matter structural examination for diagnosis of major depressive disorder and subthreshold depression in adolescents and young adults: a preliminary radiomics analysis. BMC Med Imaging 2022;22:164.
20. Zhang X, Cao X, Xue C, Zheng J, Zhang S, Huang Q, et al. Aberrant functional connectivity and activity in Parkinson’s disease and comorbidity with depression based on radiomic analysis. Brain Behav 2021;11e02103.
21. Lu H, Chan SSM, Ma S, Lin C, Mok VCT, Shi L, et al. Clinical and radiomic features for predicting the treatment response of repetitive transcranial magnetic stimulation in major neurocognitive disorder: results from a randomized controlled trial. Hum Brain Mapp 2022;43:5579–5592.
22. Kaur A, Basavanagowda DM, Rathod B, Mishra N, Fuad S, Nosher S, et al. Structural and functional alterations of the temporal lobe in schizophrenia: a literature review. Cureus 2020;12e11177.
23. Carrasco-Poves A, Ruiz-Espana S, Brambilla CR, Neuner I, Rajkumar R, Ramkiran S, et al. Analysis of new biomarkers for the study of schizophrenia following a radiomics approach on MR and PET imaging. In : 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC); 2022 Jul 11-15; Glasgow, Scotland, United Kingdom. New York: IEEE; 2022. p. 234–237.
24. Xi YB, Cui LB, Gong J, Fu YF, Wu XS, Guo F, et al. Neuroanatomical features that predict response to electroconvulsive therapy combined with antipsychotics in schizophrenia: a magnetic resonance imaging study using radiomics strategy. Front Psychiatry 2020;11:456.
25. Park YW, Choi D, Lee J, Ahn SS, Lee SK, Lee SH, et al. Differentiating patients with schizophrenia from healthy controls by hippocampal subfields using radiomics. Schizophr Res 2020;223:337–344.
26. Cui LB, Fu YF, Liu L, Wu XS, Xi YB, Wang HN, et al. Baseline structural and functional magnetic resonance imaging predicts early treatment response in schizophrenia with radiomics strategy. Eur J Neurosci 2021;53:1961–1975.
27. Latha M, Kavitha G. Combined metaheuristic algorithm and radiomics strategy for the analysis of neuroanatomical structures in schizophrenia and schizoaffective disorders. IRBM 2021;42:353–368.
28. Wang J, Liu P, Zhang A, Yang C, Liu S, Wang J, et al. Specific gray matter volume changes of the brain in unipolar and bipolar depression. Front Hum Neurosci 2021;14:592419.
29. Phillips ML, Swartz HA. A critical appraisal of neuroimaging studies of bipolar disorder: toward a new conceptualization of underlying neural circuitry and a road map for future research. Am J Psychiatry 2014;171:829–843.
30. Wang Y, Sun K, Liu Z, Chen G, Jia Y, Zhong S, et al. Classification of unmedicated bipolar disorder using whole-brain functional activity and connectivity: a radiomics analysis. Cereb Cortex 2020;30:1117–1128.
31. Mooney MA, Bhatt P, Hermosillo RJM, Ryabinin P, Nikolas M, Faraone SV, et al. Smaller total brain volume but not subcortical structure volume related to common genetic risk for ADHD. Psychol Med 2021;51:1279–1288.
32. Sun H, Chen Y, Huang Q, Lui S, Huang X, Shi Y, et al. Psychoradiologic utility of MR imaging for diagnosis of attention deficit hyperactivity disorder: a radiomics analysis. Radiology 2018;287:620–630.
33. Jefferson JW. Social anxiety disorder: more than just a little shyness. Prim Care Companion J Clin Psychiatry 2001;3:4–9.
34. Kim BH, Kim MK, Jo HJ, Kim JJ. Predicting social anxiety in young adults with machine learning of resting-state brain functional radiomic features. Sci Rep 2022;12:13932.
35. Baker HJ, Hollywood A, Waite P. Adolescents’ lived experience of panic disorder: an interpretative phenomenological analysis. BMC Psychol 2022;10:143.
36. Cornacchio D, Chou T, Sacks H, Pincus D, Comer J. Clinical consequences of the revised DSM‐5 definition of agoraphobia in treatment‐ seeking anxious youth. Depress Anxiety 2015;32:502–508.
37. Shin J, Park DH, Ryu SH, Ha JH, Kim SM, Jeon HJ. Clinical implications of agoraphobia in patients with panic disorder. Medicine (Baltimore) 2020;99e21414.
38. Bang M, Park YW, Eom J, Ahn SS, Kim J, Lee SK, et al. An interpretable radiomics model for the diagnosis of panic disorder with or without agoraphobia using magnetic resonance imaging. J Affect Disord 2022;305:47–54.
39. Han X, Wei L, Sun Y, Hu Y, Wang Y, Ding W, et al. MRI-based radiomic machine-learning model may accurately distinguish between subjects with internet gaming disorder and healthy controls. Brain Sci 2021;12:44.
40. Ha S, Sohn IJ, Kim N, Sim HJ, Cheon KA. Characteristics of brains in autism spectrum disorder: structure, function and connectivity across the lifespan. Exp Neurobiol 2015;24:273–284.
41. Hashem S, Nisar S, Bhat AA, Yadav SK, Azeem MW, Bagga P, et al. Genetics of structural and functional brain changes in autism spectrum disorder. Transl Psychiatry 2020;10:229.
42. Chaddad A, Desrosiers C, Hassan L, Tanougast C. Hippocampus and amygdala radiomic biomarkers for the study of autism spectrum disorder. BMC Neurosci 2017;18:52.
43. Chaddad A, Desrosiers C, Toews M. Multi-scale radiomic analysis of sub-cortical regions in MRI related to autism, gender and age. Sci Rep 2017;7:45639.
44. Hatt M, Krizsan AK, Rahmim A, Bradshaw TJ, Costa PF, Forgacs A, et al. Joint EANM/SNMMI guideline on radiomics in nuclear medicine. Eur J Nucl Med Mol Imaging 2023;50:352–375.
45. van Timmeren JE, Cester D, Tanadini-Lang S, Alkadhi H, Baessler B. Radiomics in medical imaging-“how-to” guide and critical reflection. Insights Imaging 2020;11:91.
46. Shur JD, Doran SJ, Kumar S, Ap Dafydd D, Downey K, O’Connor JPB, et al. Radiomics in oncology: a practical guide. Radiographics 2021;41:1717–1732.
47. Cui LB, Xu X, Cao F. Building the precision medicine for mental disorders via radiomics/machine learning and neuroimaging. Front Neurosci 2021;15:685005.

Article information Continued

Figure 1.

Simplified radiomics pipeline. The region of interest (ROI) is segmented on images that can be done manually, automated, or semiautomated (left hippocampus in this example). Next, radiomics features from different classes (shape, histogram, and texture in this example) are extracted from ROI. From hundreds of features, only the most predictive features are selected. Finally, different machine learning models are built based on the selected features to predict various clinical psychiatric questions.

Figure 2.

The relationship between psychiatry, radiology, and artificial Intelligence (AI). Psychoradiology includes the techniques taking advantage of radiology to diagnose, classify, and treat psychiatric disorders. A part of psychoradiology that takes advantage of classical AI models is radiomics.

Table 1.

Published studies about the role of radiomics in psychiatric disorders

Study Target Modality No. of cases Brain region segmented No. of extracted features Feature selection technique No. of selected features Machine learning models Findings
Ma et al. [19] Differentiation between major depression disorder (MDD) and subthreshold depression (STD) T1 weighted MRI and DTI 142 (43 MDD, 49 STD, 50 HC), only adolescent patients 124 regions (38 cortical and subcortical regions and 24 sulci per hemisphere) 3,030 RF 25 RF Accuracy 86% and AUC of 0.93 for MDD vs. HC
Accuracy 70.5%, AUC of 0.69 for STD vs. HC
Accuracy of 59%, AUC of 0.66 for MDD vs. STD
Zhang et al. [20] Differentiate between isolated Parkinson’s disease (PD) from Parkinson’s disease with depression (PDP) versus healthy volunteers (HC) Resting state fMRI 21 DPD, 49 PD, 50 HC 16 gyri 6,557 LASSO, RF, SVM 19 features for PDP vs. HC, 34 features for PD vs. HC, 17 features for PD vs. PDP LASSO, RF, SVM LASSO had highest performance.
Accuracy of 95 for PDP vs. HC, 96% for PD vs. HC, and 85% for PD vs. PDP
Lu et al. [21] Differentiation between Schizophrenia (SZ) vs. HC T1 MRI, [11c]ABP-688 PET 17 SZ, 17 HC 5 regions: frontal cortex, posterior cingulate, temporal cortex, primary auditory cortex, and thalamus 48 Relief Algorithm Between 7 to 43 for different brain regions SVM, Bagged Trees, KNN, NB AUC of 0.89 for T1 sequence and 0.82 for PET to differentiate SZ vs. HC
Xi et al. [24] Prediction of treatment response after ECT in SZ T1 weighted MRI 28 responsive and 29 non-responsive patients 19 regions 15 first order features t-test 13 Logistic regression (LR), SVM Accuracy above 90% for LR and SVM to predict treatment response
Park et al. [25] Differentiation between SZ vs. HC T1 weighted MRI 86 SZ, 66 HC Bilateral hippocampi 642 Mutual Formation 30 LR, Extra-trees, AdaBoost, XGBoost, SVM LR had highest performance: Accuracy of 82%
SZ patients were on treatment
Cui et al. [26] Treatment (medical treatment, ECT, and rTMS) response prediction in SZ [treatment was heterogeneous, not all cases received the same treatment] T1 weighted MRI and resting-state fMRI 85 responsive and 63 non-responsive patients 91 cortical and 15 subcortical regions 408 LASSO 12 SVM Accuracy of 80% for fMRI, 69% for T1 and 85% for the combination of T1+fMRI
Latha and Kavitha [27] Differentiation between SZ vs. Schizoaffective disorder (SA) vs. HC T1 weighted MRI 84 HC, 81 SZ, 31 SA Ventricle, cerebellum, and whole brain 104 feature for ventricles, 60 features for brain, 56 for cerebellum No feature selection Binary Particle Swarm Optimization, Fuzzy SVM Features of cerebellum were more accurate with accuracy of 90%
Wang et al. [28] Differentiation between bipolar disorder II (BD II) vs. HC Resting state fMRI 90 BD (only BD II), 117 HC 116 regions of brain 7,018 Mann-Whitney U-test and LASSO 65 SVM Accuracy above 80% for HC vs. BD
Sun et al. [32] Differentiation of ADHD from HC subjects, and Differentiation ADHD inattentive (ADHD-I) and combined inattentive and hyperactive subtypes (ADHD-C) T1 weighted MRI and DTI 83 (40 with ADHD-I and 43 with ADHD-C), and 87 HC 31 cortical regions, 7 subcortical regions per hemisphere, 24 sulci per hemisphere, 48 white matter regions 3,106 Forest-based 8 feature for ADHD vs. HC and 4 features for ADHS-I vs. ADHD-C RF Accuracy of 73% for ADHD vs. HC, 80% for ADHD-I vs. ADHD-C
Kim et al. [34] Predicting the social anxiety Resting state fMRI 116 14 regions of brain 56 Shapley Additive Explanation Features of orbitofrontal cortex Xboost, SVM, RF, and multi-layer perceptron Xboost with highest performance; accuracy of 77%
Bang et al. [38] Differentiation of panic disorder vs. HC T1 weighted MRI 93 patients, 120 HC Amygdala, insula, and anterior cingulate 1,498 LASSO 179 XGBoost, RF AUC of 0.81 for differentiation panic patients vs. HC
Han et al. [39] Differentiation between Internet gaming disorder (IGD) vs. HC 3D Fast spoiled Gradient Recalled sequence, and DTI 59 cases, 69 HC 101 regions of brain 2,084 RF 179 RF Accuracy of 73% to differentiate HC vs. IGD
Chaddad et al. [42] Autism spectrum disorder (ASD) vs. development control T1 34 cases, 30 HC Hippocampi and amygdala 15 11 features in hippocampi and 4 features for amygdala SVM, RF Accuracy of 76% to differentiate autism vs. HC

MRI, magnetic resonance imaging; DTI, diffusion tensor imaging; AUC, area under the curve; fMRI, functional MRI; LASSO, least absolute shrinkage and selection operator; RF, random forest; SVM, support vector machine; PET, positron emission tomography; KNN, k-nearest neighbors algorithm; NB, Naive Bayes algorithm; rTMS, repetitive transcranial magnetic stimulation; ADHD, attention deficit hyperactivity disorder