Evaluation of asymmetry in right and left eyes of normal individuals using extracted features from optical coherence tomography and fundus images
Tahereh Mahmudi1, Raheleh Kafieh2, Hossein Rabbani2, Alireza Mehri2, Mohammad-Reza Akhlaghi3
1 Department of Medical Physics and Biomedical Engineering, School of Medicine, Tehran University of Medical Sciences, Tehran; Medical Image and Signal Processing Research Center, School of Advanced Technologies in Medicine, Isfahan University of Medical Sciences, Isfahan, Iran
2 Department of Medical Physics and Biomedical Engineering, School of Medicine, Tehran University of Medical Sciences, Tehran, Iran
3 Department of Ophthalmology, School of Medicine, Isfahan University of Medical Sciences, Isfahan, Iran
Correspondence Address:
Raheleh Kafieh
Medical Image and Signal Processing Research Center, School of Advanced Technologies in Medicine, Isfahan University of Medical Sciences, Isfahan
Iran
Source of Support: None, Conflict of Interest: None
DOI: 10.4103/jmss.JMSS_67_19
Background: Asymmetry analysis of retinal layers in right and left eyes can be a valuable tool for early diagnoses of retinal diseases. To determine the limits of the normal interocular asymmetry in retinal layers around macula, thickness measurements are obtained with optical coherence tomography (OCT). Methods: For this purpose, after segmentation of intraretinal layer in threedimensional OCT data and calculating the midmacular point, the TM of each layer is obtained in 9 sectors in concentric circles around the macula. To compare corresponding sectors in the right and left eyes, the TMs of the left and right images are registered by alignment of retinal raphe (i.e. diskfovea axes). Since the retinal raphe of macular OCTs is not calculable due to limited region size, the TMs are registered by first aligning corresponding retinal raphe of fundus images and then registration of the OCTs to aligned fundus images. To analyze the asymmetry in each retinal layer, the mean and standard deviation of thickness in 9 sectors of 11 layers are calculated in 50 normal individuals. Results: The results demonstrate that some sectors of retinal layers have signifcant asymmetry with P < 0.05 in normal population. In this base, the tolerance limits for normal individuals are calculated. Conclusion: This article shows that normal population does not have identical retinal information in both eyes, and without considering this reality, normal asymmetry in information gathered from both eyes might be interpreted as retinal disorders.
Keywords: Alignment, asymmetry analysis, fundus images, optical coherence tomography
Recently, optical coherence tomography (OCT) has revolutionized the clinical imaging of the retina by a noninvasive imaging modality in the diagnosis of ocular diseases.[1],[2] The high-resolution, cross-sectional images of the retina can be obtained by OCT systems, and it provides a valuable tool for measuring the parameters of retinal morphology.[3] Improvements in automatic analysis will be beneficial to clinicians as it can improve the speed and accuracy of their diagnoses. Therefore, the automatic extraction of parameters such as retinal layer thickness is already possible.
Asymmetry analysis is a valuable tool for early diagnoses of retinal diseases. For instance, it is very common to investigate glaucomatous eyes by visual field tests. However, such a test is not sensitive enough to find very small loss in layers such as ganglion cells. By only focusing on interindividual variations in one eye, such small losses may not be found. This can simply justify our need to consider interocular differences to compare thicknesses of two eyes from one individual. It is expected that small interocular differences (compared to variation across individuals) in normative database would provide an asymmetry limit range for normal population. It is also expected that different diseases would alter the symmetry to fall outside the normative range. This is already shown in symmetry analysis of retinal nerve fiber layer (RNFL) in glaucoma,[4] but more sophisticated diseases affecting other retinal layers may also be considered.
For asymmetry analysis in retinal images, a number of previous works are available.[4],[5],[6],[7],[8],[9],[10],[11],[12],[13],[14],[15],[16],[17],[18],[19],[20],[21],[22],[23],[24],[25] For instance, interocular symmetry/asymmetry was analyzed on the RNFL thickness (RNFLT) of the retina on OCT images in normal population to discriminate normal/abnormal cases. [Table 1] summarizes the available works on symmetry of retinal layers between the right and left eyes using OCT.
To the best of our knowledge, no study is undertaken to evaluate symmetry of all 11 subretinal layers in concentric circles around the macula, by standards of the Early Treatment Diabetic Retinopathy Study (ETDRS) in normal population, and the presented work determines that the normal tolerance limit is each sector of the mentioned circles for all 11 subretinal layers.
The purpose of this study is to determine normal tolerance limits for asymmetry of retinal layer thickness between two eyes and to infer that measurements beyond this level are signature of possible abnormalities. This article is extension of Mahmudi et al.'s study;[17] compared to which the number of volunteers is increased from 19 to 50, the evaluated layers consist 11 intraretinal layers rather than only focusing on RNFL and total retinal thickness, and the right and left eyes are aligned according to retinal raphe using a combined method by means of registration,[26] alignment, and fusion to provide a correct comparison.
Materials and MethodsMaterials
The set of images is provided by the Ophthalmology Department, Feiz Hospital, Isfahan, Iran. The Ethics Committee of Isfahan University of Medical Sciences approved the study protocol, and the individuals gave approval before inclusion and provided written informed consent. Fifty normal individuals (age 45 ± 10 years) participated in this study and underwent a comprehensive test; two eyes of each patient were tested with three-dimensional (3D) OCT-1000 (MK2, Ver. 3.51) Topcon device which could produce both fundus and OCT images. The inclusion criteria for normal eye are presented in [Table 2].
The individuals were recruited by advertisement among the general population of students and staff in the Department of Advanced Technologies in Medicine, Isfahan University of Medical Sciences, Isfahan, Iran.
Each captured image includes two modalities of OCT data and fundus image (described below):
Optical coherence tomography data
Each data includes macular OCTs of the right and left eyes. The dimension of the OCT data is 650 × 512 × 128 voxels with a voxel resolution of 3.54 × 11.72 × 46.88 μm which correspond to axial, nasal-temporal, and superior-inferior orientations. The dataset is, therefore, composed of 128 slices with a size of 650 × 512.
Fundus images
Each image includes two-color fundus image of the retina from the left and right eyes with dimension of 1534 ×1612 pixels.
The dataset is publicly available in https://sites.google.com/site/hosseinrabbanikhorasgani/datasets-1/oct-fundus-right-left and https://hrabbani.site123.me/available-datasets/oct-data-color-fundus-images-of-left-right-eyes-of-50-healthy-persons.
Asymmetry analysis for thickness of retinal layers
Covering a great part of the eye, the retina is a multilayered structure responsible for transforming light into neural signals for further use by the brain. In this article, using automatic 3D segmentation on each dataset,[27] thickness maps (TMs) of 11 retinal layers in OCT, pertaining to histological retinal layers, were generated.
Layer 1: nerve fiber layerLayer 2: ganglion cell layerLayer 3: inner plexiform layerLayer 4: inner nuclear layerLayer 5: outer plexiform layerLayer 6: outer nuclear layerLayer 7: inner segment layerLayer 8: connecting ciliaLayer 9: outer segment layerLayer 10: Verhoeff membraneLayer 11: retinal pigment epithelium (RPE), also called the vitreous lamina.[28]The proposed method compares each layer in two eyes of an individual and looks for tolerance limits of normal eyes. For this purpose, different steps are proposed, as demonstrated in [Figure 1]. The 3D segmentation is needed for calculation of each boundary; however, the OCTs in the right and left eyes need to have identical rotation to have a correct comparison in the right and left eyes. That is why the next steps are proposed to find the retinal raphe and to correct the rotation. Construction of OCT projection, determination of macular center, construction of TM, and finally registration are the steps for retinal raphe alignment. Finally, the registered TMs are analyzed in 9 sectors of concentric circles to determine the asymmetry of the left and right eyes and to find the tolerance limits for each sector in each layer. Each step of the block diagram in [Figure 1] is elaborated in the following subsections.
Segmentation using diffusion map method
In this study, we used 3D intraretinal layer segmentation algorithm (using coarse-grained diffusion map)[27] on spectral-domain OCTs. This method is a fast segmentation method based on a spectral graph method named diffusion maps.[29],[30],[31] In contrast to other methods of graph-based OCT image segmentation, the presented approach does not require edge-based image information and rather relies on regional image texture.[32] As described in detail in Kafieh et al.'s study,[27] the method demonstrates robustness in low image contrast and poor layer-to-layer image gradients.
Each two-dimensional (2D)/3D OCT image was analyzed to localize 11 layers (12 surfaces), as shown in [Figure 2]. Signed and unsigned errors of the method in Kafieh et al.'s study[27] (according to independent standard resulted from averaging tracings from two expert observers) are 8.52 ± 3.13 and 7.56 ± 2.95 μm, respectively.
Optical coherence tomography projection and scaling
It is possible to collapse 3D OCT volumes along the depth axis to make a 2D projection map. There are several methods for making a projection such as averaging, highest, or lowest values of each column of 3D space.[33],[34] In this study, we used the column average of 3D OCT slices to create a projection demonstrated in [Figure 3]. Such a projection image demonstrated a clear macular region, but the vessels are not obvious enough for vessel segmentation. Therefore, a limited averaging along x-axis is proposed in outer retinal layers to produce vessel maps with clear vessel information.[35] This map, however, is not a good indicator for the macula region.
One important consideration in sampling ratio between OCT slices and corresponding fundus image is a four-time scaling in vertical axes. The size of each projection is 128 × 512 with a resolution of 46.88 × 11.72 μm/pixel. It can be simply seen that the vertical resolution is four times higher than horizontal resolution, and we can change the size of each projected image into 512 × 512 by scaling of vertical pixels and achieving equal resolution of 11.72 μm/pixel as shown in [Figure 4].
Determination of the macular center (fovea) in optical coherence tomography projections for ETRDS step
A diverse collection of methods is already proposed for automatic localization of fovea.[36],[37],[38],[39] We propose a simple strategy to find the middle point of the macula by pattern-matching scheme. First of all, we made 10 training templates (sized 153 × 153) manually located at the center of the macula. The averaged version of these templates was used as final template. Then, we used 2D convolution on averaged template and target image. Using maximum value, the coordinate of the center of macula was selected as the center point, as shown in [Figure 5]. For validation purpose, we compared the results with manual labeling of macula and 20.51 ± 6.09 μm error was achieved.
Construction of the thickness map
Analysis of thickness in retinal layers is an important way to quantify pathological changes.[40] In this study, the TMs are calculated by subtracting the location of two consequent boundaries calculated by 3D segmentation.[32] The boundaries first went into a curvature correction step with reference to lower boundary of RPE and are flattened before calculation of the thickness values.[32],[41] The flattening step removes the tilt in B-scans which may be due to off-axis image acquisition, and since the curvature correction is performed in both the right and left eyes, the tilt angle will be removed similarly in both eyes.[42] TMs of the 11 retinal layers in the right and left eyes are displayed in pseudo color [Figure 6]a, [Figure 6]b, [Figure 6]c, [Figure 6]d, [Figure 6]e, [Figure 6]f, [Figure 6]g, [Figure 6]h, [Figure 6]i, [Figure 6]j, [Figure 6]k. Total retinal layer thickness is also calculated by summing thickness measurements in 11 layers [Figure 6]l.
Registration
As described above, the OCTs in the right and left eyes should have identical rotation to provide a correct comparison in the right and left eyes. The axons of retina pass over a route to optic nerve head (ONH) without passing from the fovea (raphe). The correct location of raphe discriminates superior and inferior regions correctly, and the overlaid ETRDS lines match the OCT data. However, if the raphe would not be correctly located, the ETRDS sectors will mix the OCT information, and the thickness values would be incorrect. Furthermore, the locations in the right and left eyes will not correspond mutually. Even, if we assume that raphe orientation would be identical in both eyes, we need this alignment due to the need for being registered with other individuals.
One way for making identical rotation in both eyes is alignment based on retinal raphe (in this article, estimated by the line connecting macula to ONH); however, ONH is not detectable in projection images from macular OCTs. Therefore, the proposed strategy is to align the accompanying fundus images of the right and left eyes according to retinal raphe and then to register each OCT to the corresponding fundus image using extracted vessels in both modalities. [Figure 7] shows the proposed alignment and registration method, and each step is elaborated in more detail in the next subsections.
Alignment of the accompanying fundus images
We used the retinal raphe for aligning fundus images of both eyes by rotating each fundus image to horizontal retinal raphe [Figure 8]. To obtain the retinal raphe, middle point of the macula and optic disc in fundus image were obtained using a pattern-matching scheme by manual building of 10 training templates located at the center of the macula and ONH. The size of the macular templates is chosen (empirically) to be 201 × 201, and the size of the ONH templates is chosen to be 121 × 121. Then, an averaged version of these templates was used as the final template to be used in 2D convolution [Figure 9]. It should be mentioned that the proposed pattern-matching method for localization of optic disc or fovea may only be valid in normal individuals (which are of our interest in this article); however, if the proposed method would be applied on a population with unknown ocular condition, we may need to substitute the simple pattern-matching method with more complex methods like.[43],[44]
Registration of each optical coherence tomography to corresponding fundus image using extracted vessels
In this step, we have the correctly aligned fundus images, and if we register each OCT image with its corresponding fundus image, all four versions in the right and left eyes will have identical information. Since the OCT projection and fundus images vary in brightness and grayscale information, the main reliable information for registration of these two modalities is the extracted vessels. We chose an accurate vessel extraction method[45] for both modalities, as shown in [Figure 10].
For registration of vessels in two modalities, we used 2D correlation between the aligned fundus data (with horizontal retinal raphe) and different versions of OCT data, rotated from −15 to 15 degrees [Figure 11]. The correlation value was found for each rotated OCT, and the maximum answer was selected as the “best rotation.” The calculated “best rotation” is then applied on 11 TMs derived from different layers of OCT, and the reported results were calculated according to these new registered versions.
Division into nine sectors around the macula
To quantify the results, the mean thickness of each retinal layer was investigated by allocating three concentric circles based on the ETDRS standard grid with diameters of 1, 3, and 6 mm in 4 quadrants and 9 sectors around the macula[46][Figure 12]. The mean ± standard deviation (SD) of pixels in each sector was calculated.
The purpose of this study is to determine the tolerance limits for asymmetry of retinal layer thickness on normal populations. Using these tolerance limits, one may obtain a criterion for the diagnosis of particular diseases. For this purpose, at first, we obtained a mean difference (right thickness minus left thickness) in each layer. The center of macula defines the center of the concentric circles. The central circle represents the central foveal area; the second circle was subdivided into temporal/nasal (sector 2), inferior (sector 3), nasal/temporal (sector 4), and superior (sector 5) parafoveal retinal areas for the left/right eye. The third circle is similarly subdivided into temporal/nasal (sector 6), inferior (sector 7), nasal/temporal (sector 8), and superior (sector 9) perifoveal retinal areas for the left/right eye. Note that in the right and left eyes, the labels 3, 5, 7, and 9 are mirrored. For each of 9 sectors, and for each of 11 layers, the mean and SD of thickness are calculated by taking the average and SD from all 50 3D datasets. Total retinal layer thickness is also calculated for each sector, by summing the thickness of all 11 layers. A sample of such rotated version of the TM for the first layer (RNFL) with ETDRS grid is demonstrated in [Figure 13]. Furthermore, [Figure 14] shows all four versions (OCT TM and fundus in both eyes) with ETDRS grid after registration.
The next step to evaluate the asymmetry between the right and left eyes is calculating mean thickness difference (right thickness minus left thickness) in each layer. To justify the significance of the obtained differences, we also reported the corresponding P values.
Statistical analysis
Data were analyzed using MATLAB software, version 2012 (Mathworks, Natick, Mass). The Student's t-test was used to compare independent groups' averaged differences. Continuous variables are presented as mean ± SD. A two-sided P < 0.05 was considered statistically significant. In order to have a quantitative measure of the symmetry between the right and left eyes, the mean thickness difference (right thickness minus left thickness) in each layer is investigated for 9 sectors around the macula. For diagnostic parameters (following a Gaussian distribution) in the healthy population, the mean ± twice the SD was calculated to contain 95% normal limits[10] (the tolerance limit). To follow this hypothesis, we showed that the normal plot of the mean differences in each sector of retinal layers is almost linear and can be considered as a proof for its Gaussian distribution [Figure 15].
In order to have a quantitative measure of the symmetry between the right and left eyes, the mean thickness difference (right thickness minus left thickness) in each layer is investigated for 9 sectors around the macula. The maximum and minimum of the thickness for each layer of two eyes are shown in [Table 3]. Furthermore, [Table 4] summarizes the absolute normal tolerance limits. For instance, tolerance limits in RNFL thickness for 9 sectors are 1.15± (2 × 0.95) in sector 1, 2.64± (2 × 1.54) in sector 2, 4.16± (2 × 1.89) in sector 3, 1.23± (2 × 1.45) in sector 4, 2.68± (2 × 1.40) in sector 5, 4.03± (2 × 1.56) in sector 6, 4.86± (2 × 3.18) in sector 7, 2.36± (2 × 1.67) in sector 8, and 3.65± (2 × 1.39) in sector 9 (in μm). To justify the significance of the obtained differences, P value is also obtained for each layer in [Table 5]. P value indicates asymmetry on RNFLT in fovea and perifoveal temporal sectors between two eyes (P < 0.05). We also showed the detailed results for a sample layer (6th layer) in [Table 6].
The present study is set to determine normal tolerance limits for asymmetry of inter-retinal layers' thickness in normal population. Knowing the tolerance limits, we may suspect when patients would exceed these limits.
The state of being or not being asymmetric in retinal layers' thickness is investigated for the first time in this article. The results show that most of the sectors in each retinal layer are not significantly asymmetry, but some specific sectors of retinal layers have significant asymmetry with P < 0.05 in normal population. Fifth to seventh layer and RNFL seem to be more tedious to be asymmetric. Perifoveal and parafoveal temporal sectors and ventral fovea sector are more asymmetric in comparison with other sectors.
We also determined normal tolerance limits for asymmetry of retinal layer thickness in normal population. The normal tolerance limit has the highest value in perifoveal inferior, suggesting that the asymmetric values in this region are not a reliable sign of abnormalities. On the other hand, parafoveal nasal sector has a narrow normal limit of asymmetry and small variations in this region should be considered as a possible sign of abnormal situation.
One of the limitations in this work is the correct localization of the fovea on OCT projections. The incorrect location can alter the results considerably since many stages are dependent on it. Two potential sources of error are manual determination of the convolution templates, and the use of convolution operator on these templates, which leads to an error of 20.51 ± 6.09 μm in this research. A possible alternate to this method is localization of fovea using the deepest point in internal limiting membrane surface. This might be an accurate method supposing that dense OCT scans are available. To clear up, in this work, 128 scans provide a resolution of 46.88 × 11.72 μm/pixel. Namely, each B-scan is located 46.88 μm far from the next B-scan. In most fortunate conditions, one B-scan passes from the fovea and the deepest point would lead correctly to the result; otherwise, an error of at most 23.44 = 46.88/2 μm would be expected. This becomes worse if the number of scans would reduce to common numbers like 20 scans. We, therefore, admitted the convolution strategy with calculated 20.51 ± 6.09 μm error. This might be trivial comparing with 23.44 = 46.88/2 μm error in 128-slice acquisition but is considerably low in other datasets with low number of slices.
In conclusion, this article shows that normal population does not have identical retinal information in both eyes, and without considering this reality, normal asymmetry in information gathered from both eyes might be interpreted as retinal disorders.
We are now working on developing this study for evaluating asymmetry/symmetry in patients suffering from different ocular diseases. Furthermore, other features such as cup-to-disc ratio using ONH OCT may be considered in symmetry analysis in future works.
Acknowledgment
The authors would like to thank Ms. A. Soltanipour et al. for providing the source code of vessel segmentation.
Financial support and sponsorship
None.
Conflicts of interest
There are no conflicts of interest.
BiographiesTahereh Mahmoudi received her B.S. degree in Electrical Engineering (Electronic) from Shiraz University (2003) and M.Sc. in biomedical engineering from Isfahan University of Medical Sciences (2013). She is currently PhD student in biomedical engineering at Tehran University of Medical Sciences, Tehran, Iran. Her research interests are in biomedical image analysis, pattern recognition, classification and image segmentation.
Email: [email protected]
Rahele Kafieh received her BSc in Bioelectrical Engineering at Sahand University of Technology (2004) and completed her Msc and PhD in Bioelectrical Engineering at Isfahan University of Medical Sciences (2008 and 2014). She is Assistant Professor at School of Advanced Technologies in Medicine, Isfahan University of Medical Sciences, Isfahan, Iran and guest researcher at Neurocure Clinical Research Center, Charite University, Berlin, Germany. Her research is concentrated on biomedical image analysis, problems in area of graph based image analysis, time-frequency methods, deep learning and image segmentation.
Email: [email protected]
Hossein Rabbani received his BSc degree in Electrical Engineering (Communications) from Isfahan University of Technology in 2000 with the highest honors, and his MSc and PhD degrees in Bioelectrical Engineering in 2002 and 2008, respectively, from Amirkabir University of Technology. In 2007 he was with Queen's University, as a Visiting Researcher, in 2011 with University of Iowa, as a Postdoctoral Research Scholar, and in 2013-2014 with Duke University as a Postdoctoral Fellow. He is now a professor in Biomedical Engineering Department and Medical Image & Signal Processing Research Center (MISP), Isfahan University of Medical Sciences, Isfahan, Iran, and Editor in-Chief of Journal of Medical Signals and Sensors (JMSS). His main research interests are medical image analysis and modeling, statistical (m-D) signal processing, sparse transforms, and image restoration.
Email: [email protected]
Alireza Mehri Dehnavi received BSc in Electrical Engineering from Isfahan University of Technology in 1988, MSc of Engineering in Measurement and Instrumentation from Indian Institute of Technology Roorkee in 1992 and PhD in Medical Engineering from Liverpool University in 1996. He is a Professor of Biomedical Engineering in School of Advanced Technologies in Medicine of Isfahan University of Medical Sciences. His research interests are medical optics, devices and signal processing.
Email: [email protected]
Mohammad Reza Akhlaghi is an Associate Professor in Department of Ophthalmology, Isfahan University of Medical Sciences, Isfahan, Iran. He received his VitreoRetinal Fellowship in 2006 from the Tehran University of Medical Sciences.
Email: [email protected]
References
Comments (0)