Self-supervised neural network-based endoscopic monocular 3D reconstruction method

Global Cancer Statistics Report 2020. Chin J Prev Med 2021;55(03):398–398

Schonberger JL, Frahm JM, Ieee. Structure-from-Motion Revisited. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016; pp. 4104–4113.

Mur-Artal R, Tardos JD. ORB-SLAM2: an open-source SLAM system for monocular, stereo, and RGB-D cameras. Ieee Trans Robot. 2017;33(5):1255–62.

Article  Google Scholar 

Engel J, Schoeps T, Cremers D. LSD-SLAM: large-scale direct monocular SLAM. In: 13th European Conference on Computer Vision (ECCV), 2014;834–849

Lee SH, Civera J. Loosely-coupled semi-direct monocular SLAM. Ieee Robot Autom Lett. 2019;4(2):399–406.

Article  Google Scholar 

Czarnowski J, Laidlow T, Clark R, et al. DeepFactors: real-time probabilistic dense monocular SLAM. Ieee Robot Autom Lett. 2020;5(2):721–8.

Article  Google Scholar 

Eigen D, Puhrsch C, Fergus R. Depth map prediction from a single image using a multi-scale deep network. In: 28th Conference on Neural Information Processing Systems (NIPS), 2014.

Xu D, Ricci E, Ouyang W, et al. Multi-Scale Continuous CRFs as Sequential Deep Networks for Monocular Depth Estimation. In: 30th IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2017;161–169.

Cao Y, Wu Z, Shen C. Estimating depth from monocular images as classification using deep fully convolutional residual networks. Ieee Trans Circ Syst Video Technol. 2018;28(11):3174–82.

Article  Google Scholar 

Fu H, Gong M, Wang C, et al. Deep ordinal regression network for monocular depth estimation. In: 31st IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2018;2002–2011.

Luo C, Yang Z, Wang P, et al. Every pixel counts plus plus : joint learning of geometry and motion with 3D holistic understanding. Ieee Trans Pattern Anal Mach Intell. 2020;42(10):2624–41.

Article  Google Scholar 

Ranjan A, Jampani V, Balles L, et al. Competitive collaboration: joint unsupervised learning of depth, camera motion, optical flow and motion segmentation. In: 32nd IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019;12232–12241.

Casser V, Pirk S, Mahjourian R, et al. Depth Prediction without the Sensors: Leveraging Structure for Unsupervised Learning from Monocular Videos. In: 33rd AAAI Conference on Artificial Intelligence / 31st Innovative Applications of Artificial Intelligence Conference/9th AAAI Symposium on Educational Advances in Artificial Intelligence, 2019;8001–8008.

Liu X, Sinha A, Ishii M, et al. Dense depth estimation in monocular endoscopy with self-supervised learning methods. Ieee Trans Med Imaging. 2020;39(5):1438–47.

Article  Google Scholar 

Spencer J, Bowden R, Hadfield S. Defeat-net: General monocular depth via simultaneous unsupervised representation learning. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2020;14402–14413.

Yang N, Von Stumberg L, Wang R, et al. D3VO: Deep Depth, Deep Pose and Deep Uncertainty for Monocular Visual Odometry. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020; 1278–1289.

Ozyoruk KB, Gokceler GI, Bobrow TL, et al. EndoSLAM dataset and an unsupervised monocular visual odometry and depth estimation approach for endoscopic videos. Med Image Anal. 2021;71:102058.

Article  Google Scholar 

Recasens D, Lamarca J, Facil JM, et al. Endo-depth-and-motion: reconstruction and tracking in endoscopic videos using depth networks and photometric constraints. Ieee Robot Autom Lett. 2021;6(4):7225–32.

Article  Google Scholar 

Eigen D, Fergus R, Ieee. Predicting depth, surface normals and semantic labels with a common multi-scale convolutional architecture. In: IEEE International Conference on Computer Vision, 2015;2650–2658.

Laina I, Rupprecht C, Belagiannis V, et al. Deeper depth prediction with fully convolutional residual networks. In: 4th IEEE International Conference on 3D Vision (3DV), 2016;239–248.

Visentini-Scarzanella M, Sugiura T, Kaneko T, et al. Deep monocular 3D reconstruction for assisted navigation in bronchoscopy. Int J Comput Assist Radiol Surg. 2017;12(7):1089–99.

Article  Google Scholar 

Chen RJ, Bobrow TL, Athey T, et al. Slam endoscopy enhanced by adversarial depth prediction. arXiv preprint arXiv:1907.00283, 2019.

Yang YM, Shao SW, Yang T, et al. A geometry-aware deep network for depth estimation in monocular endoscopy. Eng Appl Artif Intell. 2023;122:105989.

Article  Google Scholar 

Xie J, Girshick R, Farhadi A. Deep3D: fully automatic 2D-to-3D video conversion with deep convolutional neural networks. In: 14th European Conference on Computer Vision (ECCV), 2016;842–857.

Garg R, Vijaykumar B G, Carneiro G, et al. Unsupervised CNN for single view depth estimation: geometry to the rescue. In: 14th European Conference on Computer Vision (ECCV), 2016;740–756.

Godard C, Mac Aodha O, Brostow GJ, et al. Unsupervised monocular depth estimation with left-right consistency. In: 30th IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2017;6602–6611.

Kuznietsov Y, Stuckle J, Leibe B, et al. Semi-supervised deep learning for monocular depth map prediction. In: 30th IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2017;2215–2223.

Luo Y, Ren J, Lin M, et al. Single view stereo matching. In: 31st IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2018;155–163.

Aleotti F, Tosi F, Poggi M, et al. Generative adversarial networks for unsupervised monocular depth prediction. In: Proceedings of the European Conference on Computer Vision (ECCV) Workshops. 2018;0-0.

Pilzer A, Xu D, Puscas MM, et al. Unsupervised adversarial depth estimation using cycled generative networks. In: 6th International Conference on 3D Vision (3DV), 2018;587–595.

Poggi M, Tosi F, Mattoccia S, et al. Learning monocular depth estimation with unsupervised trinocular assumptions. In: 6th International Conference on 3D Vision (3DV), 2018;324–333.

Li R, Wang S, Long Z, et al. UnDeepVO: monocular visual odometry through unsupervised deep learning. IEEE International Conference on Robotics and Automation (ICRA), 2018;7286–7291.

Zhan H, Garg R, Weerasekera C S, et al. Unsupervised learning of monocular depth estimation and visual odometry with deep feature reconstruction. In: 31st IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2018;340–349.

Babu M V, Das K, Majumdar A, et al. UnDEMoN: Unsupervised deep network for depth and ego-motion estimation. In: 25th IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2018;1082–1088.

Poggi M, Aleotti F, Tosi F, et al. Towards real-time unsupervised monocular depth estimation on CPU. In: 25th IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2018;5848–5854.

Zhou T, Brown M, Snavely N, et al. Unsupervised learning of depth and ego-motion from video. In: 30th IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2017;1851–1858.

Turan M, Ornek E P, Ibrahimli N, et al. Unsupervised odometry and depth learning for endoscopic capsule robots. In: 25th IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2018: 1801–1807.

Li L, Li X, Yang S, et al. Unsupervised-learning-based continuous depth and motion estimation with monocular endoscopy for virtual reality minimally invasive surgery. Ieee Trans Ind Inform. 2021;17(6):3920–8.

Article  Google Scholar 

Shao SW, Pei ZC, Chen WH, et al. Self-Supervised monocular depth and ego-motion estimation in endoscopy: appearance flow to the rescue. Med Image Anal. 2022;77:102338.

Article  Google Scholar 

Allan M, Mcleod J, Wang C, et al. Stereo correspondence and reconstruction of endoscopic data challenge. arXiv preprint arXiv:2101.01133, 2021.

Fang Q, Gu X, Yan J, et al. A FCN-based Unsupervised Learning Model for Deformable Chest CT Image Registration. In: IEEE Nuclear Science Symposium / Medical Imaging Conference (NSS/MIC), 2019.

Fang Q, Yan J, Gu X, et al. Unsupervised learning-based deformable registration of temporal chest radiographs to detect interval change. In: Medical Imaging Conference—Image Processing, 2020.

Mur-Artal R, Montiel JMM, Tardos JD. ORB-SLAM: a versatile and accurate monocular SLAM system. Ieee Trans Robot. 2015;31(5):1147–63.

Article  Google Scholar 

留言 (0)

沒有登入
gif