Mask-based lensless face recognition system with dual-prior face restoration

Antipa, N., Kuo, G., Heckel, R., Mildenhall, B., Bostan, E., Ng, R., Waller, L.: DiffuserCam: lensless single-exposure 3D imaging. Optica 5(1), 1–9 (2018)

Article  ADS  Google Scholar 

Anushka, R., Jagadish, S., Satyanarayana, V., Singh, M.K.: Lens less cameras for face detection and verification. In: 2021 6th International Conference on Signal Processing, Computing and Control (ISPCC), pp. 242–246. IEEE (2021)

Asif, M.S., Ayremlou, A., Sankaranarayanan, A., Veeraraghavan, A., Baraniuk, R.G.: FlatCam: thin, lensless cameras using coded aperture and computation. IEEE Trans. Comput. Imaging 3(3), 384–397 (2016)

Article  MathSciNet  Google Scholar 

Boominathan, V., Adams, J.K., Asif, M.S., Avants, B.W., Robinson, J.T., Baraniuk, R.G., Sankaranarayanan, A.C., Veeraraghavan, A.: Lensless imaging: a computational renaissance. IEEE Signal Process. Mag. 33(5), 23–35 (2016)

Article  ADS  Google Scholar 

Boominathan, V., Robinson, J.T., Waller, L., Veeraraghavan, A.: Recent advances in lensless imaging. Optica 9(1), 1–16 (2022)

Article  ADS  Google Scholar 

Chen, C., Li, X., Yang, L., Lin, X,., Zhang, L., Wong, K.-Y.: Progressive semantic-aware style transformation for blind face restoration. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 1–21. IEEE Computer Society (2021)

Chen, Y., Tai, Y., Liu, X., Shen, C., Yang, J.: FSRNet: end-to-end learning face super-resolution with facial priors. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2492–2501. IEEE Computer Society (2018)

Fawcett, T.: An introduction to ROC analysis. Pattern Recognit. Lett. 27(8), 861–874 (2006)

Article  ADS  MathSciNet  Google Scholar 

Gera, D., Balasubramanian, S.: Facial expression recognition with FlatCAM lensless imaging. In: Proceedings of International Conference on Data Science and Applications: ICDSA 2021, Volume 2, pp. 661–677. Springer (2022)

Guo, S., Yan, Z., Zhang, K., Zuo, W., Zhang, L.: Toward convolutional blind denoising of real photographs. In: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1712–1722 (2019)

Henry, C., Asif, M.S., Li, Z.: Privacy preserving face recognition with lensless camera. In: ICASSP 2023—2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1–5 (2023)

Karras, T., Laine, S., Aila, T.: A style-based generator architecture for generative adversarial networks. In: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4396–4405 (2018)

Karras, T., Laine, S., Aittala, M., Hellsten, J., Lehtinen, J., Aila, T.: Analyzing and improving the image quality of stylegan. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 8107–8116 (2019)

Khan, S.S., Sundar, V., Boominathan, V., Veeraraghavan, A., Mitra, K.: FlatNet: towards photorealistic scene reconstruction from lensless measurements. IEEE Trans. Pattern Anal. Mach. Intell. 44(4), 1934–1948 (2020)

Google Scholar 

Menon, S., Damian, A., Hu, S., Ravi, N., Rudin, C.: Pulse: Self-supervised photo upsampling via latent space exploration of generative models. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2434–2442 (2020)

Monakhova, K., Yurtsever, J., Kuo, G., Antipa, N., Yanny, K., Waller, L.: Learned reconstructions for practical mask-based lensless imaging. Opt. Express 27(20), 28075–28090 (2019)

Article  ADS  Google Scholar 

Nguyen Canh, T., Nagahara, H.: Deep compressive sensing for visual privacy protection in FlatCam imaging. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) Workshops (2019)

Ozcan, A., McLeod, E.: Lensless imaging and sensing. Annu. Rev. Biomed. Eng. 18, 77–102 (2016)

Article  Google Scholar 

Pan, X., Chen, X., Nakamura, T., Yamaguchi, M.: Incoherent reconstruction-free object recognition with mask-based lensless optics and the transformer. Opt. Express 29(23), 37962–37978 (2021)

Article  ADS  Google Scholar 

Pan, X., Chen, X., Takeyama, S., Yamaguchi, M.: Image reconstruction with transformer for mask-based lensless imaging. Opt. Lett. 47(7), 1843–1846 (2022)

Article  ADS  Google Scholar 

Pan, X., Nakamura, T., Chen, X., Yamaguchi, M.: Lensless inference camera: incoherent object recognition through a thin mask with LBP map generation. Opt. Express 29(7), 9758–9771 (2021)

Article  ADS  Google Scholar 

Richardson, E., Alaluf, Y., Patashnik, O., Nitzan, Y., Azar, Y., Shapiro, S., Cohen-Or, D.: Encoding in style: a stylegan encoder for image-to-image translation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2287–2296 (2021)

Ronneberger, O., Fischer, P., Brox, T.: U-net: Convolutional networks for biomedical image segmentation. In: Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5–9, 2015, Proceedings, Part III 18, pp. 234–241. Springer (2015)

Shimano, T., Nakamura, Y., Tajima, K., Sao, M., Hoshizawa, T.: Lensless light-field imaging with Fresnel zone aperture: quasi-coherent coding. Appl. Opt. 57(11), 2841–2850 (2018)

Article  ADS  Google Scholar 

Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)

Tan, J., Niu, L., Adams, J.K., Boominathan, V., Robinson, J.T., Baraniuk, R.G., Veeraraghavan, A.: Face detection and verification using lensless cameras. IEEE Trans. Comput. Imaging 5(2), 180–194 (2019)

Article  Google Scholar 

Tian, F., Yang, W.: Learned lensless 3D camera. Opt. Express 30(19), 34479–34496 (2022)

Article  ADS  Google Scholar 

Wang, T.C., Liu, M.Y., Zhu, J.Y., Tao, A., Kautz, J., Catanzaro, B.: High-resolution image synthesis and semantic manipulation with conditional GANs, pp. 8798–8807 (2017)

Wang, X., Li, Y., Zhang, H., Shan, Y.: Towards real-world blind face restoration with generative facial prior. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 9168–9178 (2021)

Wen, Y., Zhang, K., Li, Z., Qiao, Y.: A discriminative feature learning approach for deep face recognition. In: Computer Vision—ECCV 2016, pp. 499–515. Springer International Publishing (2016)

Wu, J., Cao, L., Barbastathis, G.: DNN-FZA camera: a deep learning approach toward broadband FZA lensless imaging. Opt. Lett. 46(1), 130–133 (2021)

Article  ADS  Google Scholar 

Wu, M.H., Lee, Y.T.C., Tien, C.H.: Lensless facial recognition with encrypted optics and a neural network computation. Appl. Opt. 61(26), 7595–7601 (2022)

Article  ADS  Google Scholar 

Yang, T., Ren, P., Xie, X., Zhang, L.: GAN prior embedded network for blind face restoration in the wild. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 672–681 (2021)

Yu, X., Fernando, B., Ghanem, B., Porikli, F., Hartley, R.: Face super-resolution guided by facial component heatmaps. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) Computer Vision—ECCV 2018, pp. 219–235. Springer International Publishing, Cham (2018)

Chapter  Google Scholar 

Zeng, T., Lam, E.Y.: Robust reconstruction with deep learning to handle model mismatch in lensless imaging. IEEE Trans. Comput. Imaging 7, 1080–1092 (2021)

Article  MathSciNet  Google Scholar 

Zhang, K., Zhang, Z., Li, Z., Qiao, Y.: Joint face detection and alignment using multitask cascaded convolutional networks. IEEE Signal Process. Lett. 23(10), 1499–1503 (2016)

Article  ADS  Google Scholar 

Zhang, Y., Wu, Z., Lin, P., Wu, Y., Wei, L., Huang, Z., Huangfu, J.: Text detection and recognition based on a lensless imaging system. Appl. Opt. 61(14), 4177–4186 (2022)

Article  ADS  Google Scholar 

Zhou, H., Feng, H., Xu, W., Xu, Z., Li, Q., Chen, Y.: Deep denoiser prior based deep analytic network for lensless image restoration. Opt. Express 29(17), 27237–27253 (2021)

Article  ADS  Google Scholar 

Comments (0)

No login
gif