Real time full-color imaging in a Meta-optical fiber endoscope

Johannes E. Fröch; Luocheng Huang; Quentin A.A. Tanguy; Shane Colburn; Alan Zhan; Andrea Ravagli; Eric J. Seibel; Karl F. Böhringer; Arka Majumdar

doi:10.1186/s43593-023-00044-4

Your Location：

Home >

Browse articles >

Real time full-color imaging in a Meta-optical fiber endoscope

eLight Vol. 3, Issue 1, (2023)

RESEARCH ARTICLE | Updated：2024-09-25

- Real time full-color imaging in a Meta-optical fiber endoscope
- Affiliations：
  
  Department of Physics, University of Washington, Seattle, WA 98195, USA
  Department of Electrical and Computer Engineering, University of Washington, Seattle, WA 98195, USA
  Tunoptix, Fluke Hall, 4000 Mason Road 300, WA 98195Seattle, USA
  SCHOTT North America, Inc., Southbridge, MA 01550, USA
  Department of Mechanical Engineering, University of Washington, Seattle, WA 98195, USA
  Department of Bioengineering, University of Washington, Seattle, WA 98195, USA
  Institute for Nano-Engineered Systems, University of Washington, Seattle, WA 98195, USA
- Author bio：
  
  *Johannes E. Fröchjfroech@uw.edu
  Arka Majumdararka@uw.edu
- Funds：
- DOI：10.1186/s43593-023-00044-4
  CLC：
- Published：2023，
  
  Published Online：07 June 2023，
  
  Received：06 December 2022，
  
  Revised：11 April 2023，
  
  Accepted：15 April 2023
- Accepted：
Scan QR Code
Johannes E. Fröch, Luocheng Huang, Quentin A.A. Tanguy, et al. Real time full-color imaging in a Meta-optical fiber endoscope. [J]. eLight, 2023,3(1).
DOI：

Johannes E. Fröch, Luocheng Huang, Quentin A.A. Tanguy, et al. Real time full-color imaging in a Meta-optical fiber endoscope. [J]. eLight, 2023,3(1). DOI： 10.1186/s43593-023-00044-4.

摘要

Abstract

Endoscopes are an important component for the development of minimally invasive surgeries. Their size is one of the most critical aspects

because smaller and less rigid endoscopes enable higher agility

facilitate larger accessibility

and induce less stress on the surrounding tissue. In all existing endoscopes

the size of the optics poses a major limitation in miniaturization of the imaging system. Not only is making small optics difficult

but their performance also degrades with downscaling. Meta-optics have recently emerged as a promising candidate to drastically miniaturize optics while achieving similar functionalities with significantly reduced size. Herein

we report an inverse-designed meta-optic

which combined with a coherent fiber bundle enables a 33% reduction in the rigid tip length over traditional gradient-index (GRIN) lenses. We use the meta-optic fiber endoscope (MOFIE) to demonstrate real-time video capture in full visible color

the spatial resolution of which is primarily limited by the fiber itself. Our work shows the potential of meta-optics for integration and miniaturization of biomedical devices towards minimally invasive surgery.

关键词

Keywords

EndoscopyMeta-opticsNano-fabricationBiomedical engineering

references

B.A. Flusberg, E.D. Cocker, W. Piyawattanametha, J.C. Jung, E.L.M. Cheung, M.J. Schnitzer, Fiber-optic fluorescence imaging. Nat. Methods2, 941-950(2005)

C.M. Lee, C.J. Engelbrecht, T.D. Soper, F. Helmchen, E.J. Seibel, Scanning fiber endoscopy with highly flexible, 1 mm catheterscopes for wide-field, full-color imaging. J. Biophotonics3, 385-407 (2010)

A. Perperidis, K. Dhaliwal, S. McLaughlin, T. Vercauteren, Image computing for fibre-bundle endomicroscopy: a review. Med. Image. Anal62, 101620(2020)

A. Shadfan, A. Hellebust, R. Richards-Kortum, T. Tkaczyk, Confocal foveated endomicroscope for the detection of esophageal carcinoma. Biomed. Opt. Express BOE6, 2311-2324 (2015)

A. Shadfan, H. Darwiche, J. Blanco, A. Gillenwater, R. Richards-Kortum, T.S. Tkaczyk, Development of a multimodal foveated endomicroscope for the detection of oral cancer. Biomed. Opt. Express BOE8, 1525-1535 (2017)

J. Park, D.J. Brady, G. Zheng, L. Tian, L. Gao, Review of bio-optical imaging systems with a high space-bandwidth product. A.P3, 044001(2021)

P. Caramazza, O. Moran, R. Murray-Smith, D. Faccio, Transmission of natural scene images through a multimode fibre. Nat. Commun. 10, 2029 (2019)

Z. Liu, L. Wang, Y. Meng, T. He, S. He, Y. Yang, L. Wang, J. Tian, D. Li, P. Yan, M. Gong, Q. Liu, Q. Xiao, All-fiber high-speed image detection enabled by deep learning. Nat. Commun. 13, 1433 (2022)

L. Wang, Y. Yang, Z. Liu, J. Tian, Y. Meng, T. Qi, T. He, D. Li, P. Yan, M. Gong, Q. Liu, Q. Xiao, High-speed all-Fiber micro-imaging with large depth of field. Laser Photonics Rev16, 2100724 (2022)

J. Shin, D.N. Tran, J.R. Stroud, S. Chin, T.D. Tran, M.A. Foster, A minimally invasive lens-free computational microendoscope. Sci. Adv5, eaaw5595 (2019)

N. Badt, O. Katz, Real-time holographic lensless micro-endoscopy through flexible fibers via fiber bundle distal holography. Nat. Commun. 13, 6055 (2022)

A. Orth, M. Ploschner, E.R. Wilson, I.S. Maksymov, B. C. Gibson, Optical fiber bundles: ultra-slim light field imaging probes. Sci. Adv5, eaav1555 (2019)

W. Choi, M. Kang, J.H. Hong, O. Katz, B. Lee, G.H. Kim, Y. Choi, W. Choi, Flexible-type ultrathin holographic endoscope for microscopic imaging of unstained biological tissues. Nat. Commun. 13, 4469 (2022)

H. Li, Z. Hao, J. Huang, T. Lu, Q. Liu, L. Fu, 500 µm field-of-view probe-based confocal microendoscope for large-area visualization in the gastrointestinal tract. Photon Res. PRJ9, 1829-1841 (2021)

T. Gissibl, S. Thiele, A. Herkommer, H. Giessen, Two-photon direct laser writing of ultracompact multi-lens objectives. Nat. Photon10, 554-560(2016)

J. Li, S. Thiele, B.C. Quirk, R.W. Kirk, J.W. Verjans, E. Akers, C.A. Bursill, S.J. Nicholls, A.M. Herkommer, H. Giessen, R.A. McLaughlin, Ultrathin monolithic 3D printed optical coherence tomography endoscopy for preclinical and clinical use. Light Sci. Appl. 9, 124 (2020)

N. Yu, F. Capasso, Flat optics with designer metasurfaces. Nat. Mater13, 139-150 (2014)

M.K. Chen, Y. Wu, L. Feng, Q. Fan, M. Lu, T. Xu, D.P. Tsai, Principles, functions, and applications of Optical Meta-Lens. Adv. Opt. Mater. 9, 2001414 (2021)

S. Colburn, A. Zhan, A. Majumdar, Metasurface optics for full-color computational imaging. Sci. Adv4, eaar2114 (2018)

C. Munley, W. Ma, J.E. Fröch, Q.A.A. Tanguy, E. Bayati, K.F. Böhringer, Z. Lin, R. Pestourie, S.G. Johnson, A. Majumdar, Inverse-designed meta-optics with spectral-spatial engineered response to mimic color perception. Adv. Opt. Mater10, 2200734 (2022)

A. Arbabi, Y. Horie, M. Bagheri, A. Faraon, Dielectric metasurfaces for complete control of phase and polarization with subwavelength spatial resolution and high transmission. Nat. Nanotech10, 937-943 (2015)

M. Piccardo, V. Ginis, A. Forbes, S. Mahler, A.A. Friesem, N. Davidson, H. Ren, A.H. Dorrah, F. Capasso, F.T. Dullo, B.S. Ahluwalia, A. Ambrosio, S. Gigan, N. Treps, M. Hiekkamäki, R. Fickler, M. Kues, D. Moss, R. Moran-dotti, J. Riemensberger, T.J. Kippenberg, J. Faist, G. Scalari, N. Picqué, T.W. Hänsch, G. Cerullo, C. Manzoni, L.A. Lugiato, M. Brambilla, L. Columbo, A. Gatti, F. Prati, A. Shiri, A.F. Abouraddy, A. Alù, E. Galiffi, J.B. Pendry, P.A. Hui-dobro, Roadmap on multimode light shaping. J. Opt. 24, 013001 (2021)

S.C. Malek, A.C. Overvig, A. Alù, N. Yu, Multifunctional resonant wavefront-shaping meta-optics based on multilayer and multi-perturbation nonlocal metasurfaces. Light Sci. Appl. 11, 246 (2022)

Z. Lin, R. Pestourie, C. Roques-Carmes, Z. Li, F. Capasso, M. Soljačić, M. Soljačić, S.G. Johnson, End-to-end metasurface inverse design for single-shot multi-channel imaging. Opt. Express OE30, 28358-28370 (2022)

S. Colburn, A. Zhan, E. Bayati, J. Whitehead, A. Ryou, L. Huang, A. Majumdar, Broadband transparent and CMOS-compatible flat optics with silicon nitride metasurfaces [Invited]. Opt. Mater. Express OME8, 2330-2344(2018)

J.-S. Park, S. Zhang, A. She, W.T. Chen, P. Lin, K.M.A. Yousef, J.-X. Cheng, F. Capasso, All-Glass, large metalens at visible Wavelength using Deep-Ultraviolet Projection Lithography. Nano Lett.19, 8673-8682 (2019)

L. Zhang, S. Chang, X. Chen, Y. Ding, M.T. Rahman, Y. Duan, M. Stephen, X. Ni, High-Efficiency, 80 mm aperture Metalens Telescope. Nano Lett.23, 51-57 (2023)

H. Ren, J. Jang, C. Li, A. Aigner, M. Plidschun, J. Kim, J. Rho, M.A. Schmidt, S.A. Maier, An achromatic metafiber for focusing and imaging across the entire telecommunication range. Nat. Commun. 13, 4183 (2022)

M. Plidschun, H. Ren, J. Kim, R. Förster, S.A. Maier, M.A. Schmidt, Ultrahigh numerical aperture meta-fibre for flexible optical trapping. Light Sci. Appl. 10, 57 (2021)

H. Pahlevaninezhad, M. Khorasaninejad, Y.-W. Huang, Z. Shi, L.P. Hariri, D.C. Adams, V. Ding, A. Zhu, C.-W. Qiu, F. Capasso, M.J. Suter, Nano-optic endoscope for high-resolution optical coherence tomography in vivo. Nat. Photon12, 540-547 (2018)

N. Xie, M.D. Carson, J.E. Fröch, A. Majumdar, E. Seibel, K.F. Böhringer, Large FOV short-wave infrared meta-lens for scanning fiber endoscopy. arXiv(2022). https://doi.org/10.48550/arXiv.2212.11272https://doi.org/10.48550/arXiv.2212.11272

E. Tseng, S. Colburn, J. Whitehead, L. Huang, S.-H. Baek, A. Majumdar, F. Heide, Neural nano-optics for high-quality thin lens imaging. Nat. Commun. 12, 6493 (2021)

L. Huang, J. Whitehead, S. Colburn, A. Majumdar, A. Majumdar, Design and analysis of extended depth of focus metalenses for achromatic computational imaging. Photon Res. PRJ8, 1613-1623 (2020)

L. Huang, S. Colburn, A. Zhan, A. Majumdar, Full-Color metaoptical imaging in visible light. Adv. Photo. Res. (2022). https://doi.org/10.1002/adpr.202100265https://doi.org/10.1002/adpr.202100265

W.T. Chen, A.Y. Zhu, V. Sanjeev, M. Khorasaninejad, Z. Shi, E. Lee, F. Capasso, A broadband achromatic metalens for focusing and imaging in the visible. Nat. Nanotech13, 220-226 (2018)

S. Wang, P.C. Wu, V.-C. Su, Y.-C. Lai, M.-K. Chen, H.Y. Kuo, B.H. Chen, Y.H. Chen, T.-T. Huang, J.-H. Wang, R.-M. Lin, C.-H. Kuan, T. Li, Z. Wang, S. Zhu, D.P. Tsai, A broadband achromatic metalens in the visible. Nat. Nanotech13, 227-232 (2018)

W.T. Chen, A.Y. Zhu, F. Capasso, Flat optics with dispersion-engineered metasurfaces. Nat. Rev. Mater. 5, 604-620 (2020)

W. Zang, Q. Yuan, R. Chen, L. Li, T. Li, X. Zou, G. Zheng, Z. Chen, S. Wang, Z. Wang, S. Zhu, Chromatic dispersion manipulation based on Metalenses. Adv. Mater32, 1904935 (2020)

F. Presutti, F. Monticone, Focusing on bandwidth: achromatic metalens limits. Optica7, 624-631 (2020)

J. Engelberg, U. Levy, Achromatic flat lens performance limits. Optica8, 834-845 (2021)

M.Y. Shalaginov, S. An, F. Yang, P. Su, D. Lyzwa, A.M. Agarwal, H. Zhang, J. Hu, T. Gu, Single-element diffraction-limited fisheye metalens. Nano Lett20, 7429-7437 (2020)

J. Engelberg, C. Zhou, N. Mazurski, J. Bar-David, A. Kristensen, U. Levy, Near-IR wide-field-of-view Huygens metalens for outdoor imaging applications. Nanophotonics9, 361-370 (2020)

Y. Liu, Q.-Y. Yu, Z.-M. Chen, H.-Y. Qiu, R. Chen, S.-J. Jiang, X.-T. He, X.-T. He, F.-L. Zhao, F.-L. Zhao, J.-W. Dong, Meta-objective with sub-micrometer resolution for microendoscopes. Photon Res. PRJ9, 106-115 (2021)

E. Arbabi, A. Arbabi, S.M. Kamali, Y. Horie, A. Faraon, Multiwavelength polarization-insensitive lenses based on dielectric metasurfaces with meta-molecules. Optica3, 628-633 (2016)

E. Bayati, R. Pestourie, S. Colburn, Z. Lin, S.G. Johnson, A. Majumdar, Inverse designed extended depth of focus meta-optics for broadband imaging in the visible. Nanophotonics (2021). doi:https://doi.org/10.1515/nanoph-2021-0431https://doi.org/10.1515/nanoph-2021-0431

P. Mouches, N.D. Forkert, A statistical atlas of cerebral arteries generated using multi-center MRA datasets from healthy subjects. Sci. Data6, 29(2019)

J.T. Dodge Jr, B.G. Brown, E.L. Bolson, H.T. Dodge, Lumen diameter of normal human coronary arteries. Influence of age, sex, anatomic variation, and left ventricular hypertrophy or dilation. Circulation 86, 232-246(1992)

R.J. Lin, V.-C. Su, S. Wang, M.K. Chen, T.L. Chung, Y.H. Chen, H.Y. Kuo, J.-W. Chen, J. Chen, Y.-T. Huang, J.-H. Wang, C.H. Chu, P.C. Wu, T. Li, Z. Wang, S. Zhu, D.P. Tsai, Achromatic metalens array for full-colour light-field imaging. Nat. Nanotechnol14, 227-231 (2019)

Z. Li, R. Pestourie, J.-S. Park, Y.-W. Huang, S.G. Johnson, F. Capasso, Inverse design enables large-scale high-performance meta-optics reshaping virtual reality. Nat. Commun. 13, 2409 (2022)

W. Feng, J. Zhang, Q. Wu, A. Martins, Q. Sun, Z. Liu, Y. Long, E.R. Martins, J. Li, H. Liang, RGB achromatic metalens doublet for digital imaging. Nano Lett22, 3969-3975 (2022)

J. Chen, J. Chen, X. Ye, X. Ye, S. Gao, S. Gao, Y. Chen, Y. Chen, Y. Zhao, Y. Zhao, C. Huang, K. Qiu, S. Zhu, S. Zhu, T. Li, T. Li, Planar wide-angle-imaging camera enabled by metalens array. Optica9, 431-437 (2022)

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Publicity Resources

No data

Related Author

No data

Related Institution

No data

⁰