Scientists Invent a Camera That Can See Through or Around Anything

A setup of one of the prototypes in the laboratory is shown.

Researchers from Northwestern’s Engineering department have invented a new high-resolution camera that can see around corners and through objects — even skin, fog, or a human skull.

The process is called synthetic wavelength holography, and it’s a new method that works by indirectly scattering light onto hidden objects, which then scatters again and travels back to the camera. An algorithm then reconstructs that scattered light signal in a way that reveals hidden objects. The team says that due to its high temporal resolution, the method also could potentially see fast-moving objects like cars speeding around corners or the human heart beating through a chest.

The idea of photographing or visualizing a subject around a corner versus seeing an organ inside a human body may sound like completely different challenges that would require different solutions, but the team says that they are actually closely related, since both deal with scattering media in which light hits an object and scatters in a manner that a direct image of the object can no longer be seen.

Synthetic wavelength holography is part of a new field of research called non-line-of-sight (NLoS) imaging. The method developed by the Northwestern researchers can rapidly photograph full-field images of large areas with what they describe as submillimeter precision.

Schematics of SWH for NLoS imaging around corners and NLoS imaging through scattering media.

“With this level of resolution, the computational camera could potentially image through the skin to see even the tiniest capillaries at work,” Northwestern’s Amanda Morris writes.

While the team says that the obvious use cases for the technology exist in medical imaging, they also argue that it could be used as an early-warning tool in car navigation systems or industrial inspection in small spaces. The team says that possible applications are “endless.”

example use cases of synthetic wavelength holography
The SWH approach combines four key attributes highlighted in the following potential future NLoS application scenarios: in each example, a scattering surface or medium is used to indirectly illuminate, and intercept light scattered by the hidden objects. a) A small probing area allows to inspect defects in tightly confined spaces, e.g., in running aircraft engines. b) A wide angular FoV allows to measure/detect hidden objects without previous knowledge of their position as, e.g., important when navigating in degraded visual environments. c) High spatial resolution allows for the measurement of small structures, such as non-invasive imaging of brain vessels through the skull. d) High temporal resolution allows to image objects in motion, e.g., to discern cardiac arrhythmia through the chest. The integration of these attributes in a single approach to NLoS imaging distinguishes SWH from the current state of the art.

“Our technology will usher in a new wave of imaging capabilities,” says Florian Willomitzer from the McCormick School of Engineering and the first author of the study.

“Our current sensor prototypes use visible or infrared light, but the principle is universal and could be extended to other wavelengths. For example, the same method could be applied to radio waves for space exploration or underwater acoustic imaging. It can be applied to many areas, and we have only scratched the surface.”

A detailed breakdown of how the team designed and built the camera can be found on Northwestern University’s website as well as on the full research paper published on Nature.


Image credits: Header image via Northwestern University, by Florian Willomitzer/Northwestern University

Discussion