论文标题

Quanta Burst摄影

Quanta Burst Photography

论文作者

Ma, Sizhuo, Gupta, Shantanu, Ulku, Arin C., Bruschini, Claudio, Charbon, Edoardo, Gupta, Mohit

论文摘要

单光子雪崩二极管(SPADS)是一种能够检测单个入射光子的新兴传感器技术,并以高的时序精度捕获了它们的到达时间。尽管过去,这些传感器仅限于单像素或低分辨率设备,但最近已经开发了大型(最多1 mpixel)的Spad阵列。这些单光子相机(SPC)能够捕获没有读取噪声的二进制单光子图像的高速序列。我们提出了Quanta Burst Photography,这是一种计算摄影技术,该技术利用SPC作为在挑战性条件(包括超轻便和快速运动)的摄影的被动成像设备。受传统爆发摄影的最新成功的启发,我们设计了算法,这些算法将SPC捕获的二进制序列与具有最小的运动模糊和伪像,高信噪比(SNR)和高动态范围相结合的二进制序列。我们从理论上分析了Quanta Burst摄影的SNR和动态范围,并确定具有重大好处的成像制度。我们通过最近开发的SPAD数组证明,该提出的方法能够为具有挑战性照明,复杂几何形状,高动态范围和移动对象的场景生成高质量的图像。随着SPAD阵列的持续发展,我们设想在消费者和科学摄影中找到量子爆发摄影的应用。

Single-photon avalanche diodes (SPADs) are an emerging sensor technology capable of detecting individual incident photons, and capturing their time-of-arrival with high timing precision. While these sensors were limited to single-pixel or low-resolution devices in the past, recently, large (up to 1 MPixel) SPAD arrays have been developed. These single-photon cameras (SPCs) are capable of capturing high-speed sequences of binary single-photon images with no read noise. We present quanta burst photography, a computational photography technique that leverages SPCs as passive imaging devices for photography in challenging conditions, including ultra low-light and fast motion. Inspired by recent success of conventional burst photography, we design algorithms that align and merge binary sequences captured by SPCs into intensity images with minimal motion blur and artifacts, high signal-to-noise ratio (SNR), and high dynamic range. We theoretically analyze the SNR and dynamic range of quanta burst photography, and identify the imaging regimes where it provides significant benefits. We demonstrate, via a recently developed SPAD array, that the proposed method is able to generate high-quality images for scenes with challenging lighting, complex geometries, high dynamic range and moving objects. With the ongoing development of SPAD arrays, we envision quanta burst photography finding applications in both consumer and scientific photography.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源