LSHR-Net: A hardware-friendly solution for high-resolution computational imaging using a mixed-weights neural network

Fangliang Bai, Jinchao Liu, Xiaojuan Liu, Margarita Osadchy, Chao Wang, Stuart J. Gibson

Research output: Contribution to journalArticlepeer-review


Recent work showed neural-network based approaches to reconstructing images from compressively sensed measurements offer significant improvements in accuracy and signal compression. Such methods can dramatically boost the capability of computational imaging hardware. However, to date, there have been two major drawbacks: (1) the high-precision real-valued sensing patterns proposed in the majority of existing works can prove problematic when used with computational imaging hardware such as a digital micromirror sampling device and (2) the network structures for image reconstruction involve intensive computation, which is also not suitable for hardware deployment. To address these problems, we propose a novel hardware-friendly solution based on mixed-weights neural networks for computational imaging. In particular, learned binary-weight sensing patterns are tailored to the sampling device. Moreover, we proposed a recursive network structure for low-resolution image sampling and high-resolution reconstruction scheme. It reduces both the required number of measurements and reconstruction computation by operating convolution on small intermediate feature maps. The recursive structure further reduced the model size, making the network more computationally efficient when deployed with the hardware. Our method has been validated on benchmark datasets and achieved state of the art reconstruction accuracy. We tested our proposed network in conjunction with a proof-of-concept hardware setup.

Original languageEnglish
Pages (from-to)169-181
Number of pages13
StatePublished - 17 Sep 2020

Bibliographical note

Publisher Copyright:
© 2020


  • Binary weights
  • Computational imaging
  • Image reconstruction
  • Neural network
  • Single pixel camera
  • Super resolution

ASJC Scopus subject areas

  • Computer Science Applications
  • Cognitive Neuroscience
  • Artificial Intelligence


Dive into the research topics of 'LSHR-Net: A hardware-friendly solution for high-resolution computational imaging using a mixed-weights neural network'. Together they form a unique fingerprint.

Cite this