Abstract
Human pose and shape (HPS) estimation with lensless imaging is not onlybeneficial to privacy protection but also can be used in covert surveillancescenarios due to the small size and simple structure of this device. However,this task presents significant challenges due to the inherent ambiguity of thecaptured measurements and lacks effective methods for directly estimating humanpose and shape from lensless data. In this paper, we propose the firstend-to-end framework to recover 3D human poses and shapes from lenslessmeasurements to our knowledge. We specifically design a multi-scale lenslessfeature decoder to decode the lensless measurements through the opticallyencoded mask for efficient feature extraction. We also propose a double-headauxiliary supervision mechanism to improve the estimation accuracy of humanlimb ends. Besides, we establish a lensless imaging system and verify theeffectiveness of our method on various datasets acquired by our lenslessimaging system.