Full-Volume 3D Fluid Flow Reconstruction with Light Field PIV

1Louisiana State University, 2InnoPeak Technology, 3Tencent Pixel Lab, 4ShanghaiTech University, 5George Mason University

Abstract


Particle Imaging Velocimetry (PIV) is a classical method that estimates fluid flow by analyzing the motion of injected particles. To reconstruct and track the swirling particles is a difficult computer vision problem, as the particles are dense in the fluid volume and have similar appearances. Further, tracking a large number of particles is particularly challenging due to heavy occlusion. Here we present a low-cost PIV solution that uses compact lenslet-based light field cameras as imaging device. We develop novel optimization algorithms for dense particle 3D reconstruction and tracking. As a single light field camera has limited capacity in resolving depth (z-dimension measurement), the resolution of 3D reconstruction on the x-y plane is much higher than along the z-axis. To compensate for the imbalanced resolution in 3D, we use two light field cameras positioned at an orthogonal angle to capture particle images. In this way, we can achieve high-resolution 3D particle reconstruction in the full fluid volume. For each time frame, we first estimate particle depths under a single viewpoint by exploiting the focal stack symmetry of light field. We then fuse the recovered 3D particles in two views by solving a linear assignment problem (LAP). Specifically, we propose an anisotropic point-to-ray distance as matching cost to handle the resolution mismatch. Finally, given a sequence of 3D particle reconstructions over time, we recover the full-volume 3D fluid flow with a physically-constrained optical flow, which enforces local motion rigidity and fluid incompressibility. We perform comprehensive experiments on synthetic and real data for ablation and evaluation. We show that our method recovers full-volume 3D fluid flows of various types. Two-view reconstruction results achieves higher accuracy than those with one view only.

BibTeX

@InProceedings{li20203d,
  author    = {Li, Zhong and Ji, Yu and Yu, Jingyi and Ye, Jinwei},
  title     = {3D Fluid Flow Reconstruction Using Compact Light Field PIV},
  booktitle = {European Conference on Computer Vision},
  year      = {2020},
  }
@ARTICLE{Ding2020,
  author    = {Ding, Yuqi and Li, Zhong and Chen, Zhang and Ji, Yu and Yu, Jingyi and Ye, Jinwei}, 
  title     = {Full-Volume 3D Fluid Flow Reconstruction With Light Field PIV}, 
  journal   = {IEEE Transactions on Pattern Analysis and Machine Intelligence}, 
  year      = {2023},
  pages     = {1-14},
  doi       = {10.1109/TPAMI.2023.3236344},
  }