Skip to content

An open-source C++ computer-vision library for plenoptic cameras modeling and processing.

License

Notifications You must be signed in to change notification settings

comsee-research/libpleno

Repository files navigation

banner-logo


The libpleno is an open-source C++ computer-vision library for plenoptic cameras modeling and processing.

Quick Start

Pre-requisites

The libpleno library has a light dependency list:

  • Eigen version >=3, a modern C++ matrix and linear-algebra library,
  • boost version >=1.54 and up, portable C++ source libraries,
  • OpenCV version >=3.2, a collection of algorithms and sample code for various computer vision problems,
  • libv, a general purpose computer vision library developed at Pascal Institute (used for graphic and serialization), modules core, build, geometry and graphic,
  • lma, a non-linear optimization library implementing the Levenberg Marquardt Algorithm,

and was compiled and tested on:

  • Ubuntu 18.04.4 LTS, GCC 7.5.0, with Eigen 3.3.4, Boost 1.65.1, and OpenCV 3.2.0,
  • Ubuntu 20.04.5 LTS, GCC 9.4.0, with Eigen 3.3.7, Boost 1.71.0, and OpenCV 4.2.0.

Please see the file dependencies.txt for more detailled dependencies list. Third-party libraries libv and lma can be found in the corresponding folder ./third_parties/. You can install them from here (warning about ros, catkin and others can be ignored for installation).

Compilation & Installation

If you are comfortable with Linux and CMake and have already installed the prerequisites above, the following commands should install libpleno on your system.

mkdir build && cd build
cmake .. -DUSE_OPEN_MP=true
make -j6
sudo make install

Applications

Currently available applications using the libpleno:

  • COMPOTE (Calibration Of Multi-focus PlenOpTic camEra), a set of tools to pre-calibrate and calibrate (multifocus) plenoptic cameras.
  • PRISM (Plenoptic Raw Image Simulator), a set of tools to generate and simulate raw images from (multifocus) plenoptic cameras.
  • BLADE (Blur Aware Depth Estimation with a plenoptic camera), a set of tools to estimate depth map from raw images obtained by (multifocus) plenoptic cameras.
  • ...

Configuration file examples are given in the folder ./examples/config/ for the datasets R12-A (see below). Observations for the dataset R12-A are also given in the folder ./examples/obs/.

Datasets

  • For calibration, datasets R12-A, R12-B, R12-C, R12-D and UPC-S can be downloaded from here.
  • For depth estimation, datasets R12-E, ES and ELP20 can be downloaded from here.

Citing

If you use libpleno in an academic context, please cite the following publication:

@inproceedings{labussiere2020blur,
  title 	=	{Blur Aware Calibration of Multi-Focus Plenoptic Camera},
  author	=	{Labussi{\`e}re, Mathieu and Teuli{\`e}re, C{\'e}line and Bernardin, Fr{\'e}d{\'e}ric and Ait-Aider, Omar},
  booktitle	=	{Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
  pages		=	{2545--2554},
  year		=	{2020}
}

or

@article{labussiere2022calibration
  title		=	{Leveraging blur information for plenoptic camera calibration},
  author	=	{Labussi{\`{e}}re, Mathieu and Teuli{\`{e}}re, C{\'{e}}line and Bernardin, Fr{\'{e}}d{\'{e}}ric and Ait-Aider, Omar},
  doi		=	{10.1007/s11263-022-01582-z},
  journal	=	{International Journal of Computer Vision},
  year		=	{2022},
  month		=	{may},
  number	=	{2012},
  pages		=	{1--23}
}

or

@article{labussiere2023blade,
  title 	=	{Blur aware metric depth estimation with multi-focus plenoptic cameras},
  author 	=	{Mathieu Labussière and Céline Teulière and Omar Ait-Aider},
  keywords 	=	{Plenoptic Camera, Multi-focus, Calibration, Defocus stereo, Relative blur, Disparity, Metric depth estimation},
  doi 		=	{https://doi.org/10.1016/j.cviu.2023.103802},
  issn 		=	{1077-3142},
  journal 	=	{Computer Vision and Image Understanding},
  year 		=	{2023},
  volume 	=	{235},
  pages 	=	{103802},
  url 		=	{https://www.sciencedirect.com/science/article/pii/S1077314223001820}
}

License

libpleno is licensed under the GNU General Public License v3.0. Enjoy!


About

An open-source C++ computer-vision library for plenoptic cameras modeling and processing.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages