Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

More truthful depth camera noise models #416

Open
peci1 opened this issue Mar 9, 2024 · 1 comment
Open

More truthful depth camera noise models #416

peci1 opened this issue Mar 9, 2024 · 1 comment
Labels
enhancement New feature or request

Comments

@peci1
Copy link
Contributor

peci1 commented Mar 9, 2024

Desired behavior

It wouldn't hurt to implement some more noise models for depth cameras than the completely useless additive Gaussian noise.

I'm not saying I have time to implement them, but I wanted to open the issue to make a space for discussion and possible starting point for contributors who would want to work on that. Maybe next year's GSoC? :)

The first two models I propose are:

  1. Multiplicative Gaussian (the noise is the larger the further the point is).
  2. Sine-wave-like noise corresponding to the error induced by disparity matching in stereo: https://docs.luxonis.com/projects/hardware/en/latest/pages/guides/depth_accuracy .

newplot

Alternatives considered

One could also run a true stereo algorithm on two source cameras, but that would get quite computationally intensive. Moreover, users have the possibility to do that with the currently available implementation, they just need to choose and provide the stereo matching algorithm.

Implementation suggestion

Ideally, the noise models should be implemented as shaders.

The sine-wave-like noise should be parametrized by the camera resolution.

@peci1 peci1 added the enhancement New feature or request label Mar 9, 2024
@azeey azeey moved this from Inbox to To do in Core development May 6, 2024
@azeey
Copy link
Contributor

azeey commented May 6, 2024

Related to gazebosim/gz-sim#2367

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
Status: To do
Development

No branches or pull requests

2 participants