feat: extract and publish realsense Sensor data #654

hemanth-vs · 2025-01-28T05:26:18Z

PR Checklist

[ x] Added label to the Pull Request for easier discoverability and search
[x ] Commit Message meets guidelines as indicated in the URL https://github.com/intel-retail/automated-self-checkout/blob/main/CONTRIBUTING.md
[ x] Every commit is a single defect fix and does not mix feature addition or changes
[ x] Unit Tests have been added for new changes
[x ] Updated Documentation as relevant to the changes
[ x] All commented code has been removed
[x ] If you've added a dependency, you've ensured license is compatible with repository license and clearly outlined the added dependency.
PR change contains code related to security
PR introduces changes that breaks compatibility with other modules (If YES, please provide details below)

What are you changing?

We worked on a feature that extracts height, weight and depth data from RealSense Sensor. It publishes the data to Kafka, Grafana, Microservice. The data can be extracted using 'push' of the publishers as mentioned in the main file 'pollRealSenseSensor.py'.

Issue this PR will close

close: #538

Anything the reviewer should know when reviewing this PR?

We utilized Docker image. All the requirements and information pertaining to this issue and docker are mentioned in the RealSenseReadme.md.

Test Instructions if applicable

All the required instructions are outlined in the RealSenseReadme.md which is present in the sub directory '/src/RealSenseExtractor'.

If the there are associated PRs in other repositories, please link them here (i.e. intel-retail/automated-self-checkout )

added code to pull data from RealSense

boiler plate code for publishing sensor info

pushing to InfluxDb for Graphana

Develop hemanth

pushing to microservice

…-checkout into develop

Develop

sakethr16 · 2025-01-28T05:41:20Z

We developed a Feature to address the intermediate issue #538.

PS :- Mentioning it here since we unable to tag the labels.

NeethuES-intel

@sakethr16 @hemanth-vs @Hemanth-byte I left comments in the code.
One comment on the PR title, can you change it to follow the git conventional commit format -
https://github.com/intel-retail/automated-self-checkout/blob/main/CONTRIBUTING.md

<type>(<scope>): <subject>
<BLANK LINE>
<body>
<BLANK LINE>
<footer>

type here should be feat, instead of issue #538

src/RealSenseExtractor/GraphanaPublisher.py

src/RealSenseExtractor/KafkaCore.py

src/RealSenseExtractor/KafkaPublisher.py

src/RealSenseExtractor/MicroServicePublisher.py

src/RealSenseExtractor/README.md

src/RealSenseExtractor/Publisher.py

src/RealSenseExtractor/UnitTests/GraphanaPublisherTest.py

src/RealSenseExtractor/UnitTests/KafkaPublisherTest.py

src/RealSenseExtractor/UnitTests/MicroServicePublisherTest.py

src/RealSenseExtractor/pollRealSenseSensor.py

Data is being extracted from RealSensor and is getting published to Multiple SOurces such as Kafka, grafana or other microServices

dquote> dquote> Data is being extracted from RealSensor and is getting published to Multiple SOurces such as Kafka, grafana or other microServices dquote> dquote> dquote>

sakethr16 · 2025-01-30T00:38:32Z

@NeethuES-intel We are not able to modify the PR Title, do you want us to raise another fresh PR?

NeethuES-intel · 2025-01-30T04:01:53Z

@NeethuES-intel We are not able to modify the PR Title, do you want us to raise another fresh PR?

@sakethr16 ok, done.

NeethuES-intel · 2025-01-30T04:32:58Z

src/RealSenseExtractor/README.md

+## How to Run
+
+### 1. Build the Docker Image
+```bash


can you create a Makefile under src/RealSenseExtractor and add these as simple make commands eg -

automated-self-checkout/Makefile

Created a Makefile.

NeethuES-intel · 2025-01-30T04:33:23Z

src/RealSenseExtractor/README.md

+## Configuration
+
+Before running the service, ensure that the appropriate values are set in the `RealSenseConfig.json` file. This configuration file defines the necessary details for:
+- RealSense camera settings


can I run your code without a realsense camera ?

No @NeethuES-intel , We cant run with realsense camera

antoniomtz · 2025-01-31T04:33:50Z

src/RealSenseExtractor/Dockerfile

+FROM python:3.9-slim
+
+# Set environment variables to ensure Python runs in non-buffered and UTF-8 mode
+ENV PYTHONDONTWRITEBYTECODE 1


LegacyKeyValueFormat: "ENV key=value" should be used instead of legacy "ENV key value" format

Updated the docker file.

ejlee3 · 2025-01-31T20:09:14Z

src/RealSenseExtractor/GraphanaPublisher.py

+from datetime import datetime
+import json
+
+class GraphanaPublisher(Publisher):


Please fix the spelling of Grafana in the file names, files, etc where applicable.

Suggested change

class GraphanaPublisher(Publisher):

class GrafanaPublisher(Publisher):

Updated the file names.

ejlee3 · 2025-01-31T20:10:45Z

src/RealSenseExtractor/RealSenseConfig.json

@@ -0,0 +1,20 @@
+{
+    "Graphana" : {


can you configure this to use a local instance of grafana/influxdb - can set everything up in a docker compose file?

We configured it to the user local instance of grafana and influx.

NeethuES-intel

@sakethr16 @Hemanth-byte @hemanth-vs I don't have a realsense camera to test. However I tried to run unit tests with make test but getting error. Not seeing the dashboard on grafana after running make up and I don't see any data coming through the grafana topics when I subscribe using an mqtt client.

sakethr16 and others added 19 commits January 26, 2025 21:05

flask starter code

d730a26

added code to pull data from RealSense

f8afa7c

Merge pull request #1 from sakethr16/develop-hemanth

f3a6b39

added code to pull data from RealSense

boiler plate code for publishing sensor info

a860f9f

Merge pull request #2 from sakethr16/develop-hemanth

e52c1a5

boiler plate code for publishing sensor info

adding kafka publishing functionality

1241a81

pushing to InfluxDb for Graphana

c3bd352

made kakfka core a class

635bd2a

Merge pull request #3 from sakethr16/develop-saketh

c90907c

pushing to InfluxDb for Graphana

Merge pull request #4 from sakethr16/develop-hemanth

b6afaaf

Develop hemanth

pushing to microservice

089e640

Merge pull request #5 from sakethr16/dev/hemanthvs-microservices

6599d2c

pushing to microservice

merged all config files

effa3ea

refactor

2a1ba4d

unit test cases for publishers

9485aa2

add Dockerfile

a98bcb1

Merge branch 'develop' of https://github.com/sakethr16/automated-self…

efaa5d2

…-checkout into develop

adding readme

8291c6c

Merge pull request #6 from sakethr16/develop

7d303dc

Develop

hemanth-vs marked this pull request as draft January 28, 2025 05:26

hemanth-vs marked this pull request as ready for review January 28, 2025 05:27

ejlee3 requested review from antoniomtz, NeethuES-intel, brian-intel and ejlee3 January 28, 2025 17:30

ejlee3 added enhancement New feature or request Intermediate labels Jan 28, 2025

NeethuES-intel requested changes Jan 29, 2025

View reviewed changes

feat : RealSenseSensor Data Extraction and Publishing

1c69eaa

Data is being extracted from RealSensor and is getting published to Multiple SOurces such as Kafka, grafana or other microServices

feat : RealSenseSensor Data Extraction and Publishing

515002d

dquote> dquote> Data is being extracted from RealSensor and is getting published to Multiple SOurces such as Kafka, grafana or other microServices dquote> dquote> dquote>

NeethuES-intel changed the title ~~Issue #538: Real Sense Sensor data extraction and publishing~~ feat: extract and publish realsense Sensor data Jan 30, 2025

NeethuES-intel reviewed Jan 30, 2025

View reviewed changes

antoniomtz requested changes Jan 31, 2025

View reviewed changes

ejlee3 requested changes Jan 31, 2025

View reviewed changes

sakethr16 and others added 4 commits January 31, 2025 18:59

Updated Grafana spelling. Connecting to InfluxDB local

1d3c550

Resolving PR comments

6e1456e

fixed the comments

ffb1e57

updated make file

87b40ac

NeethuES-intel reviewed Feb 4, 2025

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat: extract and publish realsense Sensor data #654

feat: extract and publish realsense Sensor data #654

hemanth-vs commented Jan 28, 2025

sakethr16 commented Jan 28, 2025

NeethuES-intel left a comment

sakethr16 commented Jan 30, 2025

NeethuES-intel commented Jan 30, 2025

NeethuES-intel Jan 30, 2025

sakethr16 Feb 3, 2025

NeethuES-intel Jan 30, 2025

Hemanth-byte Jan 31, 2025

antoniomtz Jan 31, 2025

sakethr16 Feb 3, 2025

ejlee3 Jan 31, 2025

sakethr16 Feb 3, 2025

ejlee3 Jan 31, 2025

sakethr16 Feb 3, 2025

NeethuES-intel left a comment

	class GraphanaPublisher(Publisher):
	class GrafanaPublisher(Publisher):

feat: extract and publish realsense Sensor data #654

Are you sure you want to change the base?

feat: extract and publish realsense Sensor data #654

Conversation

hemanth-vs commented Jan 28, 2025

PR Checklist

What are you changing?

Issue this PR will close

Anything the reviewer should know when reviewing this PR?

Test Instructions if applicable

If the there are associated PRs in other repositories, please link them here (i.e. intel-retail/automated-self-checkout )

sakethr16 commented Jan 28, 2025

NeethuES-intel left a comment

Choose a reason for hiding this comment

sakethr16 commented Jan 30, 2025

NeethuES-intel commented Jan 30, 2025

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

NeethuES-intel left a comment

Choose a reason for hiding this comment