Skip to content

Automated Robot which sort object based on their type, supports manual remote control using IoT

Notifications You must be signed in to change notification settings

arpitpatawat/Automated-object-detection-and-sorting-robot

Repository files navigation

Automated-object-detection-and-sorting-robot

Introduction 🚀 →

an object sorting Robot is made using small 3D printed parts and Servo motors which uses object detection algorithm to identify the object type and then sort accordingly

  • Works for upto 80 different objects
  • Real time detection and sorting
  • Manual and Automatic control
  • Webpanel to control it from remote place
  • report whole day activity by sending mail
  • controlling via BLYNK app
  • complete video feed for App/Web work

Project Images

alt text alt text

web-panel

Components 🤖 →

Hardware →

  • 3D printed parts of 4 DOF Robotic Arm
  • 4 MG 90 Servo motors
  • NodeMCU
  • LCD module
  • Breadboard
  • jumper wires
  • different shaped objects
  • LED's for indication
  • External camera (webcam)

Software →

  • python
  • weight and configuration file of yolo (please download weight file - Weight file)
  • open cv library
  • Arduino ide
  • Thingspeak cloud
  • BLYNK app
  • Web browser (to display web-panel)

installation & Working ⚙️ →

  1. Upload the sketch(robo_sort_final) in nodemcu also make changes for wifi ssid, password and thing speak write API's and remaining user's variable data.
  2. ESP8266 will connect with the wifi and display the local IP address of webserver in the LCD.
  3. Open any web browser and enter IP address and allow access to camera (i have used separate webcam but you can allow access to laptop camera)
  4. On the webpanel, you can move slider to control robotic arm, pick and drop object or sort left /right manually using buttons.
  5. When you turn off manual control then automatic sorting will begin.
  6. Run the python script, it will turn on webcam which will going to detect object
  7. Whenever our pre defined objects (toy elephent,zebra , sharpner or eraser in my case) will detected it will send different data thing speak cloud
  8. NodeMCU will fetch the data from cloud and move the robot using series of algorithm and update the data in the webpanel
  9. It will move continueously untill we press enter button in our keyboard (null request) considering it to be implemented in factories/ industries.
  10. At the end click mail button , it will send the whole data of object detection as a link on user's mail ID.

Simulation and video →

this was the initial part of the project -> Old Video .

It has been updated further.

About

Automated Robot which sort object based on their type, supports manual remote control using IoT

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published