Skip to content

Data Pipeline V1

Latest
Compare
Choose a tag to compare
@codewithlennylen codewithlennylen released this 27 Mar 00:35

Summary

There are 4 major functions that this architecture serves:

  • Getting IoT Data from IoT Core and Storing it in an S3 Bucket (Raw)
  • Processing the raw data into something useful to display to end-users
  • Sending alerts to users in case a leak is detected
  • Sending 'valve shutdown' command to IoT Devices in case a leak is detected

Blockers

  • Security Revision

Delivered

  • Secure IoT Data Storage
  • Leakage Detection Algorithm
  • User Alerting System
  • Valve shutdown feature (Leakage mitigation) - enabled via AWS Lambda & IoT Core
  • Web Dashboard Linked

Next Release

  • Use AWS Secrets Manager to securely store environment variables
  • Use Kinesis Data Analytics to analyze IoT realtime events
  • Build an API to query the Raw Data -> AWS API Gateway