Data Pipeline V1

Summary

There are 4 major functions that this architecture serves:

• Getting IoT Data from IoT Core and Storing it in an S3 Bucket (Raw)
• Processing the raw data into something useful to display to end-users
• Sending alerts to users in case a leak is detected
• Sending 'valve shutdown' command to IoT Devices in case a leak is detected

Blockers

• Security Revision

Delivered

• Secure IoT Data Storage
• Leakage Detection Algorithm
• User Alerting System
• Valve shutdown feature (Leakage mitigation) - enabled via AWS Lambda & IoT Core
• Web Dashboard Linked

Next Release

• Use AWS Secrets Manager to securely store environment variables
• Use Kinesis Data Analytics to analyze IoT realtime events
• Build an API to query the Raw Data -> AWS API Gateway