-
kinesis_stream_put_to_s3_athena_partitioning.py
Description: process data from kinesis stream and put to s3, partitioning the data for Athena. The partition is based on the timestamp of the "d" value, so is not important the order of the stream data.
Environment Variables: S3_BUCKET -> name of the s3 bucket (es. 'bucket') S3_PATH -> custom path (es. 'test/test1/test2')
Example minimum json: { "_id":"asdasdasdasd", "d":{"sec":1498746471} }
-
Notifications
You must be signed in to change notification settings - Fork 0
texano00/aws-lambda-functions
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
About
AWS lambda functions - utilities
Topics
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published