Skip to content

discovery-digital/vmware-go-kcl

This branch is 8 commits ahead of, 20 commits behind vmware/vmware-go-kcl:master.

Folders and files

NameName
Last commit message
Last commit date
Mar 2, 2020
Nov 4, 2019
Jul 10, 2019
Nov 6, 2019
Apr 24, 2018
Apr 8, 2018
Sep 12, 2018
Jun 28, 2019
Aug 17, 2018
Feb 22, 2019
Mar 3, 2020
Oct 28, 2019

Repository files navigation

VMware-Go-KCL

Overview

Amazon Kinesis enables real-time processing of streaming data at massive scale. Kinesis Streams is useful for rapidly moving data off data producers and then continuously processing the data, be it to transform the data before emitting to a data store, run real-time metrics and analytics, or derive more complex data streams for further processing.

The VMware Kinesis Client Library for GO (VMware-Go-KCL) enables Go developers to easily consume and process data from [Amazon Kinesis][kinesis].

VMware-Go-KCL brings Go/Kubernetes community with Go language native implementation of KCL matching exactly the same API and functional spec of original Java KCL v2.0 without the resource overhead of installing Java based MultiLangDaemon.

Try it out

Prerequisites

Make sure hmake is version 1.3.1 or above and go is version 1.11 or above

hmake --version
1.3.1

Make sure to launch Docker daemon with specified DNS server --dns DNS-SERVER-IP

On Ubuntu, update the file /etc/default/docker to put --dns DNS-SERVER-IP in DOCKER_OPTS.

On Mac, set DNS in Docker PreferencesDaemonInsecure registries

Build & Run

hmake

# security scan
hmake scanast

# run test
hmake check

# run integration test
# update the worker_test.go to let it point to your Kinesis stream
hmake test

Documentation

VMware-Go-KCL matches exactly the same interface and programming model from original Amazon KCL, the best place for getting reference, tutorial is from Amazon itself:

Contributing

The vmware-go-kcl project team welcomes contributions from the community. Before you start working with vmware-go-kcl, please read our Developer Certificate of Origin. All contributions to this repository must be signed as described on that page. Your signature certifies that you wrote the patch or have the right to pass it on as an open-source patch. For more detailed information, refer to CONTRIBUTING.md.

License

MIT License

About

KCL Implementation in Go lang by VMware

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Go 97.5%
  • Shell 2.3%
  • Dockerfile 0.2%