-
Notifications
You must be signed in to change notification settings - Fork 4
Teknek & other streaming platforms
There are a number of platforms which are close or similar to teknek. This page will briefly discuss teknek and it's design goals.
Teknek is designed to be accessible by a wide range of users. Teknek was inspired by Apache Hive, hive hides away the complexities of hadoop by providing a CLI for lighting fast prototyping, as well as plug able language features like user defined functions. Teknek provides a simple language name SOL (Stream Operator Language) and the ability to define and chain together operators without an IDE or compiler.
Teknek is completely peer-to-peer. There is no coordination service other then the plan information in zookeeper. Teknek Nodes uses locking semantics in zookeeper for software correctness in a peer-to-peer fashion.
Teknek is a stream processing engine ONLY. Many streaming systems take on the more difficult problems dealing with group by semantics and persistent operators directly. Teknek delegates these responsibilities to pluggable API's and third party software such as Kafka or Cassandra.