Skip to content

Hydrospheredata/mist

Folders and files

NameName
Last commit message
Last commit date

Latest commit

9a79b31 · Oct 7, 2019
Mar 16, 2018
Nov 8, 2018
Aug 15, 2019
May 23, 2018
Oct 7, 2019
Apr 2, 2019
Jul 23, 2019
Jul 22, 2019
May 23, 2018
Jan 20, 2017
Jul 22, 2019
Oct 20, 2017
Mar 2, 2019
Aug 18, 2016
Jan 17, 2019
Mar 16, 2018
Mar 26, 2019
Jul 24, 2019

Repository files navigation

Build Status Build Status Maven Central Docker Hub Pulls

Hydrosphere Mist

Join the chat at https://gitter.im/Hydrospheredata/mist

Hydrosphere Mist is a serverless proxy for Spark cluster. Mist provides a new functional programming framework and deployment model for Spark applications.

Please see our quick start guide and documentation

Features:

  • Spark Function as a Service. Deploy Spark functions rather than notebooks or scripts.
  • Spark Cluster and Session management. Fully managed Spark sessions backed by on-demand EMR, Hortonworks, Cloudera, DC/OS and vanilla Spark clusters.
  • Typesafe programming framework that clearly defines inputs and outputs of every Spark job.
  • REST HTTP & Messaging (MQTT, Kafka) API for Scala & Python Spark jobs.
  • Multi-cluster mode: Seamless Spark cluster on-demand provisioning, autoscaling and termination(pending) Cluster of Spark Clusters

It creates a unified API layer for building enterprise solutions and microservices on top of a Spark functions.

Mist use cases

High Level Architecture

High Level Architecture

Contact

Please report bugs/problems to: https://github.com/Hydrospheredata/mist/issues.

http://hydrosphere.io/

LinkedIn

Facebook

Twitter