Skip to content

Latest commit

 

History

History
73 lines (37 loc) · 3.01 KB

README.md

File metadata and controls

73 lines (37 loc) · 3.01 KB

JindoData User Guide

JindoData is a self-developed data lake storage acceleration suite by Alibaba Cloud's Big Data team, designed for big data and AI ecosystems. It provides comprehensive access acceleration solutions for both Alibaba Cloud and major industry data lake storage systems.

Built on a unified architecture and kernel, JindoData supports access through the all-purpose SDK (JindoSDK) to OSS/OSS-HDFS. JindoSDK is compatible with HCFS interfaces, object storage interfaces, and POSIX interfaces, as well as supporting Python and TensorFlow, along with a full ecosystem of compatible tools (JindoCli, JindoFuse, JindoDistCp) and plugins.

JindoData

Downloading and Installing JindoSDK

JindoSDK serves as the standard client for accessing JindoData components. To install and verify it, refer to JindoSDK Download and JindoSDK Quick Start. For multi-platform support, consult JindoSDK Multi-Platform Support.

Upgrading JindoSDK

As an actively updated client providing continuous updates with new features and performance improvements for Alibaba Cloud EMR data lakes, we recommend users stay up-to-date with the latest JindoSDK version for ongoing support and optimal experience. A convenient script is available to assist in upgrading JindoSDK across your cluster; please refer to the JindoSDK Upgrade Documentation.

Usage Scenarios

Using JindoSDK in Hadoop Ecosystem

See Using JindoSDK in Hadoop Ecosystem

Using JindoSDK in AI Ecosystem

See Using JindoSDK in AI Ecosystem

Using Jindo Python SDK

See Jindo Python SDK Quick Start

Using Jindo TensorFlow Connector

See Using JindoTensorFlowConnector

Using JindoFuse

See JindoFuse Quick Start

Using Jindo Flink Sink

See Using Jindo Flink Sink

Using JindoRuntime with Fluid

See Overview of Using JindoRuntime with Fluid

Authentication Solutions for JindoData

See Authentication in JindoData

Data Copy Tools - JindoDistCp

See Quick Start for JindoDistCp

Warehouse Migration Tool - JindoTable MoveTo

See Using JindoTable MoveTo

Warehouse Tier Management Tool - JindoTable SetStorage

See Using JindoTable SetStorage Class

OSS-HDFS Service (JindoFS) Client Tools

See OSS-HDFS Service (JindoFS) Client Tools Overview

FAQs

Refer to the JindoData FAQs

Release History

Check out the JindoSDK Release Notes for version information.