Help Center> > Service Overview >What Is DLI?

What Is DLI?

Data Lake Insight (DLI) is a serverless big data compute and analysis service that is fully compatible with Apache Spark and Apache Flink ecosystems and supports batch streaming. With multi-model engines, enterprises can use SQL statements or programs to easily complete batch processing, stream processing, in-memory computing, and machine learning of heterogeneous data sources.

Description

You can query and analyze heterogeneous data sources such as CloudTable, RDS, and DWS on the cloud using multiple access methods, such as visualized interface, Restful API, JDBC, ODBC, and Beeline. The data format is compatible with five mainstream data formats: CSV, JSON, Parquet, Carbon, and ORC.

  • The SQL query function is supported. Provides standard SQL statements for users. For details, see Data Lake Insight SQL Syntax Reference.
  • Fully-managed Spark computing: You can submit computing tasks through interactive sessions or in batch mode to analyze data in the fully managed Spark queues. For details, see Data Lake Insight API Reference.
  • Jobs can be submitted using Beeline. For details, see Data Lake Insight User Guide.
  • Jobs can be submitted using Spark-submit. For details, see Data Lake Insight User Guide.
  • The DLI server can be connected through JDBC or ODBC. For details, see Data Lake Insight User Guide.
  • Datasource connection: Data sources such as CloudTable, DWS, RDS, and CSS can be accessed through DLI. For details, see Data Lake Insight User Guide.
  • Interconnects with Yonghong BI to implement data analysis. For details, see Data Lake Insight Developer Guide.
  • Interconnects with the Tableau Desktop to implement data analysis. For details, see Data Lake Insight Developer Guide.
  • Support of geometry query. For details, see Data Lake Insight Developer Guide.

Accessing DLI

The public cloud provides a web-based service management platform that allows you to access DLI both through the console and HTTPS-based APIs. In addition, the DLI server can be connected through JDBC or ODBC.

  • Using APIs

    If you need to integrate DLI on the public cloud into a third-party system for secondary development, use APIs to access the service. For details, see Data Lake Insight API Reference.

  • Access through the management console

    To submit SQL jobs or Spark jobs, use the management console to access DLI. If you have registered with the public cloud, log in to the management console and choose Service List > EI Enterprise Intelligence > Data Lake Insight.

  • JDBC or ODBC

    DLI can use JDBC or ODBC to connect to the server for data query. For details, see Data Lake Insight User Guide.