What Are the Features of CS?
CS provides the following functions:
- Abundant StreamSQL online analysis capabilities
Aggregation functions, such as Window and Join, geographical functions, and CEP functions are supported. SQL is used to express business logic, facilitating service implementation. For details, see the Cloud Stream Service SQL Syntax Reference.
- StreamingML
CS Provides multiple streaming machine learning methods to analyze and predict data in real time. You only need to call related functions through SQL statements to perform data statistics, anomaly detection, real-time clustering, and time series analysis. For details, see StreamingML.
- Geographical location analysis
CS offers geographical location analysis functions to analyze geospatial data in real time. You can fulfill yaw detection and geo-fencing through SQL statements. For details, see Geographical Functions.
- CEP SQL
CS provides pattern matching and detection based on Match Recognize to assist business personnel in anomaly detection based on complex event rules through SQL. You can apply this function in various scenarios, such as fraud detection, abnormal vehicle behavior detection, and abnormal running status detection of industrial devices. For details, see Pattern Matching.
- Data visualization
CS works with charts of various types to display job output data in real time. You can directly use API Gateway (APIG) to access job data as well as customize data to be visualized. For details, see Data Visualization.
- Visual SQL editor
CS provides a visual editor for users who are not familiar with SQL development. The visual editor encapsulates upstream and downstream services (such as DIS and CloudTable) and internal logic operators (such as filter and window) that need to be interconnected with CS into drag-and-drop components. It allows you to easily create a job topology by dragging required elements into the canvas and then connecting them. By clicking each element in the canvas, you can set related parameters. For details, see Visual Editor.
- Exclusive cluster creation and resource quota allocation for jobs
Tenants can create exclusive clusters, which are physically isolated from shared clusters and other tenants' clusters and are not subject to other jobs. Tenants can also configure the maximum SPU quota for their exclusive clusters and allocate available clusters and SPU quota for their sub-users. For details, see Cluster Management.
- Online SQL job testing
Job debugging helps you check whether a SQL statement's logic is correct. After sample data is input manually or using OBS, the correct SQL statement logic will export results as expected. For details, see Debugging a Job.
- Support for user-defined Flink and Spark jobs
You can submit user-defined Flink and Spark jobs in exclusive clusters.
- Support for Spark streaming and structured streaming
You can submit user-defined Spark streaming jobs in exclusive clusters.
- Interconnection with multiple cloud services to form a rich stream ecosystem
The CS ecosystem consists of cloud service ecosystems and open-source ecosystems.
- Cloud service ecosystems: CS can be interconnected with other cloud services by using Stream SQL. You can directly use SQL statements to read and write data from various cloud services, such as Data Ingestion Service (DIS), Object Storage Service (OBS), CloudTable Service (CloudTable), Distributed Cache Service (DCS), MapReduce Service (MRS), Relational Database Service (RDS), and Simple Message Notification (SMN).
- Open-source ecosystems: After connections to other VPCs are established through VPC peering connections, you can access all data sources and output targets (such as HBase, Elasticsearch, and Kafka) supported by Flink and Spark in your exclusive CS cluster.
For details, see the Cloud Stream Service Stream Ecosystem Development Guide.
- Interconnection with Intelligent EdgeFabric (IEF)
IEF works together with CS to provide on-cloud management, stream processing on edge devices, and real-time stream processing.
Did this article solve your problem?
Thank you for your score!Your feedback would help us improve the website.