Compute
Elastic Cloud Server
Huawei Cloud Flexus
Bare Metal Server
Auto Scaling
Image Management Service
Dedicated Host
FunctionGraph
Cloud Phone Host
Huawei Cloud EulerOS
Networking
Virtual Private Cloud
Elastic IP
Elastic Load Balance
NAT Gateway
Direct Connect
Virtual Private Network
VPC Endpoint
Cloud Connect
Enterprise Router
Enterprise Switch
Global Accelerator
Management & Governance
Cloud Eye
Identity and Access Management
Cloud Trace Service
Resource Formation Service
Tag Management Service
Log Tank Service
Config
OneAccess
Resource Access Manager
Simple Message Notification
Application Performance Management
Application Operations Management
Organizations
Optimization Advisor
IAM Identity Center
Cloud Operations Center
Resource Governance Center
Migration
Server Migration Service
Object Storage Migration Service
Cloud Data Migration
Migration Center
Cloud Ecosystem
KooGallery
Partner Center
User Support
My Account
Billing Center
Cost Center
Resource Center
Enterprise Management
Service Tickets
HUAWEI CLOUD (International) FAQs
ICP Filing
Support Plans
My Credentials
Customer Operation Capabilities
Partner Support Plans
Professional Services
Analytics
MapReduce Service
Data Lake Insight
CloudTable Service
Cloud Search Service
Data Lake Visualization
Data Ingestion Service
GaussDB(DWS)
DataArts Studio
Data Lake Factory
DataArts Lake Formation
IoT
IoT Device Access
Others
Product Pricing Details
System Permissions
Console Quick Start
Common FAQs
Instructions for Associating with a HUAWEI CLOUD Partner
Message Center
Security & Compliance
Security Technologies and Applications
Web Application Firewall
Host Security Service
Cloud Firewall
SecMaster
Anti-DDoS Service
Data Encryption Workshop
Database Security Service
Cloud Bastion Host
Data Security Center
Cloud Certificate Manager
Edge Security
Situation Awareness
Managed Threat Detection
Blockchain
Blockchain Service
Web3 Node Engine Service
Media Services
Media Processing Center
Video On Demand
Live
SparkRTC
MetaStudio
Storage
Object Storage Service
Elastic Volume Service
Cloud Backup and Recovery
Storage Disaster Recovery Service
Scalable File Service Turbo
Scalable File Service
Volume Backup Service
Cloud Server Backup Service
Data Express Service
Dedicated Distributed Storage Service
Containers
Cloud Container Engine
Software Repository for Container
Application Service Mesh
Ubiquitous Cloud Native Service
Cloud Container Instance
Databases
Relational Database Service
Document Database Service
Data Admin Service
Data Replication Service
GeminiDB
GaussDB
Distributed Database Middleware
Database and Application Migration UGO
TaurusDB
Middleware
Distributed Cache Service
API Gateway
Distributed Message Service for Kafka
Distributed Message Service for RabbitMQ
Distributed Message Service for RocketMQ
Cloud Service Engine
Multi-Site High Availability Service
EventGrid
Dedicated Cloud
Dedicated Computing Cluster
Business Applications
Workspace
ROMA Connect
Message & SMS
Domain Name Service
Edge Data Center Management
Meeting
AI
Face Recognition Service
Graph Engine Service
Content Moderation
Image Recognition
Optical Character Recognition
ModelArts
ImageSearch
Conversational Bot Service
Speech Interaction Service
Huawei HiLens
Video Intelligent Analysis Service
Developer Tools
SDK Developer Guide
API Request Signing Guide
Terraform
Koo Command Line Interface
Content Delivery & Edge Computing
Content Delivery Network
Intelligent EdgeFabric
CloudPond
Intelligent EdgeCloud
Solutions
SAP Cloud
High Performance Computing
Developer Services
ServiceStage
CodeArts
CodeArts PerfTest
CodeArts Req
CodeArts Pipeline
CodeArts Build
CodeArts Deploy
CodeArts Artifact
CodeArts TestPlan
CodeArts Check
CodeArts Repo
Cloud Application Engine
MacroVerse aPaaS
KooMessage
KooPhone
KooDrive

Configuring and Importing Sample Projects

Updated on 2024-08-12 GMT+08:00

Scenarios

Flink provides sample projects for multiple scenarios, including Java and Scala sample projects, to help you quickly learn Flink projects.

Methods to import Java and Scala projects are the same.

The following example describes how to import Java sample code. Figure 1 shows the operation process.

Figure 1 Process of importing sample projects

Procedure

  1. Obtain the sample project from the flink-examples-security folder in the src\flink-examples directory where the sample code is decompressed. For details, see Obtaining the MRS Application Development Sample Project. You can select a sample based on the service scenario. For details about the samples, see Flink Sample Project.

    NOTE:
    • In security mode, obtain the sample project flink-examples-security from the src\flink-examples folder.
    • In normal mode, obtain the sample project flink-examples-normal from the src\flink-examples folder.

  2. Before importing the sample project, configure JDK for IntelliJ IDEA.

    1. Start IntelliJ IDEA and click Configure.
      Figure 2 Choosing Configure
    2. Choose Project Defaults from the Configure drop-down list.
      Figure 3 Choosing Project Defaults
    3. Choose Project Structure from the Project Defaults submenu.
      Figure 4 Project Defaults
    4. On the Project Structure page, select SDKs and click the plus sign to add the JDK.
      Figure 5 Adding the JDK
    5. On the Select Home Directory for JDK page that is displayed, select the JDK directory and click OK.
      Figure 6 Selecting the JDK directory
    6. After the JDK is selected, click OK to complete the configuration.
      Figure 7 Completing the JDK configuration

  3. (Optional) If a Scala sample project is imported, install Scala plug-ins in IntelliJ IDEA.

    1. Choose Plugins from the Configure drop-down list.
      Figure 8 Plugins
    2. On the Plugins page, click Install plugin from disk.
      Figure 9 Install plugin from disk
    3. On the Choose Plugin File page, select the Scala plugin file of the corresponding version and click OK.
      Figure 10 Choose Plugin File
    4. On the Plugins page, click Apply to install the Scala plugins.
    5. On the Platform and Plugin Updates page that is displayed, click Restart to make the configurations take effect.
      Figure 11 Platform and Plugin Updates

  4. Import the Java sample project to IDEA.

    1. Start IntelliJ IDEA. On the Quick Start page, select Import Project.

      Alternatively, for the used IDEA tool, add the project directly from the IDEA home page. Choose File > Import project... to import a project.

      Figure 12 Importing a project (on the Quick Start page)
    2. Select the directory for storing the imported projects and click OK.
      Figure 13 Select File or Directory to Import
    3. Select Create project from existing sources and click Next.
      Figure 14 Create project from existing sources
    4. Confirm the project location and project name, and click Next.
      Figure 15 Import Project
    5. Retain the default value of the root directory for the project to be imported and click Next.
      Figure 16 Import Project
    6. Retain the default dependency library that is automatically recognized by IDEA and the suggested module structure, and click Next.
    7. Confirm the JDK to be used by the project and click Next.
    8. After the import is complete, click Finish. The imported sample project is displayed on the IDEA home page.
      Figure 17 Completing the import
      Figure 18 Imported project

  5. Import the dependency JAR file for the sample project.

    If the sample project code is obtained from an open-source image site, dependency JAR files are automatically downloaded after Maven is configured.
    NOTE:

    If other FusionInsight components such as Kafka are used in the sample code, obtain them from the installation directory of these FusionInsight components. For details about dependency packages of sample projects, see Reference Information.

  6. (Optional) If a Scala sample application is imported, configure a language for the project.

    1. On the IDEA home page, choose File > Project Structures... to go to the Project Structure page.
    2. Choose Modules, right-click a project name, and choose Add > Scala.
      Figure 19 Selecting Scala
    3. Wait until IDEA identifies Scala SDK, select the dependency JAR files in the Add Scala Support dialog box, and then click OK.
      Figure 20 Add Scala Support
    4. If the IDEA fails to identify Scala SDK, create a Scala SDK.
      1. Click Create....
        Figure 21 Create...
      2. On the Select JAR's for the new Scala SDK page, click Browse....
        Figure 22 Select JAR's for the new Scala SDK
      3. On the Scala SDK files page, select the scala sdk directory and click OK.
        Figure 23 Scala SDK files
    5. Click OK.
      Figure 24 The configuration is successful.

  7. Configure the text file encoding format of IDEA to prevent garbled characters.

    1. On the IDEA home page, choose File > Settings....
      Figure 25 Choosing Settings
    2. Configure encoding.
      1. On the Settings page, unfold Editor, and choose File Encodings.
      2. Select UTF-8 from the IDE Encoding and Project Encoding drop-down lists on the right.
      3. Click Apply.
      4. Click OK to complete the encoding settings.
      Figure 26 Settings
    NOTE:
    • Obtain related dependency packages from the Flink server installation directory.
    • Obtain Kafka dependency packages from the Kafka environment.
    • For details about the dependency packages, see Reference Information.

  8. Configure Maven.

    1. Add the configuration information such as the address of the open-source image repository to the setting.xml configuration file of the local Maven by referring to Configuring Huawei Open-Source Mirrors.
    2. On the IntelliJ IDEA page, choose File > Settings > Build, Execution, Deployment > Build Tools > Maven, select Override next to User settings file, and change the value of User settings file to the directory where the settings.xml file is stored. Ensure that the directory is <Local Maven installation directory>\conf\settings.xml.
      Figure 27 Directory for storing the settings.xml file
    3. Click the drop-down list next to Maven home directory and select the Maven installation directory.
    4. Click Apply and then OK.
    5. On the right of the IntelliJ IDEA home page, click Maven Projects. On the displayed page, choose Project name > Lifecycle and run the clean and compile scripts.
      Figure 28 Maven Projects page

Reference Information

The lib and opt directories of the Flink client contain Flink JAR files. By default, the lib directory contains the Flink core JAR file, and the opt directory contains the JAR file (for example, flink-connector-kafka*.jar) for connecting to external components. If it is required during application development, manually copy the related JAR files to the lib directory.

The dependency packages of the sample projects provided by Flink are as follows:

Table 1 Dependency packages

Sample Project

Depended Package

Description

DataStream (Java/Scala)

flink-dist_*.jar

You can obtain the package from the lib directory in the installation path of the Flink client or server.

Sample project of the asynchronous checkpoint mechanism application (in Java or Scala)

Producing and consuming data in Kafka (in Java or Scala)

kafka-clients-*.jar

You can obtain the package from the lib directory in the installation directory of the Kafka component client or server.

flink-connector-kafka_*.jar

You can obtain the package from the opt directory in the installation path of the Flink client or server.

Pipeline (Java/Scala)

flink-dist_*.jar

You can obtain the package from the lib directory in the installation path of the Flink client or server.

flink-connector-netty_*.jar

You can obtain the package from the lib folder generated after the secondary development sample code is compiled.

curator-client-2.12.0.jar

curator-framework-2.12.0.jar

Stream SQL Join (Java)

flink-dist_2.11*.jar

You can obtain the package from the lib directory in the installation path of the Flink client or server.

kafka-clients-*.jar

You can obtain the package from the lib directory in the installation directory of the Kafka component client or server.

flink-connector-kafka_2.11*.jar

You can obtain the package from the opt directory in the installation path of the Flink client or server.

flink-table_2.11*.jar

-

We use cookies to improve our site and your experience. By continuing to browse our site you accept our cookie policy. Find out more

Feedback

Feedback

Feedback

0/500

Selected Content

Submit selected content with the feedback