What's New in Flink 1.15

Flink 1.15 Release Date

For more version support information, see Lifecycle of DLI Compute Engine Versions.

Flink 1.15 Description

• The syntax design of Flink 1.15 has been improved to achieve higher compatibility and consistency with mainstream open-source technology standards.
• Flink 1.15 has added support for new connectors such as Hive and Hudi.
• For synchronous data migration scenarios in Flink 1.15, DataArts Studio's DataArts Migration is recommended.
• Flink 1.15 now supports integration with DEW-CSMS secret management, providing a privacy protection solution.
• Flink 1.15 supports minimal submission of Flink Jar jobs.
  

  Minimal submission means Flink only submits the necessary job dependencies, not the entire Flink environment. By setting the scope of non-Connector Flink dependencies (starting with flink-) and third-party libraries (like Hadoop, Hive, Hudi, and MySQL-CDC) to provided, you ensure these dependencies are excluded from the Jar job, avoiding conflicts with Flink core dependencies.

  • Only Flink 1.15 supports minimal submission of Flink Jar jobs. Enable this by configuring flink.dli.job.jar.minimize-submission.enabled=true in the runtime optimization parameters.
  • For Flink-related dependencies, use the provided scope by adding <scope>provided</scope> in the dependencies, especially for non-Connector dependencies under the org.apache.flink group starting with flink-.
  • For dependencies related to Hadoop, Hive, Hudi, and MySQL-CDC, also use the provided scope by adding <scope>provided</scope> in the dependencies.
  • In the Flink source code, only methods marked with @Public or @PublicEvolving are intended for user invocation. DLI guarantees compatibility with these methods.