[Roadmap] Planning 0.7 Release

[wuchong]

Timeline Plan

• Feature Freeze: May 10, 2025
• Release: May 15, 2025

Milestone Board

https://github.com/alibaba/fluss/milestone/2

Highlight Features

List of features announced by contributors and committers that are likely to be ready for the feature freeze

New Lakehouse Storage

• [Feature] Refactor Lakehouse Storage Implementation #107

A completely new architecture designed for large-scale production environments, featuring plug-in support for mainstream lake formats such as Iceberg and Hudi. This addresses key pain points in Tiering Service performance, scalability, and operational efficiency, providing a more reliable unified lakehouse and streaming solution for enterprise-grade use cases.

Authentication & Access Control

• [Umbrella] Introduce Fluss Authentication and authorization #399

Introducing plugin-based authentication and fine-grained access control to meet the stringent data security requirements of enterprises.

Kafka Compatibility

• Support Kafka Protocol Compatibility #486

Compatibility with the Kafka network protocol, enabling seamless integration with the Kafka ecosystem.

Spark Engine

• [Umbrella][Feature] Support spark engine #155

Adds native support for Spark as a computation engine, enabling efficient batch and streaming and interactive query processing.

Multi-Level Partitions & Partition Pushdown

• [Feature] Support partition pushdown in Flink connector #196
• [Feature] Support multiple partitioned fields for partitioned table #195

Improves query performance through advanced partitioning strategies and partition pruning capabilities.

Datastream API Support

• [Umbrella][Feature] Datastream API Support #569

Provides a public API for Flink DataStream users, making it handy and powerful like Kafka DataStream API.

---

We welcome any ideas, suggestions, or feedback from the community! Your input is invaluable in shaping the future of Fluss. Please feel free to comment on the discussion and linked issues.

[gongzexin]

I hope to support flink datastream api.

[wuchong]

Good idea. Track in #569

[SteNicholas]

IMO, 0.7 version could support HA with #188. Meanwhile, zookeeper could be removed in 0.7. WDYT?

[wuchong]

Yes, the HA has been tracked in milestone v0.7.

Regarding the removal of ZooKeeper (ZK), I hope we can finalize an approved design for its replacement, like KRaft, in this version. However, considering the numerous significant tasks already planned for this release, I believe it will be challenging to fully implement this change in the current version.

[gongzexin]

I would like to know if there are plans to support ALTER TABLE table_a ADD column_x ...

[wuchong]

Sorry, schema evolution is not planned in v0.7, but probably will be supported in v0.8.

[dufangwei-yyds]

when support flink stream api?

[polyzos]

@dufangwei-yyds You can track it here.

[rizinator007]

Bentley

[wuchong]

Considering the development progress is slower than expected, thus we have to postpone the release date to the end of May. I suggest the new date:

Feature Freeze: May 26, 2025
Release: May 29, 2025