[data] Adding Kafka datasink.#60307

Merged

richardliaw merged 27 commits into

ray-project:masterfrom

justinrmiller:58725-Kafka-Datasync

Mar 18, 2026

Commits on Jan 20, 2026

Adding Kafka datasink.
Justin Miller
committed
Update python/ray/data/dataset.py

justinrmiller
and
gemini-code-assist[bot]
authored

Commits on Feb 5, 2026

Addressing PR comments and adding test for Kafka datasink.
Justin Miller
committed
Addressing PR comments.
Justin Miller
committed
Merge branch 'master' into 58725-Kafka-Datasync
justinrmiller
authored
Missed using the _serialize_key value, added a test to ensure that won't happen again.
Justin Miller
committed
Merge branch '58725-Kafka-Datasync' of https://github.com/justinrmiller/ray into 58725-Kafka-Datasync
Justin Miller
committed

Commits on Feb 9, 2026

Merge branch 'master' into 58725-Kafka-Datasync
justinrmiller
authored

Commits on Feb 11, 2026

Merge branch 'master' into 58725-Kafka-Datasync
justinrmiller
authored

Commits on Feb 17, 2026

Merge remote-tracking branch 'upstream/master' into 58725-Kafka-Datasync
Justin Miller
committed

Commits on Feb 21, 2026

Merge branch 'master' into 58725-Kafka-Datasync
justinrmiller
authored
Address PR comments.
Justin Miller
committed
Merge branch '58725-Kafka-Datasync' of https://github.com/justinrmiller/ray into 58725-Kafka-Datasync
Justin Miller
committed
Surfacing first exception in Kafka datasink.
Justin Miller
committed
Fixing type hint issue.
Justin Miller
committed

Commits on Feb 23, 2026

Merge branch 'master' into 58725-Kafka-Datasync
justinrmiller
authored

Commits on Mar 8, 2026

Commits on Mar 9, 2026

fix doc test and simplify serialization
owenowenisme
committed

Commits on Mar 11, 2026

Address PR review comments from iamjustinhsu
Justin Miller
committed
Merge branch 'master' into 58725-Kafka-Datasync
justinrmiller
authored

Commits on Mar 16, 2026

Commits on Mar 17, 2026

Merge branch 'master' into 58725-Kafka-Datasync
justinrmiller
authored

Commits on Mar 18, 2026