Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BE: Serde: Support mm2 topics serdes #444

Open
2 tasks done
fallen-up opened this issue Jun 13, 2024 · 0 comments
Open
2 tasks done

BE: Serde: Support mm2 topics serdes #444

fallen-up opened this issue Jun 13, 2024 · 0 comments
Labels
area/serde Serialization & Deserialization (plugins) scope/backend Related to backend changes status/triage/completed Automatic triage completed type/enhancement En enhancement/improvement to an already existing feature

Comments

@fallen-up
Copy link

Issue submitter TODO list

  • I've searched for an already existing issues here
  • I'm running a supported version of the application which is listed here and the feature is not present there

Is your proposal related to a problem?

No response

Describe the feature you're interested in

mirrormaker2 has some service topics in a special format, since kafka version 2.7.0 it is now possible to view them manually.
It would be great if kafka-ui could do this too.

documentation:
https://cwiki.apache.org/confluence/display/KAFKA/KIP-597%3A+MirrorMaker2+internal+topics+Formatters
apache/kafka#8604

examples:
HeartbeatFormatter:
./bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic heartbeats --formatter org.apache.kafka.connect.mirror.formatters.HeartbeatFormatter --from-beginning
Heartbeat{sourceClusterAlias=B, targetClusterAlias=A, timestamp=1588502119726}

CheckpointFormatter:
./bin/kafka-console-consumer.sh --bootstrap-server localhost:9093 --topic A.checkpoints.internal --formatter org.apache.kafka.connect.mirror.formatters.CheckpointFormatter --from-beginning
Checkpoint{consumerGroupId=qwert, topicPartition=A.heartbeat, upstreamOffset=631, downstreamOffset=631, metatadata=}

OffsetSyncFormatter:
./bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic mm2-offset-syncs.B.internal --formatter org.apache.kafka.connect.mirror.formatters.OffsetSyncFormatter --from-beginning
OffsetSync{topicPartition=heartbeat-0, upstreamOffset=0, downstreamOffset=0}

Describe alternatives you've considered

No response

Version you're running

1.0.0

Additional context

No response

@fallen-up fallen-up added status/triage Issues pending maintainers triage type/feature A brand new feature labels Jun 13, 2024
@kapybro kapybro bot added status/triage/manual Manual triage in progress area/topics status/triage/completed Automatic triage completed and removed status/triage Issues pending maintainers triage labels Jun 13, 2024
@fallen-up fallen-up changed the title Support for mm2 topics deserialization FE: Support for mm2 topics deserialization Jun 13, 2024
@Haarolean Haarolean changed the title FE: Support for mm2 topics deserialization BE: Serde: Support mm2 topics serdes Jun 13, 2024
@Haarolean Haarolean added type/enhancement En enhancement/improvement to an already existing feature scope/backend Related to backend changes and removed type/feature A brand new feature status/triage/manual Manual triage in progress labels Jun 13, 2024
@Haarolean Haarolean added area/serde Serialization & Deserialization (plugins) and removed area/topics labels Oct 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/serde Serialization & Deserialization (plugins) scope/backend Related to backend changes status/triage/completed Automatic triage completed type/enhancement En enhancement/improvement to an already existing feature
Projects
Status: Todo
Development

No branches or pull requests

2 participants