Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Serde: Support __transaction_state topic #407

Open
2 tasks done
ver-alex opened this issue May 22, 2024 · 5 comments
Open
2 tasks done

Serde: Support __transaction_state topic #407

ver-alex opened this issue May 22, 2024 · 5 comments
Labels
area/serde Serialization & Deserialization (plugins) scope/backend Related to backend changes status/triage/completed Automatic triage completed type/enhancement En enhancement/improvement to an already existing feature

Comments

@ver-alex
Copy link

ver-alex commented May 22, 2024

Issue submitter TODO list

  • I've searched for an already existing issues here
  • I'm running a supported version of the application which is listed here and the feature is not present there

Is your proposal related to a problem?

I would like to be able to show content of the Kafka internal topics.

Describe the feature you're interested in

To get a better insight into the internal Kafka transactions topic __transaction_state it would be great to be able to show the key/value in a readable format. The necessary serdes/formatters should be available in the Kafka distribution/clients.

Describe alternatives you've considered

We are currently using the kafka-console-consumer.sh with the formatter for transactions.

$ kafka-console-consumer.sh --formatter "kafka.coordinator.transaction.TransactionLog\$TransactionLogMessageFormatter" --bootstrap-server localhost:29092 --topic __transaction_state --from-beginning

Version you're running

2956664 v1.0.0

Additional context

No response

@ver-alex ver-alex added status/triage Issues pending maintainers triage type/feature A brand new feature labels May 22, 2024
@kapybro kapybro bot added status/triage/manual Manual triage in progress area/messages status/triage/completed Automatic triage completed and removed status/triage Issues pending maintainers triage labels May 22, 2024
Copy link

Hi ver-alex! 👋

Welcome, and thank you for opening your first issue in the repo!

Please wait for triaging by our maintainers.

As development is carried out in our spare time, you can support us by sponsoring our activities or even funding the development of specific issues.
Sponsorship link

If you plan to raise a PR for this issue, please take a look at our contributing guide.

@Haarolean
Copy link
Member

I see that __transaction_state messages are not deserialized properly, but __consumer_offsets looks fine to me, can you attach a screenshot?

image

There's also a __consumer_offsets built-in serde which should be used by default for __consumer_offsets topic:
image

Copy link

kapybro bot commented May 22, 2024

Further user feedback is requested. Please reply within 7 days or we might close the issue.

@ver-alex
Copy link
Author

ver-alex commented May 23, 2024

Sorry, my bad. __consumer_offsets work as expected. Will amend the initial description.

Copy link

kapybro bot commented May 23, 2024

Thanks for the additional feedback! We'll get back to your issue soon.

@kapybro kapybro bot unassigned ver-alex May 23, 2024
@ver-alex ver-alex changed the title add support to show messages in __transaction_state and __consumer_offsets add support to show messages in __transaction_state May 23, 2024
@Haarolean Haarolean changed the title add support to show messages in __transaction_state Serde: Support __transaction_state topic May 25, 2024
@Haarolean Haarolean added type/enhancement En enhancement/improvement to an already existing feature scope/backend Related to backend changes area/serde Serialization & Deserialization (plugins) and removed type/feature A brand new feature status/triage/manual Manual triage in progress labels May 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/serde Serialization & Deserialization (plugins) scope/backend Related to backend changes status/triage/completed Automatic triage completed type/enhancement En enhancement/improvement to an already existing feature
Projects
Status: Todo
Development

No branches or pull requests

2 participants