Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Latency metric on topics with few offsets #384

Open
mwarkentin opened this issue Aug 30, 2024 · 0 comments
Open

Latency metric on topics with few offsets #384

mwarkentin opened this issue Aug 30, 2024 · 0 comments

Comments

@mwarkentin
Copy link
Member

I created some global monitors using the sentry arroyo latency and a fallback for sbc arroyo latency (since there are data team monitors as well).

I'm attempting to use Datadog's no data reporting to have a fallback for when the consumer is broken and stops reporting latency entirely, however it seems like on topics with little activity, we also stop reporting latency.

I suspect this is because Arroyo records this metric during commit.

Would it be possible to record a latency metric of 0 if there is no new offsets to process? This makes more sense to me than not recording a metric at all and would improve this use case.

Are there any reasons not to do this?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant