Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update (Billing) Consumers to emit accepted outcomes for indexed transactions. #3696

Open
Dav1dde opened this issue Jun 6, 2024 · 4 comments
Labels
filler Requires little effort to resolve. Ready to be picked up anytime.

Comments

@Dav1dde
Copy link
Member

Dav1dde commented Jun 6, 2024

After #3662

  • Update billing consumer to not emit accepted outcomes for transaction metrics with the sampled: true tag
  • Update transaction consumer to not only emit accepted outcomes for the TransactionsIndexed category but also the Transactions category.

This will make our counts overall more consistent.

Todo: investigate the same for Spans

@jjbayer
Copy link
Member

jjbayer commented Jun 6, 2024

These changes should be deployed together, but even if they are, there might be some wrong reporting because consumers do not restart at exactly the same time. I.e. maybe this new behavior should be controlled by a global option.

@olksdr olksdr added the filler Requires little effort to resolve. Ready to be picked up anytime. label Jun 10, 2024
@jjbayer
Copy link
Member

jjbayer commented Jul 3, 2024

Let's discuss priority again in Monday's meeting. As we saw for profiles, after metrics extraction the "total" data category (e.g. Transaction) is currently double-represented after metrics extraction, so it is possible to report multiple outcomes for the same payload if it gets dropped after metrics extraction:

flowchart LR
    o -->|payload| metrics_extraction
    metrics_extraction -->|payload| more_processing
    more_processing -->|outcome: dropped| outcomes 
    metrics_extraction -->|metrics| metrics_consumer
    metrics_consumer -->|outcome: accepted| outcomes
Loading

We need to either implement this ticket to give the payload full ownership over the data category, or introduce a if metrics_extracted condition to the index_category() function to make sure the payload stops representing the "total" category after metrics extraction.

@jjbayer
Copy link
Member

jjbayer commented Jul 3, 2024

See also #3767.

@jjbayer
Copy link
Member

jjbayer commented Jul 8, 2024

Decision: implement ownership in consumer as the description states. Requires tagging of the usage metric with a sampled tag.

Idea: Pass the sampled state into metrics extraction by having a composite impl Getter that combines the event with the dynamic sampling decision.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
filler Requires little effort to resolve. Ready to be picked up anytime.
Projects
None yet
Development

No branches or pull requests

3 participants