Make Transactions Fail when Test Fails

[scefali]

It will be a lot easier to see which tests are flaky if we can make the transition fail for that test so we can look at failure rates on each test as a transaction in Sentry.

[untitaker]

@scefali were you planning to work on this feature? I think it's not that hard to impl

[scefali]

@untitaker No I wasn't but if you think it's that easy I can try

[untitaker]

I think you want to grab the current transaction and set the status, right around here:

pytest-sentry/pytest_sentry.py

Line 188 in 1e9cb69

sentry_sdk.set_tag("pytest.result", "pending")

we already do something that here: https://github.com/getsentry/sentry-python/blob/f4c19e168d15fbb7caa942333d048a85f147045c/sentry_sdk/integrations/celery.py#L319

Just substitute hub for Hub.current