Recommendations for E2E testing addins

[schmkr]

Hello,

For our add-in in Outlook, we have written End-to-End-tests using Playwright. This works just fine, even with logging in and MFA.

One thing we have run into though, is it seems Playwright needs to be running in headed mode and cannot run headless. Whenever it runs headless, the user ends up in a different (more basic/lightweight) version of Outlook online:

I am aware some websites implement anti-headless-browsers measures and that there are ways to circumvent those measures. Unfortunately, without success, up to now.

So I was curious, to hear from the community or Microsoft, is there a way to ensure even an headless browser ends up on the "modern" or "regular" online Outlook, even when using a headless browser?

This will allow us to ensure our add-in for Outlook online customers functions as expected and does not break user's experience.

[merkelfleet]

Hey. I don't have any answers to your questions, but I have a few questions of my own.
I also would like to add E2E tests for our Excel add-in. There is no documentation about this topic on the official pages.

How did you created your Playwright environment and the tests? And how do you use your add-in in the tests? Is there a guide I can follow?