1 visitor - 1 test : make the QA easier
under review
Léo Wiel
Merged in a post:
Improve 1 Visitor 1 test & QA rejection
N
Nick Stratton
Hello,
There is no good way currently to QA when you have 1 Visitor 1 Test enabled.
Problem:
I'm running into situations where clients use 1 visitor 1 test and express frustrations with not being able to QA. I'm trying to find a path forward to help these clients have a better QA experience while having this feature enabled.
As you know, QA with 1V1T enabled can be a pain.
- If you're already accepted to a test and you're trying to QA a new test with the same targeting, you'll be rejected with a status of 1 test 1 visitor
- Even if you fully flush the ABTasty cookie and try to QA that new test directly, you'll still get the same 1 test 1 visitor rejection as the test acceptance is conditioned based on numerical order of the test IDs
Clients get frustrated at this and it often ends up with them launching the test without QA. This is dangerous and can lead to them missing certain behaviors or errors in the test setup, leading to more frustrations.
Léo Wiel
Merged in a post:
Exclude 1 visitor 1 test from QA
Pierre Pellegrin
Hi team,
Showroomprivé uses 1 visitor 1 test option.
When they want to QA a test they have to remove cookies or use a private session in order to be targeted by a new test.
They find very painful.
They would like this option not to be activated when in QA.
Thanks :)
N
Nick Stratton
Hello, Five Below ($200k ARR) also report this pain
Blandine Paulet
under review
l
laurent.babicz@showroomprive.net
It will be very useful to continue to launch several tests at the same time
Arthur Charbit
laurent.babicz@showroomprive.net: Hi Laurent, thanks for your comment!
By this you mean launching several test and making them mutually exclusive?
l
laurent.babicz@showroomprive.net
Arthur Charbit We run several test in prod on same page with the 1 visitor = 1 test rule. But when we want to QA new ones we are assigned to existing test and sometimes in private mode too
I would like under QA to be able to switch from tests such as variations