Questions Marketplaces Should Ask before Running Tests - EcommerceBytes

Summary

It can feel like marketplaces are incessantly running tests to make tweaks or test new features, which can prove disruptive to sellers' routines. And because marketplaces rarely disclose the existence of a test, never mind the nature of a given test, it has gotten to the point sellers can't differentiate between tests and glitches.

It can feel like marketplaces are incessantly running tests to make tweaks or test new features, which can prove disruptive to sellers' routines. And because marketplaces rarely disclose the existence of a test, never mind the nature of a given test, it has gotten to the point sellers can't differentiate between tests and glitches.

So when Etsy engineer Theresa Eades wrote about tests in a post on the Etsy Code as Craft blog, we thought sellers would be interested in what she shared.

First, she disclosed some examples of issues her team encountered in two prior tests (which Etsy calls "experiments"):

"Two years ago, when my team worked on adding video to the listing page, we had to restart the experiment because we forgot to include specific event logging for our feature.

"Last year we implemented the key functionality for an experiment with the "add to cart" button, but neglected to get accessibility and text strings translated early, costing us a delay till the translations could complete."

She then explained how she created a standard checklist to help reduce such pitfalls when conducting product experiments.

Here are some of the more interesting questions on her checklist:

- Is there anything in my experiment that could degrade performance of the site?

- What populations should be included or excluded from the experiment?

- When should users see this feature? (Which pages, signed in/signed out, mobile, desktop, etc.)

- Where/when should bucketing occur?

- Will the experiment conflict with any other experiments? Do the experiments need to run exclusively?

- What countries should the experiment run in (can impact translations)?

Questions Marketplaces Should Ask before Running Tests - EcommerceBytes
Photo Credit: EcommerceBytes

Etsy, Inc. (ETSY) CEO Josh Silverman Presents at Oppenheimer 25th Annual Technology, Internet & Communications Conference (Transcript) - Seeking Alpha

Etsy, Inc. (NASDAQ:ETSY) Oppenheimer 25th Annual Technology, Internet & Communications Conference August 9, 2022 1:15 PM ET Company Participants Rachel Glaser - CFO Josh Silverm …

Read more here
Etsy, Inc. (ETSY) CEO Josh Silverman Presents at Oppenheimer 25th Annual Technology, Internet & Communications Conference (Transcript) - Seeking Alpha

I tried 3 TikTok-viral side hustles and lost 20 cents - Mashable

We live in a capitalist society intent on grinding down the human spirit into sellable parts. As such, for many people it is no longer enough to work a steady, full-time job in pur …

Read more here
I tried 3 TikTok-viral side hustles and lost 20 cents - Mashable

Etsy Misses Out on Opportunity To Support Sellers During Its Labor Day Sale - eSeller365

Etsy is asking sellers to participate in its Labor Day weekend sales event starting on August 31 targeting shoppers in the US and Canada. Unfortunately, the only way for sellers t …

Read more here
Etsy Misses Out on Opportunity To Support Sellers During Its Labor Day Sale - eSeller365

How to Take Advantage of Etsy's Repeat-Buyers Feature - EcommerceBytes

Etsy enhanced a feature that helps drive repeat buyers to individual sellers’ shops, and it offered tips on how sellers could take advantage of the feature. The “Etsy Updates feed …

Read more here
How to Take Advantage of Etsy's Repeat-Buyers Feature - EcommerceBytes

Etsy Seller Finances in Jeopardy, Reps Unable to Help - EcommerceBytes

An Etsy seller is in a vicious circle after changing bank accounts and trying unsuccessfully to update their account on Etsy with the new information. Unable to get customer servic …

Read more here
Etsy Seller Finances in Jeopardy, Reps Unable to Help - EcommerceBytes