Tag Archives: STELLA Ratings

Finally, no more late night trips to the store

Soap.com logoThe future is here. Well, maybe it’s not here yet, but it arrives sometime in July. With the upcoming launch of Soap.com, the founders of customer-obsessed Diapers.com are headed down a path to fundamentally improve the online customer experience for purchasing everyday products like toothpaste, hair brushes and…yes…even soap.

In what might be the most impressive behind-the-scenes look at how fulfillment technology and innovation are being used to WOW today’s online shoppers, this video shows precisely how Marc Lore and Vin Bharara, the creators of Diapers.com and the soon-to-be-launched Soap.com, are changing the way we buy online:

This amazing robotic back-end system will allow Soap.com to carry “every product in every category” and deliver those items NEXT DAY to two-thirds of the country (the rest of the country can expect two-day deliveries)…with free shipping to boot! Hard to imagine a better site for buying those everyday products.

And if that wasn’t enough, you can be sure that the company won’t let up on its non-stop friendly, knowledgeable and reliable customer support, which, combined with the other top-quality features of the shopping experience, earned Diapers.com an ELITE STELLA Rating. Diapers.com is a top-rated site for overall service and is neck-and-neck with legendary customer service champ Zappos.com.

If price, selection and service really are the three factors that determine where we buy online, it looks like Soap.com is about to take an enormous lead in the race to become the go-to destination for everyday essentials.

STELLA Ratings for Top 150 Sites

We’re very proud to announce the release of our STELLA Ratings for the 150 largest Internet retailers in the U.S. Through our comprehensive evaluations of every possible touch point for the leading Internet retailers,  we are now able to bring an unprecedented level of transparency to consumers around the service quality of today’s most well-known online stores.  Our ratings are rooted in objective data, covering over 300 unique customer service features, metrics and policies for each site.

Leverage our STELLA Ratings to help you steer clear of frustrating companies that provide horrible customer service (I think we can all appreciate the value in that), and also keep your eyes peeled for our STELLAService Seal, which is displayed on top-rated sites like Zappos.com and Diapers.com.  Here at STELLAService, we’ll continue to analyze and identify those companies which are truly customer-centric and focused on providing the best service possible.

Seller Ratings: Wisdom of a Certain Crowd

When people talk about the “wisdom of the crowd”, they are usually referring to the aggregation of information in groups that results in accurate conclusions or decisions. Made especially popular by James Surowiecki’s The Wisdom of Crowds: Why the Many Are Smarter Than the Few and How Collective Wisdom Shapes Business, Economies, Societies and Nations, the theory has supplied us with some  entertaining anecdotes about the accuracy of crowd-driven calculations (Surowiecki tells a story about how a large crowd was accurately able to guess the weight of an ox when the crowd’s individual guesses were averaged). As it happens, I tend to enjoy reading these stories to uncover where and when the wisdom of the crowd can bring truth – or wisdom – to strange or otherwise unsuspecting situations.

However, there are specific elements required to form a “wise crowd”, as Surowiecki calls it, and when it comes to the very business with which I’m engaged (measuring the service quality of Internet retailers), I think there’s a lot of confusion and misconception about the use of (and value from) community-driven seller ratings, which many people confuse as a perfect application of the wisdom of the crowd theory. To determine whether or not these seller ratings are indeed giving us the wisdom of the crowd, there are three criteria that must be met (according to Surowiecki):

  1. Diversity of opinion
  2. Independence
  3. Decentralization

Question: are online seller ratings like the ones on BizRate or Amazon’s marketplace truly driven by a genuine wisdom of the crowd?  We weren’t sure, so we turned to people that know more about this stuff than we do…MIT. In an MIT Technology Review article entitled ”Can You Trust Crowd Wisdom?“, Vassilis Kostakos, an adjunct assistant professor at Carnegie Mellon, confirms with his team that the rating systems commonly used by online consumers can “easily be swayed by a small group of highly active users.” The article goes on to say that rating systems can paint a distorted picture if a small number of users do most of the voting. And sure enough, after looking at millions of votes across Amazon’s community ratings system (albeit for products, not sellers), he came to the conclusion that “a small number of users accounted for a large number of ratings….and only 5 percent of active Amazon users cast votes on more than 10 products. A handful of users voted hundreds of items.” Even with the incorporation of mechanisms designed to control the quality of ratings –  such as allowing users to vote on the helpfulness of other users’ reviews – there are significant dangers in placing your complete trust in the accuracy of these ratings.

Based on Dr. Kostakos’ findings and looking back to Surowiecki’s criteria for identifying a truly wise crowd, it appears that community-driven seller ratings aren’t quite as wise as people probably think:

  1. Diversity of opinion – When a relatively small number of highly active users provide the overwhelming majority of the ratings and reviews (like they do on Amazon), the scores or ratings cannot in any way represent the diverse set of opinions and experiences required for the entire crowd. It’s actually the opposite.
  2. Independence – User-driven ratings and reviews are inherently biased, and it is impossible to determine whether or not a given rating has been influenced by friends, family, or even competitors of the retailer being rated. Ever wonder why YouTube ratings always tend toward extremes? Most people are only motivated to speak up if they “love it or hate it”. If there’s one thing community driven ratings are not, it’s independent.
  3. Decentralization – While one could argue that the internet is the ultimate decentralizer – pulling people, perspectives and information from every corner of the globe – it doesn’t much matter if there’s a minority of users who control the ratings. Decentralization could occur if this “minority” of active reviewers were exactly proportionate in its demographics, locations and opinions to the customer base of the store in question…but even if it that were somehow true, how would we ever know?!

Even though it’s clear that community-driven seller ratings fail to qualify as a representation of the wisdom of the crowd, can  they still be helpful and provide some useful information? Yes, they’re obviously better than nothing. But standing alone, do they provide enough information for online consumers to feel completely comfortable that they’re making the best possible purchasing decision? Not at all.

What’s the solution? A dual-rating system, which has been successfully pioneered by Metacritic.com and Gamespot.com in which the community and the objective, third party experts have their say. Whether evaluating the merits or quality of a camera, a restaurant, a video game or an Internet retailer, consumers increasingly want more information, and from more sources. While movie go-ers are interested in what the “crowd” thinks of the Alice in Wonderland in IMAX 3D, they are also interested in what the critics, or the experts, say.  The ”expert” rating allows consumers to combat the potential biases, extremes and inconsistencies of user-driven ratings and provides the perfect point of comparison for someone who remains understandably skeptical from the community’s opinion.

It might be possible for the real wisdom of the crowd to be reflected through a user-driven rating if the crowd were somehow able to meet the above-mentioned criteria, but the ultimate problem facing consumers is that they would still have no way of knowing if the difficult “wisdom of the crowd criteria” had been met or not…and the only way to reassure them that the ratings can be trusted is by the presence of a completely independent, unbiased and professional rating right there next to it. I think Niki Kittur, an assistant professor at CMU who studies user collaboration on Wikipedia, summed it up nicely: ”There are both intentional and unintentional sources of bias” in user-driven rating systems. “In the end, what we really need [are] tools and transparency.”

More information from more independent sources drives transparency. So when it comes to measuring the service quality of an online retailer, you’ll now have one more “tool”, or information set to further enhance transparency:  our STELLA Ratings.

You say STELLA, we send SALSA!

Can you guess the #1 highest grossing condiment in the United States?  Nope, it’s not mustard, or even ketchup with their nifty new packaging.  It’s salsa!  Some say it’s because salsa doesn’t “keep” as long, but we, along with Jerry Seinfeld, think it’s because people just like to say salsa.

And aside from saying it, we like to eat it and share it too!  That’s why from now until next Wednesday, March 17th at 6PM EDT, we are offering you a chance to win a 3-month subscription of premium salsa from AmazingClubs.com.

How does it work?  It’s simple!

STEP 1: Tweet!  (and tweet some more)

STEP 2: Mention #STELLAService

STEP 3: Follow @STELLAService to see if you’ve won the tasty salsa prize!

Don’t waste any more time –  get your tweet on by clicking the sample tweet below!

You say #STELLAService, they send #salsa! Join the tweeting fun and enter a chance to win 3 months of gourmet salsa!

You can also visit our website for complete details.

We are thrilled to be on the verge of announcing our first “batch” of STELLA Ratings, so please remember to follow @STELLAService so you can stay tuned to our salsa give-away in addition to all of the other exciting new developments for STELLAService!

Follow

Get every new post delivered to your Inbox.

Join 60 other followers