large_Crossover Series NFTs.png

medium_Crossover Series NFTs.png

small_Crossover Series NFTs.png

thumbnail_Crossover Series NFTs.png

From Photography to NFT Art: Twisted Digital Landscapes with Nate Hill

From Design System to ‘NFT Design System’: Creating TinyFaces

Neurodiversity and Inclusion: Choosing Kinder Design

medium_652ccf22c8853584bde5553986a4eed0.png

small_652ccf22c8853584bde5553986a4eed0.png

thumbnail_652ccf22c8853584bde5553986a4eed0.png

Web5 is here. Goodbye Web3? TBD.

<p><a href="http://ift.tt/2pdzuVl">medium bookmark / Raindrop.io</a> |  </p>
<div><img src="http://ift.tt/2pGFGrL" alt="stars thumbs ux ratings"></div>
<p>Netflix officially ditched its classic 1-to-5-star rating system for a binary thumbs-up, thumbs-down rating system. They made the <a href="http://ift.tt/2pfOCkS">in-product announcement</a> last month with a full-screen overlay that promises ease.<img src="http://ift.tt/2pGiqKq" alt="netflix thumbs rating announcement"></p>
<p></p>
<p>In addition to the new rating system, Netflix has new match percentages (up to 100%) to more accurately predict how much users will like something:</p>
<p><img src="http://ift.tt/2pfDODx" alt="netflix new ratings stars percent match">The new rating system received 200% more ratings in A/B tests, <a href="http://ift.tt/2mUB1B1">according to Netflix VP of Product Todd Yellin</a>.</p>
<p>When it comes to rating movies and shows, stars reflect the preferences that people want to have, rather than how people actually behave. Todd gave the example of users giving 5 stars to a documentary but just 3 stars to an Adam Sandler movie that they watched over and over again. “What you do versus what you say you like are different things,” said Todd. </p>
<p>The change <a href="http://ift.tt/2nSgmeT">has annoyed some of Netflix&#8217;s 100 million subscribers</a>, but this isn’t the first time a major content provider favored thumbs over stars.</p>
<p>In 2009, YouTube made the same shift after realizing that most users only rated videos they loved, with a smaller portion rating videos that they hated. Users rarely gave videos 2-, 3-, or 4-stars as demonstrated in <a href="http://ift.tt/2pGwT93">this J-shaped curve</a>:</p>
<p><img src="http://ift.tt/2pfHkhc" alt="youtube 5-star ratings"></p>
<p>Source: <a href="http://ift.tt/2n5ifH0">YouTube</a></p>
<p>Simpler rating systems might <a href="http://ift.tt/2pforet">improve user engagement</a> for Netflix and YouTube, but switching to thumbs-up, thumbs-down might not be the right decision for your product.</p>
<h3>How Ratings Can Drive User Engagement</h3>
<p></p>
<p>Ratings serve different purposes for different products and different users. Before you can answer which rating system will work best for your product, it’s important to come back to the why. Here are some of the things that ratings can help do:</p>
<ul>
<li>Ratings help you better understand individual preferences and present a more <a href="http://ift.tt/2n9L4Rg">personalized user experience</a>. This is especially true for products that have sophisticated algorithms for personalization, like Netflix. The more a user rates, the smarter your product becomes in adapting to their taste and making recommendations. </li>
</ul>
<ul>
<li>Aggregate ratings help inform users and guide their decision-making. This works for products that have high or low degrees of personalization (a brand new user on Amazon will still benefit from average ratings even if they don’t receive personalized offers). It’s especially useful for products that require longer buying-decision time. </li>
</ul>
<ul>
<li>The user feedback helps products understand whether or not the content is valuable and improve offerings over time. This can benefit products with and without sophisticated personalization.</li>
</ul>
<p>Depending on which of these—or other—factors are most important to your product, you may opt for stars, thumbs, or another rating system altogether. </p>
<h2>Star ratings help users make complex decisions</h2>
<p></p>
<p>While most products want to increase the speed of purchases, there might be an inherently high buying-decision time for certain goods. </p>
<p>A person who likes shoe shopping may want to look at hundreds of different shoes and read dozens of reviews before settling on the perfect pair. Zappos’ 5-star ratings, accompanied by even more detailed “fit survey” percentages, are helpful in guiding the decision.</p>
<p><img src="http://ift.tt/2pfqbEh" alt="zappos stars percentage">Stars ratings are often accompanied by qualitative reviews, which further aid deeper considerations. This is true of online retailers like Zappos, Amazon, and Nordstrom, among others. </p>
<h3>Qualitative reviews, with stars, increase engagement time but can delay key actions</h3>
<p>Increasing complexity with stars and qualitative reviews is a good combination if time per session is an important engagement metric for your product. </p>
<p>Yelp is a site for restaurant reviews. While people can make reservations and book events on the platform, it’s primarily known as a destination for crowd-sourced reviews. One of Yelp’s <a href="http://ift.tt/2pGAeF4">engagement metrics</a> might be around time on platform, which might be more important than the conversion from looking up a restaurant to eating a meal there.</p>
<p>More complex ratings, alongside 5-star reviews, probably help Yelp make their site more interesting and browse-worthy.</p>
<p><img src="http://ift.tt/2pfAJ6n" alt="yelp review writing">When users have more creativity with their reviews, the reviews can become a point of pride and meaning. Yelp has done an excellent job <a href="http://ift.tt/2psb2mC">gamifying their reviews to massively grow their user base</a>. </p>
<p>In contrast, OpenTable has a shorter path to activation. They are in the business of helping people make reservations and may not want to encourage aimless browsing that does not lead to a conversion. They present a mix-bag of stars and a thumbs-up.</p>
<p><img src="http://ift.tt/2pfFVHl" alt="opentable browsing">This gives enough information for users who do want to browse around but also a shortcut to make a quick decision.</p>
<h2>Thumbs-up ratings help products personalize content</h2>
<p>One of the reasons that Netflix adopted a binary system was because they used star-ratings differently than other products. The stars were predictions of how much Netflix thought users would like something, not an average of community ratings.</p>
<p>Netflix Director of Product Innovation Cameron Johnson <a href="http://ift.tt/2nJT8ra">told Business Insider that</a> people didn’t intuitively understand that Netflix’s stars would get more personalized with more ratings. </p>
<p>Other products that are dependent on personalization have long used binary ratings. Pandora curates radio stations based on your listening preferences. To get feedback, they use a simple thumbs-up or thumbs-down. Thumbs-down also skips the song.</p>
<p><img src="http://ift.tt/2pfEhpm" alt="pandoa evaluation thumbs rating">Spotify also uses thumbs-up, thumbs-down rating for its radio feature, which provides new music based past behaviors.</p>
<p><img src="http://ift.tt/2pGrnTK" alt="spotify stars">Products with sophisticated personalization and curation abilities seem to favor binary rating systems. Simplier rating systems could help products gather larger datasets and may encourage users to make a split-second decision. </p>
<h2>Other rating systems to consider</h2>
<p>Stars and thumbs-up, thumbs-down are two popular rating systems, but <a href="http://ift.tt/2pfN1M4">they’re not the only ones out there</a>. Some products use 10-point ratings (IMBd), 100-point ratings (Rotten Tomatoes), only upvotes/likes (GrowthHackers), and emoji ratings. </p>
<p>While this post can give you some ideas of how other products are using different rating systems, experimenting within your own product will help you find a more definitive answer. </p>
<p>Netflix made their change after extensive testing. As <a href="http://ift.tt/2mUB1B1">Netflix&#8217;s Todd Yellin</a> said, “We are addicted to the methodology of A/B testing.”</p>
<div><a href="http://ift.tt/2pdzuVl">http://ift.tt/2pdzuVl</a></div>


5-Star vs. Thumbs-Up: When to Use Which Rating System

5-Star vs. Thumbs-Up: When to Use Which Rating System

Top Stories