Friday, February 27, 2015

Data and the User Experience

Post 2: Data and the User Experience
By Matt Wheeler


Last month we shared some of the technology behind Polyvore’s Style Profile and how we’re using machine learning to understand our users' individual style to recommend more personalized products and outfits.


We discovered that our unique set data (our users create over 3 million sets every month) helps improve the recommendations to create a more engaging shopping and discovery experience for our users. Let’s dive into more detail:


Without divulging too much of the secret sauce, we recently developed three independent algorithms -- or “streams,” as we call them-- that we use to generate product recommendations.
  1. Stream 1: Generates recommendations based on a user’s brand-affinity (a passion for Prada, for example).
  2. Stream 2: Generate recommendations based on collaborative filtering: items that similar users have liked.
  3. Stream 3: Leverages the talent of our awesome community of creators by recommending items frequently paired in sets.


We decided to get a deeper understanding of how users react to the three types of recommendations by launching an experiment that tests each stream. The results are pretty interesting and give us insight into ways that we can improve our user experience.


Which of the three streams do users prefer?
One of the features we make available is the ability to “like” a product. We can use these likes as a tool for measuring the quality of our recommendations. That is, if we show you 20 items and you like 10 of them then we are doing much better than if we show you 20 items and you like 5 of them.


We looked at the distribution of like rates data to understand which streams users prefered:


like_rate_boxplot.png
Figure 1 - Overall like rate distribution (median = black horizontal bar)


The horizontal black lines in the middle of the boxes are the median like rates for each recommendation type. The boxes themselves represent the range of like rates in which most users fall. It is clear that the similar-users-based recommendations are the most popular, followed by the Polyvore set-based recommendations, with the brand-based recommendations bringing up the rear. So, we should focus our energies on increasing the number of impressions from user-based recommendations, right? Well, maybe. The overall variances in the individual like rates is relatively high (the boxes cover a lot of area on the graph).


Does this mean that we have a lot of heavy “likers” and a bunch of “non-likers”? Does it mean that users actually have individual preferences for recommendation type? Or does it mean something else entirely?
To answer these question, we used each user’s likes to create their “perfect mix” of streams and compared it against the average user’s perfect mix. For instance, if we showed you 100 recommendations from each stream and in each stream you liked 10 items, then your perfect mix would be an even 33%/33%/33% mix of recommendations from each stream. If the average Polyvore user’s perfect mix was 40% similar-user-based recommendations, 35% set-based recommendations, and 25% brand-based recommendations then we would say you have a -7% relative affinity for similar-user-based recommendations, a -2% affinity for set-based recommendations, and a +8% affinity for brand-based recommendations. Plotting these affinities per user in ascending order we get the following graphs:


stream_mix_diff.png
Figure 2 - Distribution of individual preference for each of the three streams. The x-axis is individual users, sorted by increasing stream affinity. A positive .1 means that a user’s ideal mix of streams would add an additional 10% to the average mix (e.g. go from 25% of total individual impressions to 35% of total individual impressions). Note that it is not possible for a stream to be increased in a user’s ideal mix without a decrease in at least one other stream.


In each of these graphs, a large negative value indicates a user who likes the stream much less than the average Polyvore user, while a large positive number indicates someone who likes the stream much more. We can see that, for each stream, there is a non-trivial minority of users who have a strong positive affinity. There is a similarly sized minority who have a strong negative affinity. This suggests that we could improve the individual user experience by showing users more impressions from the streams they like and fewer from those they dislike.


Testing our hypothesis with an experiment:
Another interesting finding concerns the relationship between user’s reactions to the streams. It turns out that there is a pronounced negative correlation between brand-based affinity and similar-user-based affinity:


user_vs_brand.png
Figure 3 - 95% prediction interval of similar user affinity regressed on brand affinity


This chart uses the same values as those in Figure 2 and shows that users who have a strong affinity for recommendations based on similar-users generally have a strong negative affinity for brand-based recommendations, and vice versa. Interestingly, this relationship is much weaker when comparing similar-user-based affinity with set-based affinity.


user_vs_set.png
Figure 4 - 95% prediction interval of similar user affinity regressed on set affinity


This tells us that users who like recommendations from other users also appreciate -- or at least are not overly annoyed by -- recommendations based on sets. We see this same weak relationship when we compare brand-affinity folks to the set-based stream.

brand_vs_set.png
Figure 5 - 95% prediction interval of brand affinity regressed on set affinity

This is great news for us! Making recommendations based on sets is something that only Polyvore can do, and the data suggests that investing time to improve these recommendations will only complement the user experience. Our creators’ sets are a rich store of fashion data and this set-based product recommendation algorithm only scratches the surface of what’s possible. All is powered by the unique data from our creators’ sets. Stay tuned.  

96 comments:

  1. Generate easy heroes of the storm keys giveaway and enjoy the unlimited gold and coin for free for heroes of the storm.

    ReplyDelete
    Replies
    1. Situs Resmi Obat Kuat hammer of thor, Harga dan Ciri Asli Hammer semakin hari Harap dimaklumi masalah seperti ini tidak pernah ada materi yang mengajarkan di sekolah ataupun dalam rumah oleh orang tua karena kasus seperti ini di anggap sangat tabu. Maka dari itu kami menyimpulkan dalam sebuah kesimpulan nyata beberapa tips tata cara bagaimana cara merawat penis dengan baik dan benar. Basuh Air mengapa..karena air sangat penting untuk kesehatan tubuh 70 % tubuh kita mengandung air, termasuk kesehatan organ vital Anda.

      Hal ini disebabkan karena air mampu membuang banyak racun dari tubuh serta mempertahankan jumlah darah dan oksigen di dalam penis. Faktor kesehatan fisik dan mental memainkan peran hammer of thor of thor Asli dalam fungsi alat vital pada pria. Jika Anda sedang stres karena pekerjaan atau hubungan yang buruk, menderita depresi, kecanduan alkohol atau obat-obatan, atau kelebihan berat badan dapat membuat alat vital anda berfungsi kurang baik. Untuk menyingkirkan rambut kemaluan bisa dengan mencukur Foto Memek.

      Tetapi berhati-hati lah saat menggunakan salah satu metode tersebut Jika menggunakan pisau cukur Foto Bugil Asli pastikan mengasah pisau secara teratur. Pilihan terbaik dan paling aman untuk mengurangi risiko luka dan infeksi karena pemangkasan rambut kemaluan ini adalah dengan gunting. Menjaga kesehatan reproduksi wanita dan pria bisa dilakukan dengan menjaga kesehatan alat reproduksi. Ada banyak cara sederhana untuk menjaga alat reproduksi pria dan wanita apabila organ intim mengeluarkan cairan cairan tertentu Obat Kuat hammer of thor harus sering dibersihkan Setelah buang air baik kecil maupun besar maka tangan juga harus dibersihkan Kotoran sisa yang menempel setelah buang air besar atau kecil bisa menyebabkan iritasi bahkan membuat infeksi. Bagi wanita sangat penting untuk membersihkan organ kewanitaan dari depan kebelakang bukan dari belakang ke depan Foto Ngentot.

      Delete
  2. Rubber lawn playground mats are created under hygienic as well as bacteria free of charge environment, these types of mats provides your kid’s as well as playground safety and security RUBBER GRASS PLAYGROUND MATS

    ReplyDelete
  3. the diagram shows the results by changes the matter. Dissertation proposal online

    ReplyDelete
  4. Click this given below link clash of clan cheats then you can easily get clash of clans gems generator.

    ReplyDelete
  5. Hi dude, I am really enjoying reading your well written articles.Digital tickets Please post for other article :

    ReplyDelete
  6. The motivated work and reading on this platform, I appreciate it. Keep sharing!

    Superman Black Jacket

    ReplyDelete
  7. it is the best place to know how to hack facebook account from the generators online here.

    ReplyDelete
  8. If you are applying to college or graduate school, odds are you have to write dozens upon dozens of unique application essays, all responding to different prompts. It may seem like such a tedious, daunting task that you want to give up, re-use essays, or just not try very hard on each one. It may seem like application essays are dry or boring, and that no one on the other end actually reads them. Get admission essay writing service for best college entry.

    ReplyDelete
  9. Exceptional! It is extremely critical to take action on that details and collect more and more information in the circle of reading. Inspirational!
    assignment writing uk

    ReplyDelete
  10. Great post. I did previously be checking constantly your blog and I am impressed. free itunes gift card codes

    ReplyDelete
  11. Great article! This reading is explained with key points and so effective for the learning.
    rick grimes jacket

    ReplyDelete
  12. I would like to thank for the efforts you have made in writing this post. I am hoping the same best work... UK Dissertation Writing 

    ReplyDelete
  13. Polyvore is going in the right direction for sure.

    Click this link

    ReplyDelete
  14. Very interesting blog. Alot of blogs I see these days don't really provide anything that I'm interested in, but I'm most definately interested in this one. Just thought that I would post and let you know.
    geometry dash| sniper games |happy wheels | happy wheels 2 |agario| my little pony games mickey mouse games mahjong |pacman

    ReplyDelete
  15. Very interesting blog you have posted here. I recommend custom essay writing service for good college papers.

    ReplyDelete
  16. All the Match details Match venues and matches schedules of t20 worldcup 2016. Live score T20 worldcup t20 WC live Streaming

    ReplyDelete
  17. This comment has been removed by the author.

    ReplyDelete
  18. This is our latest design pakistan dress design site India Pakistani,mobile phone health beauty cosmetics fashion designs and much more is available.

    ReplyDelete
  19. I really had a great time with your post! I am looking forward to read more blog post regarding this! Well written
    awriter.org

    ReplyDelete
  20. You are a very good person, I think. I feel your views very interesting and creative, I have learned a little from it. I will use it in my life. descargar facebook gratis , descargar whatsapp gratis , whatsapp descargar

    ReplyDelete
  21. O aplicativo dedicado de bate-papo surgiu das cinzas do Beluga Messenger, cliente de bate-papo que foi comprado pelo baixar Facebook no começo do ano. A versão para iOS estará disponível em breve, mas a versão para Android já está disponível nesse link.
    Source: facebook movel baixar

    As versões anteriores do Mobogenie app estão cada vez mais populares entre os usuários, oferecendo maneiras simples e atraentes para sincronizar telefones sem aborrecimentos.
    Source: mobogenie
    ----------
    Signture:
    Baixar whatsapp

    ReplyDelete
  22. If your account is temperorally blocked , find here so,me amazing tricks to prevent your fb account from inactivity expiration through fb hack and lot more fun to do free.

    ReplyDelete
  23. Very interesting blog. Alot of blogs I see these days don't really provide anything that I'm interested in, but I'm most definately interested in this one. Just thought that I would post and let you know.
    geometry dash| sniper games |happy wheels | happy wheels 2 |agario| five nights at freddy's

    ReplyDelete
  24. Very nice to see this site. The best resume headline provide the list of all schools, colleges and specialist courses attended, along with the relevant dates and grades.

    ReplyDelete
  25. Thanks for the best blog.it was very useful for me.keep sharing such ideas in the future as well.this was actually what i was looking for,and i am glad to came here!
    earn to die
    Hi! I’ve been reading your blog for a while now and finally got the courage to go ahead and give youu a shout out from Austin Texas! Just wanted to tell you keep up the fantastic work!my weblog:
    tank trouble
    tank trouble

    earn to die 1

    earn to die 2

    earn to die 3

    tank trouble 4
    tank trouble 3
    tank trouble 2

    ReplyDelete
  26. If you wanna see recipes, health tips then must visit this.

    ReplyDelete
  27. I like this post, it's useful with me. Thank you very much!
    Auto reviews

    ReplyDelete
  28. Very interesting blog. Alot of blogs I see these days don't really provide anything that I'm interested in, but I'm most definately interested in this one. Just thought that I would post and let you know. happy wheels

    ReplyDelete
  29. Flash game for one Happy Wheels or two players in which a couple of tanks will face each other in a maze and will try to eliminate the opponents. Tank Trouble The game has two multiplayer modes, for two or three people that will make you trip into the maze a lot more interesting.Age of War 6

    Free Online Games

    Age of War 3

    Gold miner

    If a ageofwaraz.Pizzeria serves pizzas, then naturally a Burgeria would serve burgers. However, Papa’s Burgeria will make any delicious hamburger or cheeseburger to order, and it just so happens his customer’s are as picky as they come Age of War 6. In this frantic sequel to Papa’s Pizzeria, you play as either Marty or Rita, cooking, building, and serving the craziest burgers in town. Work up the ranks and become a patty flipping master!

    Hi! I’ve been reading your blog for a while
    now and finally got the courage to go ahead and give youu a shout out from Austin Texas! Age of War 4 Just wanted to tell you keep up the fantastic work!my weblog:Age of War 5 Take control of 16 different units and 15 different turrets to defend your base and destroy your enemy.Age of War 2

    ReplyDelete
  30. A nova versão Facebook baixar para Windows Phone foi totalmente reformulado, com um desempenho mais rápido, uma nova interface de usuário, navegação melhorada, suporte para várias resoluções, tamanhos de telha e muito mais.
    O baixar Mobogenie ainda dá a possibilidade de levar todos os dados do computador para seu celular. Graças a seu simples sistema de transferência de arquivos, você pode mudar imagens, vídeos, músicas, planilhas e até outros arquivos.

    ReplyDelete
  31. Whirlpool Spare Parts An Authorised Distributor of home appliance spare parts in the nation, Appliance Spares Warehouse is now offering Whirlpool spare parts for ensuring long life of the washing machines. Repairing the damaged Whirlpool washing machines with their spare parts can save time and effort of the individuals involved in manual hand washing.

    ReplyDelete
  32. This is quite an interesting blog, i need not to mention the professional way you have arranged the content and images. Thank you for making it possible for us to share our thoughts. Profile activities help you can count on.

    ReplyDelete
  33. Diep.io is a new addition in which you control a tank and shoot down both obstacles and opponents. Diep.io, which is quickly becoming the next Agar.io style game sensation. Diep.io is a funny muliplayer tanks shooting game. Control a tank, shoot opponents and obstacles, upgrade your tank while trying to keep alive.

    ReplyDelete
  34. Obrigado a todos análise muito detalhada. Se você tiver tempo você pode olhar para o nosso site Baixar facebook gratis . Eu acho que é um local popular e pode ser necessário

    ReplyDelete
  35. A nova versão Facebook baixar para Windows Phone foi totalmente reformulado, com um desempenho mais rápido, uma nova interface de usuário, navegação melhorada, suporte para várias resoluções, tamanhos de telha e muito mais.
    O baixar Mobogenie ainda dá a possibilidade de levar todos os dados do computador para seu celular. Graças a seu simples sistema de transferência de arquivos, você pode mudar imagens, vídeos, músicas, planilhas e até outros arquivos.

    ReplyDelete

  36. The war between humans, orcs and elves continues. Lead your race through a series of epic battles, using your crossbow to fend off foes and sending out units to destroy castles. Researching and upgrading wisely will be crucial to your success!
    age of war 3 | age of war | unfair mario 2 | tank trouble 3 | tank trouble
    The game controls are shown just under . Movement mechanisms primarily include acceleration and tilting controls.
    cubefield | tank trouble | happy wheels | slitherio | gold mine

    ReplyDelete
  37. The information you provide is very useful and it makes me feel extra good information, thank you for sharing it.
    Y3 games | Y8 | racing games | yepi | Kizi games | Frozen Games,
    Friv 2 Games,

    ReplyDelete
  38. Capstone Projects Writing Company. This is a very nice post that gives an insight into Polyvore's product, technology and culture. I have to say that I have gained a lot from your post. Thanks a lot for sharing. Potato Cells Lab Report Help

    ReplyDelete
  39. It is a wonderful information and also get good knowledge and ideas from this article. The author is giving good thoughts and suggestions to each and every readers through this article.The good advantages of this article is giving good thought to each and every readers and also it’s giving good impressions. Looking forward to another article.
    iasosource.com | emblemzone.com

    ReplyDelete
  40. Virginia Web Design I wanted to thank you for this great read!! I definitely enjoying every little bit of it I have you bookmarked to check out new stuff you post.

    ReplyDelete
  41. The war between humans, orcs and elves continues. Lead your race through a series of epic battles, using your crossbow to fend off foes and sending out units to destroy castles. Researching and upgrading wisely will be crucial to your success!
    slitherio | unfair mario 2 | age of war 2
    The game controls are shown just under . Movement mechanisms primarily include acceleration and tilting controls.
    cubefield | tank trouble | happy wheels |earn to die 1 |
    earn to die 6 |earn to die 6| duck life

    ReplyDelete
  42. We are really grateful for your blog post. You will find a lot of approaches after visiting your post. Great work.
    contact form | snapchat emoji

    ReplyDelete
  43. This is a great article. It gave me a lot of useful information. thank you very much. Can you play more games at :
    strike force kitty 2 | swords and souls 2 | red ball 3 | ninjago games

    ReplyDelete
  44. Run game is today's hottest games. Run 3 version is most played game, run 2 is the older version, but still favorite players. In addition, return man 2 game is a big competitor of run game. Right behind return man game is cat mario 4 game which has plays No. 4 in the rankings this week.
    Source: tank trouble unblocked and stick war unblocked

    ReplyDelete
  45. Really unbelievable, is not as easy as you can see, the posts difficulty and challenge waiting for you and that's the main difficulties that make us interesting.
    Unblocked Craft, friv 2 games, abcya

    ReplyDelete
  46. Thanks for the best blog.it was very useful for me.keep sharing such ideas in the future as well.this was actually what i was looking for,and i am glad to came here!
    kids games free | games games | shooting games | tank games | apple shooter | stick war 2 | unblocked games

    ReplyDelete
  47. Welcomes to google terminal keep sharing such ideas in the future as well.
    google snake this was actually EARN TO DIE
    what i was looking for,and i am glad to came here! AGE OF WAR 2
    Hi! I’ve been reading your blog for a while HAPPY WHEELS
    I want you to thank for your time of this wonderful read!!! Slitherio
    Amazing insight you have on this, Slither io This article always blew me BIG FARM
    hotmail sign in | hotmail login
    sign in to hotmail | log in to hotmail

    ReplyDelete

  48. I want to share any applications example baixar snapchat , google play and play store. Snapchat is app which everybody like, it's chat app. Baixar google play and play store are two applications of google. It allows you download applications and games which you like. Please, Baixar play store
    to mobile to experience

    ReplyDelete
  49. I liked all the stuff that you have shared. Great post. Thanks for sharing this with me.
    [url=http://www.astickerprinting.com/Custom-Window-Stickers"]shop window stickers[/url]

    ReplyDelete
  50. thanks very good information providing. Vietnam Visa

    ReplyDelete
  51. You’ve written nice post, I am gonna bookmark this page, thanks for info. I actually appreciate your own position and I will be sure to come back here.

    cat mario |retrica | launcherfive nights at freddy's 5

    ReplyDelete
  52. Associating a PC to an outer system (for example, the Net) presents the shot that outside aggressors will abuse the system, possibly by taking system data or by affecting the system's execution (for example, by presenting infections). https://goo.gl/vP2gEB

    ReplyDelete
  53. The winter holiday season is about to start soon and first in the line is Christmas Day.
    I have put up a blog where you will find all the latest wallpapers, quotes, images and poems.
    Do check it out and here's wishing you all a very Happy Christmas 2016

    ReplyDelete
  54. You’ve written nice post, I am gonna bookmark this page, thanks for info. I actually appreciate your own position and I will be sure to come back here.
    Games online 2017
    العاب
    العاب طبخ 2017
    العاب

    ReplyDelete
  55. Finding a moneylender skilled at renegotiating understudy advances with awful credit is not an especially troublesome thing to do. In any case, it depends on the sort of advance that the understudy has taken out. On the off chance that the credit is from a private loan specialist, then it might be conceivable to arrange another reimbursement plan. Auto Title Loans Chicago

    ReplyDelete
  56. When you experience understudy advance unions, you will find that cash is to a lesser degree an issue than some time recently. After an understudy credit combination you pay just a single low regularly scheduled installment, leaving additional cash for things you need and need. cash advance

    ReplyDelete
  57. After understudy advance solidification, the variable financing cost turns into a settled loan fee for a set timeframe. Many individuals experience the ill effects of terrible credit and this can bring about issues with attempting to acquire that exceptionally essential school advance solidification financing yet in the event that you use administrations of a government based organization, they don't do any credit checks and the top advantage of all, understudy advance combination is considered as great obligation and will be all the more engaging any future loan specialists. cash advance

    ReplyDelete
  58. Since school educational cost charges are keeping on expanding each year and with the proceeding with populace development in the US, the opposition for fitting the bill for school grants has turned out to be harder and harder. payday loans

    ReplyDelete
  59. There are different assets to discover cash for a school instruction. Understudy grants, understudy credits, and allows are accessible to get a school instruction. Subsequent to experiencing the benefits and bad marks, the best alternative might be picked. Payday Loans San-diego

    ReplyDelete
  60. You have made a unique difference between data & user experience. I like it. Thanks for sharing this post.

    clipping path service

    clipping path service

    ReplyDelete
  61. Here's the kicker: business spectators trust that the new private understudy credits aren't generally as generous as they appear to be. They trust that the rising rates they include, the extra expenses they charge and the long reimbursement times that these credits accompany, more than compensate for any morsels they toss to understudies. cash advance corona

    ReplyDelete
  62. There are numerous government advance projects that can be connected for by understudies and guardians. The one most prominent for guardians is the PLUS credit program composed particularly for guardians and graduate understudies. check cashing

    ReplyDelete
  63. In the event that an understudy has imperfect record in regards to making installments before, as yet finding another credit is less demanding for him or her when contrasted with other such individuals. Principle explanation for simple access to awful credit understudy advances is that these can be profited as Federal advances, which are given in spite of the unfriendly history of the advance seekers. Car Title Loans

    ReplyDelete
  64. It is an understudy credit without strong intrigue installments since it has been financed. Apply for a Stafford Loan, and you will in all likelihood fit the bill for an understudy advance without a cosigner. cash advance

    ReplyDelete

  65. نوفر لك عميلنا العزيز افضل مجموعه من الخدمات المتكامله والتي تتمثل في خدمات التنظيف المختلفه وايضا نقل الاثاث مع الفك والتركيب والتغليف عند الحاجه وكذلك مكافحة الحشرات ورش المبيدات
    شركة تنظيف مساجد بالرياض
    شركة تركيب غرف نوم بالرياض
    شركة مكافحة حشرات بالخرج
    شركة تنظيف منازل بالخرج
    شركة تنظيف بالخرج
    شركة رش دفان بالرياض
    شركة تنظيف مجالس بالخرج
    شركة مكافحة الفئران بالرياض
    شركة تنظيف خزانات بالرياض

    ReplyDelete
  66. Thank you for sharing this post. I must admit I have read a good number of your blogs and i am always impressed. I must also admit I find it insightful to read your blogging. Keep up the good work. Do you need Help with Analyzing Dissertation Data Using SPSS software? We are ready to assist you at anytime?

    ReplyDelete
  67. This tells us that users who like recommendations from other users also appreciate.
    ván cốp pha phủ phim - ván ép phủ keo

    ReplyDelete
  68. I will tweet to my friends to get them to check it out. keep it up. Thanks for sharing!.If have a long time than visit to:
    minecraft | facebook baixar | whatsapp baixar | baixar facebook | photo grid | traffic rider

    ReplyDelete
  69. I wanted to thank you for this excellent read!! I definitely loved every little bit of it.Cheers for the info!!!! & This is the perfect blog for anyone who wants to know about this topic. I like play games five nights at freddy’s 4 | game word cookies game | game word cookies answers

    ReplyDelete
  70. gear s3
    perfect text: Last month we shared some of the technology behind Polyvore’s Style Profile and how we’re using machine learning to understand our users' individual style to recommend more personalized products and outfits.
    بازی فوتبال خیابانی

    ReplyDelete
  71. knowledgeable experience shared by you in a very simple form.Look forward to more blog posting from your end.

    www.usessayhelp.blogspot.com/

    ReplyDelete
  72. This comment has been removed by the author.

    ReplyDelete
  73. Your article is very useful to read, not sorry to read, thanks to the motivation and success article always !!!

    PokerOnline Terpercaya
    agen poker terbaik
    judi qq
    bandarq

    ReplyDelete