{"id":372,"date":"2020-07-14T11:09:55","date_gmt":"2020-07-14T08:09:55","guid":{"rendered":"https:\/\/sherpa.digital\/?p=372"},"modified":"2021-01-08T09:11:49","modified_gmt":"2021-01-08T09:11:49","slug":"usability-test-sample-size","status":"publish","type":"post","link":"https:\/\/sherpa.digital\/en\/thoughts\/usability-test-sample-size\/","title":{"rendered":"Usability test sample size"},"content":{"rendered":"\n<p>&#8220;How many users should we include in the usability test?\u201d might be the question many of us have asked at least once; it is such a question that requires consideration of expertise and effort. On one hand, deciding on a way to approach the matter is dependent on one\u2019s capability to handle the ways to do it; on the other, project limitations such as budget and time have to be taken into account as most of us do not have unlimited access to either of these.&nbsp;<\/p>\n\n\n\n<p>A simple answer to the question is, in fact, based on the statistical significance of a test which is the ability to explain the likelihood of an event not happening randomly. So if you set a significance level of 90%, it means that you are 90% confident that the results of the test you conducted can be explained by your hypothesis.<\/p>\n\n\n\n<p>What affects the significance level is the test sample size, confidence level, and hypothesis type as the methods you will need to apply are based on these. When your hypothesis is built on your ability to find pain points of the users during a test, you can find how many users you need to test by deciding on how confident you want to be in the results. This is just a simple explanation of how a sample size can be found before a test is conducted at the most basic level. Since it is a prediction, as you might have noticed, we can refer to the whole process as inferring based on possibilities. Therefore it is to be noted that there are different methods for calculating the sample size depending on the distribution of the probability. Luckily, there are already <a href=\"https:\/\/uxplanet.org\/sample-size-for-usability-study-part-1-about-nielsen-and-probability-efffecdbfa95\">analyses<\/a> with actual data on the matter that let us not delve deep into the matter here but explore what kind of approaches are available to us.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Quantitative Usability Tests<\/h3>\n\n\n\n<p>An analysis on the matter sets a <a href=\"https:\/\/www.nngroup.com\/articles\/quantitative-studies-how-many-users\/?lm=analytics-user-experience&amp;pt=article\">minimum of 20 users<\/a> as a requirement for the test sample size if you want to conduct <strong>a quantitative study<\/strong>. There are strict conditions, however, regarding how the process of the test should be planned which results in a trade-off between statistical accuracy and cost in terms of effort and money. If you want to take this approach, make sure that you have the expertise and resources to see the test through.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Qualitative Usability Tests<\/h3>\n\n\n\n<p>Another analysis suggests that <a href=\"https:\/\/www.nngroup.com\/articles\/why-you-only-need-to-test-with-5-users\/\">only 5 users<\/a> are needed for a usability test by conducting <strong>a qualitative study<\/strong>. By doing so, the analyst argues that the benefit provided as opposed to the cost would be much higher since:<\/p>\n\n\n\n<p>\u201c<em>You don&#8217;t have to measure usability to improve it.<\/em>\u201d<\/p>\n\n\n\n<p>If you see your users, for example, struggling with navigating back to the page where they sign-up or place an order due to a design element, the matter of how much they have a hard time, loses its importance in terms of ability to capture pain points. If a sample size of 5 users has the probability of detecting the signals, you can allocate the remaining budget conducting more tests.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>&#8220;How many users should we include in the usability test?\u201d might be the question many of us have asked at least once; it is such a question that requires consideration of expertise and effort. <\/p>\n","protected":false},"author":19,"featured_media":374,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-372","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorised"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v20.13 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Usability test sample size - SHERPA<\/title>\n<meta name=\"description\" content=\"&quot;How many users should we include in the usability test?\u201d might be the question many of us have asked at least once; it is such a question that requires consideration of expertise and effort.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/sherpa.digital\/en\/thoughts\/usability-test-sample-size\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Usability test sample size - SHERPA\" \/>\n<meta property=\"og:description\" content=\"&quot;How many users should we include in the usability test?\u201d might be the question many of us have asked at least once; it is such a question that requires consideration of expertise and effort.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/sherpa.digital\/en\/thoughts\/usability-test-sample-size\/\" \/>\n<meta property=\"og:site_name\" content=\"SHERPA\" \/>\n<meta property=\"article:publisher\" content=\"http:\/\/www.facebook.com\/sherpadesign\" \/>\n<meta property=\"article:published_time\" content=\"2020-07-14T08:09:55+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-01-08T09:11:49+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/sherpa.digital\/en\/wp-content\/uploads\/sites\/2\/2020\/07\/undraw-test1.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1600\" \/>\n\t<meta property=\"og:image:height\" content=\"1200\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Ata Kayacan\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@SHERPADD\" \/>\n<meta name=\"twitter:site\" content=\"@SHERPADD\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Ata Kayacan\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/sherpa.digital\/en\/thoughts\/usability-test-sample-size\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/sherpa.digital\/en\/thoughts\/usability-test-sample-size\/\"},\"author\":{\"name\":\"Ata Kayacan\",\"@id\":\"https:\/\/sherpa.digital\/en\/#\/schema\/person\/770f6b5643e6ea4fa2cbc6682ef5b2a6\"},\"headline\":\"Usability test sample size\",\"datePublished\":\"2020-07-14T08:09:55+00:00\",\"dateModified\":\"2021-01-08T09:11:49+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/sherpa.digital\/en\/thoughts\/usability-test-sample-size\/\"},\"wordCount\":517,\"publisher\":{\"@id\":\"https:\/\/sherpa.digital\/en\/#organization\"},\"inLanguage\":\"en-GB\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/sherpa.digital\/en\/thoughts\/usability-test-sample-size\/\",\"url\":\"https:\/\/sherpa.digital\/en\/thoughts\/usability-test-sample-size\/\",\"name\":\"Usability test sample size - SHERPA\",\"isPartOf\":{\"@id\":\"https:\/\/sherpa.digital\/en\/#website\"},\"datePublished\":\"2020-07-14T08:09:55+00:00\",\"dateModified\":\"2021-01-08T09:11:49+00:00\",\"description\":\"\\\"How many users should we include in the usability test?\u201d might be the question many of us have asked at least once; it is such a question that requires consideration of expertise and effort.\",\"breadcrumb\":{\"@id\":\"https:\/\/sherpa.digital\/en\/thoughts\/usability-test-sample-size\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/sherpa.digital\/en\/thoughts\/usability-test-sample-size\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/sherpa.digital\/en\/thoughts\/usability-test-sample-size\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/sherpa.digital\/en\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Usability test sample size\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/sherpa.digital\/en\/#website\",\"url\":\"https:\/\/sherpa.digital\/en\/\",\"name\":\"SHERPA\",\"description\":\"Experience Design Studio\",\"publisher\":{\"@id\":\"https:\/\/sherpa.digital\/en\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/sherpa.digital\/en\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/sherpa.digital\/en\/#organization\",\"name\":\"SHERPA\",\"url\":\"https:\/\/sherpa.digital\/en\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/sherpa.digital\/en\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/sherpa.digital\/en\/wp-content\/uploads\/sites\/2\/2019\/02\/sherpa-logo.png\",\"contentUrl\":\"https:\/\/sherpa.digital\/en\/wp-content\/uploads\/sites\/2\/2019\/02\/sherpa-logo.png\",\"width\":111,\"height\":24,\"caption\":\"SHERPA\"},\"image\":{\"@id\":\"https:\/\/sherpa.digital\/en\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"http:\/\/www.facebook.com\/sherpadesign\",\"https:\/\/twitter.com\/SHERPADD\",\"http:\/\/instagram.com\/sherpadd\",\"http:\/\/www.linkedin.com\/company\/sherpa-define-&amp;-design\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/sherpa.digital\/en\/#\/schema\/person\/770f6b5643e6ea4fa2cbc6682ef5b2a6\",\"name\":\"Ata Kayacan\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/sherpa.digital\/en\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/sherpa.digital\/en\/wp-content\/uploads\/sites\/2\/2020\/11\/user-11279-475x476-1-100x100.jpg\",\"contentUrl\":\"https:\/\/sherpa.digital\/en\/wp-content\/uploads\/sites\/2\/2020\/11\/user-11279-475x476-1-100x100.jpg\",\"caption\":\"Ata Kayacan\"},\"url\":\"https:\/\/sherpa.digital\/en\/thoughts\/author\/ata-kayacan\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Usability test sample size - SHERPA","description":"\"How many users should we include in the usability test?\u201d might be the question many of us have asked at least once; it is such a question that requires consideration of expertise and effort.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/sherpa.digital\/en\/thoughts\/usability-test-sample-size\/","og_locale":"en_GB","og_type":"article","og_title":"Usability test sample size - SHERPA","og_description":"\"How many users should we include in the usability test?\u201d might be the question many of us have asked at least once; it is such a question that requires consideration of expertise and effort.","og_url":"https:\/\/sherpa.digital\/en\/thoughts\/usability-test-sample-size\/","og_site_name":"SHERPA","article_publisher":"http:\/\/www.facebook.com\/sherpadesign","article_published_time":"2020-07-14T08:09:55+00:00","article_modified_time":"2021-01-08T09:11:49+00:00","og_image":[{"width":1600,"height":1200,"url":"https:\/\/sherpa.digital\/en\/wp-content\/uploads\/sites\/2\/2020\/07\/undraw-test1.jpg","type":"image\/jpeg"}],"author":"Ata Kayacan","twitter_card":"summary_large_image","twitter_creator":"@SHERPADD","twitter_site":"@SHERPADD","twitter_misc":{"Written by":"Ata Kayacan","Estimated reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/sherpa.digital\/en\/thoughts\/usability-test-sample-size\/#article","isPartOf":{"@id":"https:\/\/sherpa.digital\/en\/thoughts\/usability-test-sample-size\/"},"author":{"name":"Ata Kayacan","@id":"https:\/\/sherpa.digital\/en\/#\/schema\/person\/770f6b5643e6ea4fa2cbc6682ef5b2a6"},"headline":"Usability test sample size","datePublished":"2020-07-14T08:09:55+00:00","dateModified":"2021-01-08T09:11:49+00:00","mainEntityOfPage":{"@id":"https:\/\/sherpa.digital\/en\/thoughts\/usability-test-sample-size\/"},"wordCount":517,"publisher":{"@id":"https:\/\/sherpa.digital\/en\/#organization"},"inLanguage":"en-GB"},{"@type":"WebPage","@id":"https:\/\/sherpa.digital\/en\/thoughts\/usability-test-sample-size\/","url":"https:\/\/sherpa.digital\/en\/thoughts\/usability-test-sample-size\/","name":"Usability test sample size - SHERPA","isPartOf":{"@id":"https:\/\/sherpa.digital\/en\/#website"},"datePublished":"2020-07-14T08:09:55+00:00","dateModified":"2021-01-08T09:11:49+00:00","description":"\"How many users should we include in the usability test?\u201d might be the question many of us have asked at least once; it is such a question that requires consideration of expertise and effort.","breadcrumb":{"@id":"https:\/\/sherpa.digital\/en\/thoughts\/usability-test-sample-size\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/sherpa.digital\/en\/thoughts\/usability-test-sample-size\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/sherpa.digital\/en\/thoughts\/usability-test-sample-size\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/sherpa.digital\/en\/"},{"@type":"ListItem","position":2,"name":"Usability test sample size"}]},{"@type":"WebSite","@id":"https:\/\/sherpa.digital\/en\/#website","url":"https:\/\/sherpa.digital\/en\/","name":"SHERPA","description":"Experience Design Studio","publisher":{"@id":"https:\/\/sherpa.digital\/en\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/sherpa.digital\/en\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-GB"},{"@type":"Organization","@id":"https:\/\/sherpa.digital\/en\/#organization","name":"SHERPA","url":"https:\/\/sherpa.digital\/en\/","logo":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/sherpa.digital\/en\/#\/schema\/logo\/image\/","url":"https:\/\/sherpa.digital\/en\/wp-content\/uploads\/sites\/2\/2019\/02\/sherpa-logo.png","contentUrl":"https:\/\/sherpa.digital\/en\/wp-content\/uploads\/sites\/2\/2019\/02\/sherpa-logo.png","width":111,"height":24,"caption":"SHERPA"},"image":{"@id":"https:\/\/sherpa.digital\/en\/#\/schema\/logo\/image\/"},"sameAs":["http:\/\/www.facebook.com\/sherpadesign","https:\/\/twitter.com\/SHERPADD","http:\/\/instagram.com\/sherpadd","http:\/\/www.linkedin.com\/company\/sherpa-define-&amp;-design"]},{"@type":"Person","@id":"https:\/\/sherpa.digital\/en\/#\/schema\/person\/770f6b5643e6ea4fa2cbc6682ef5b2a6","name":"Ata Kayacan","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/sherpa.digital\/en\/#\/schema\/person\/image\/","url":"https:\/\/sherpa.digital\/en\/wp-content\/uploads\/sites\/2\/2020\/11\/user-11279-475x476-1-100x100.jpg","contentUrl":"https:\/\/sherpa.digital\/en\/wp-content\/uploads\/sites\/2\/2020\/11\/user-11279-475x476-1-100x100.jpg","caption":"Ata Kayacan"},"url":"https:\/\/sherpa.digital\/en\/thoughts\/author\/ata-kayacan\/"}]}},"_links":{"self":[{"href":"https:\/\/sherpa.digital\/en\/wp-json\/wp\/v2\/posts\/372","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sherpa.digital\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sherpa.digital\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sherpa.digital\/en\/wp-json\/wp\/v2\/users\/19"}],"replies":[{"embeddable":true,"href":"https:\/\/sherpa.digital\/en\/wp-json\/wp\/v2\/comments?post=372"}],"version-history":[{"count":0,"href":"https:\/\/sherpa.digital\/en\/wp-json\/wp\/v2\/posts\/372\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/sherpa.digital\/en\/wp-json\/wp\/v2\/media\/374"}],"wp:attachment":[{"href":"https:\/\/sherpa.digital\/en\/wp-json\/wp\/v2\/media?parent=372"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sherpa.digital\/en\/wp-json\/wp\/v2\/categories?post=372"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sherpa.digital\/en\/wp-json\/wp\/v2\/tags?post=372"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}