Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision		 Previous revision
public:papers:cacm2018 [2017-12-24 11:39] – [A large-scale comparative study of beta testers and standard users [CACM 2018]] xukroppublic:papers:cacm2018 [2020-05-14 11:38] (current) – xukrop
Line 2: Line 2:
 ~~NOTOC~~ ~~NOTOC~~
  
 +<grid>
 +<col xs="12" sm="8" lg="8">
 <TEXT size="large"> <TEXT size="large">
-\_{{fa>user}}\_\_//Authors:// Vlasta Stavova, Lenka Dedkova, Martin Ukrop and Vashek Matyas+ 
 +\_{{fa>user}}\_\_//Authors:// [[:publications:authors:vlasta-stavova|Vlasta Stavova]], Lenka Dedkova, [[:publications:authors:martin-ukrop|Martin Ukrop]] and [[:publications:authors:vashek-matyas|Vashek Matyas]]
  
 {{fa>user-circle-o}}\_//Primary contact:// Vlasta Stavova %%<%%<vlasta.stavova@mail.muni.cz>%%>%% {{fa>user-circle-o}}\_//Primary contact:// Vlasta Stavova %%<%%<vlasta.stavova@mail.muni.cz>%%>%%
  
 {{fa>bullhorn}}\_//Journal:// [[https://cacm.acm.org/|Communications of the ACM]] {{fa>bullhorn}}\_//Journal:// [[https://cacm.acm.org/|Communications of the ACM]]
 +
 +\_{{fa>id-badge}}\_\_//DOI:// [[https://doi.org/10.1145/3173570|10.1145/3173570]]
 </TEXT> </TEXT>
 +</col>
 +
 +<col xs="12" sm="4" lg="4">
 +<TEXT align="right">
 +
 +<button type="warning" icon="fa fa-file-pdf-o">[[https://crocs.fi.muni.cz/_media/publications/pdf/2018-cacm-stavova.pdf|Pre-print PDF]]</button>
 +
 +<button type="info" icon="fa fa-external-link">[[https://dl.acm.org/citation.cfm?id=3173570|Final version (ACM DL)]]</button>
 +
 +<button collapse="bibtex" icon="fa fa-file-code-o">BiBTeX</button>
 +</TEXT>
 +</col>
 +</grid>
 +
 +<collapse id="bibtex" collapsed="true">
 +  @Article{2018-cacm-stavova,
 +    Title = {A Large-scale Comparative Study of Beta Testers and Regular Users},
 +    Author = {Vlasta Stavova and Lenka Dedkova and Martin Ukrop and Vashek Matyas},
 +    Journal = {Communications of the ACM},
 +    Year = {2018},
 +    Volume = {61},
 +    Number = {2},
 +    Pages = {64--71},
 +    Publisher = {ACM},
 +    Doi = {10.1145/3173570},
 +  }
 +</collapse>
  
 <panel type="default" title="Abstract"> <panel type="default" title="Abstract">
Line 20: Line 52:
 </panel> </panel>
  
-<popover trigger="focus" title="Not yet available" content="Paper PDF will be added in February 2018."> +===== Summarizing video =====
-<button type="warning" icon="fa fa-file-pdf-o">Pre-print PDF</button> +
-</popover> +
-\_ +
-<button collapse="bibtex" icon="fa fa-file-code-o">BiBTeX</button> +
-  +
-<collapse id="bibtex" collapsed="true"> +
-  @Article{2017-cacm-stavova, +
-    title = {A large-scale comparative study of beta testers and standard users}, +
-    author = {Vlasta Stavova and Lenka Dedkova and Martin Ukrop and Vashek Matyas}, +
-    journal = {To appear in Communications of ACM}, +
-    year = {2018}, +
-    keywords = {usablesec, ESET}, +
-    organization = {ACM}, +
-  } +
-</collapse>+
  
-----+{{ youtube>H7ik9SeAexQ?900x520 |A large-scale comparative study of beta testers and standard users}}
  
 ===== Key insights ===== ===== Key insights =====
Line 46: Line 63:
   * **Identifying usability issues**\\ When testing international products, ensure beta testers are culturally representative of regular users to help identify potential localization and cultural usability issues.   * **Identifying usability issues**\\ When testing international products, ensure beta testers are culturally representative of regular users to help identify potential localization and cultural usability issues.
   * **Ensuring representation**\\ Most important, testers should be representative of regular users. Keep checking that this is the case or pursue additional rigorous analyses to reach the most credible and applicable conclusions possible.   * **Ensuring representation**\\ Most important, testers should be representative of regular users. Keep checking that this is the case or pursue additional rigorous analyses to reach the most credible and applicable conclusions possible.
-===== Summary ===== 
- 
-Beta testers are the first end users outside a software company to use its product. They have been used for decades and are rightly credited not only with finding and reporting bugs, but also with improving general product usability through their feedback and/or the ways they use the product. 
- 
-In this paper, we investigate whether beta testers represent standard users well enough to allow for the extrapolation of testing data to standard users. We have investigated records of beta testers and standard users of home security solution developed by the IT security software provider ESET. With more than 600 000 participants from more than 180 countries, we present what we believe to be the first large-scale comparison between standard users and beta testers. 
- 
-We compared several aspects of both populations, such as hardware, operating system, country of origin and EULA reading time, all taken from system data. Other attributes, such as age, gender, privacy perception and computer proficiency self-evaluation, were available thanks to a user questionnaire. 
- 
-We conclude that - at least in our study - beta users represent standard users well in terms of hardware and operating system in large scale beta testing. However, populations differ significantly in the distribution of users and testers between countries. This may cause a problem when a testing includes localization and usability issues that may be influenced by regional differences. 
- 
-===== Summarizing video ===== 
- 
-{{ youtube>H7ik9SeAexQ?900x520 |A large-scale comparative study of beta testers and standard users}} 
  
 ===== How did we make the research video ===== ===== How did we make the research video =====