Website Design and Trust Elements: A/B Testing on a Start-up's Website

Authors

  • Lars Schmitt Technical University of Munich
  • Isabel Haupenthal Technical University of Munich
  • Faisal Bin Ahmed Technical University of Munich

DOI:

https://doi.org/10.54820/ZOWH5239

Keywords:

website design, e-trust, online trust, e-commerce, A/B testing

Abstract

Start-ups are young companies that are hardly known, especially during their early stages, by the relevant stakeholders. A start-up's website is, therefore, often the first point of contact for potential customers, investors, or partners. Such a website usually explains the new product or service and presents the founding team with its competencies. The user's perception of the website and its design can be crucial in determining whether the user is interested in getting in touch with the start-up or even considering the purchase of the respective product or service. User’s trust in the website and its operator is essential for this. The so-called trust elements, such as logos, testimonials, or seals, are intended to create trust on websites. So far, the influence of these elements on user behaviour has hardly been empirically proven in a real-life context. Therefore, we have applied the method of A/B testing to the website of a fictive start-up. Trust elements were placed on one variant of the website (A), whereas on the other variant, there were none (B). The experiment shows that the duration of the user sessions does not differ between the two variants. However, more requests were made on the website variant with trust elements.

References

Beldad, A., Jong, M., Steehouder, M. (2010), “How shall I trust the faceless and the intangible? A literature review on the antecedents of online trust”, Computers in Human Behavior, Vol. 26 No. 5, pp. 857-869.

Chang, R.‐D., Fang, C.‐J., Tseng, Y.‐C. (2011), “The effects of WebTrust assurance on consumers' web purchase decisions”, Online Information Review, Vol. 36 No. 2, pp. 218-240.

Crook, T., Frasca, B., Kohavi, R., Longbotham, R. (2009), “Seven pitfalls to avoid when running controlled experiments on the web”, Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 1105-1114.

Cyr, D. (2013), “An eight country investigation”, Electronic Commerce Research and Applications, Vol. 12 No. 6, pp. 373-385.

Gefen, D., Karahanna, E., Straub, D. W. (2003), “Inexperience and experience with online stores: The importance of tam and trust”, IEEE Transactions on Engineering Management, Vol. 50 No. 3, pp. 307-321.

Google Optimize (2020), “Optimize Resource Hub”, available at: https://support.google.com/optimize/answer/7018998?hl=en (15 May 2021)

Grabner-Kräuter, S., Kaluscha, E. A., Fladnitzer, M. (2006), “Perspectives of online trust and similar constructs – a conceptual clarification”, Proceedings of the 8th international conference on Electronic commerce, pp. 235-243.

Hynninen, P., Kaupinnen, M. (2014), “A/B Testing - A promising tool for customer value evaluation”, IEEE 1st International Workshop on Requirements Engineering and Testing, pp. 16-17.

Kim, J. U., Kim, W. J., Park, S. C. (2010), “Consumer perceptions on web advertisements and motivation factors to purchase in the online shopping”, Computers in Human Behavior, Vol. 26 No. 5, pp. 1208-1222.

Kohavi R. (2012), “Online controlled experiments: introduction, learnings, and humbling statistics”, Proceedings of the sixth ACM conference on Recommender systems, pp. 1-2.

Kohavi, R. (2015), ”Online Controlled Experiments: Lessons from Running A/B/n Tests for 12 Years”, Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, p. 1.

Kohavi, R., Deng, A., Frasca, B., Longbotham, R., Walker, T., Xu, Y. (2012), “Trustworthy online controlled experiments: five puzzling outcomes explained”, Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 786-794.

Kohavi, R., Deng, A., Longbotham, R., Xu, Y. (2014), “Seven rules of thumb for web site experimenters”, Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 1857-1866.

Kohavi, R., Henne, R. M., Sommerfield, D. (2007), “Practical guide to controlled experiments on the web: listen to your customers not to the hippo”, Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 959-967.

Kohavi, R., Longbotham, R. (2011), “Unexpected results in online controlled experiments”, ACM SIGKDD Explorations Newsletter, Vol. 12 No. 2, pp. 31-35.

Kohavi, R., Tang, D., Xu, Y., Hemkens L. G., Ioannidis, J. (2020), “Online randomized controlled experiments at scale: lessons and extensions to medicine”, Trials, Vol. 21No. 1, pp. 1-9.

Kohavi, R., Thomke, S. (2017), “The surprising power of online experiments: Getting the most out of A/B and other controlled tests”, Harvard Business Review, Vol. 95 No. 5, pp. 74-82.

Kracher, B., Corritore, C., Wiedenbeck, S. (2005), “A foundation for understanding online trust in electronic commerce”, Journal of Information, Communication and Ethics in Society, Vol. 3 No. 3, pp. 131-141.

Langmann, S. (2018), “A/B testing - The importance of significance and test duration”, Applied Marketing Analytics, Vol. 4 No. 2, pp. 149-156.

Li, Y.-M., Yeh, Y.-S. (2010), “Increasing trust in mobile commerce through design aesthetics”, Computers in Human Behavior, Vol. 26 No. 4,pp. 673-684.

Lim, W. M. (2015), “Antecedents and consequences of e-shopping: an integrated model”, Internet Research, Vol. 25 No. 2, pp. 184-217.

Liu, B. Q., Goodhue, D. L. (2012), “Two Worlds of Trust for Potential E-Commerce Users: Humans as Cognitive Misers”, Information Systems Research, Vol. 23 No. 4, pp. 1246-1262.

Lowry, P. B., Twyman, N. W., Pickard, M., Jenkins, J. L., Bui, Q. N. (2014), “Proposing the Affect-Trust Infusion Model (ATIM) to explain and predict the influence of high and low affect infusion on Web vendor trust”, Information and Management, Vol. 51 No. 5, pp. 579-594.

Mayer, R. C., Davis, J. H., Schoorman, F. D. (1995), “An Integrative Model of Organizational Trust”, The Academy of Management Review, Vol. 20 No. 3, pp. 709-734.

McKnight, D. H., Chervany, N. L. (2001), “What trust means in e-commerce customer relationship: An interdisciplinary conceptual typology”, International Journal of Electronic Commerce, Vol. 6 No. 2, pp. 35-59.

McKnight, D. H., Choudhury, V., Kacmar, C. (2002), “The impact of initial consumer trust on intentions to transact with a web site: A trust building model”, Journal of Strategic Information Systems, Vol. 11 No. 3-4, pp. 297-323.

Merrilees, B., Fry, M.-L. (2003), “E-trust – the influence of perceived interactivity on e-retailing users”, Marketing Intelligence and Planning, Vol. 21 No. 2, pp. 123-128.

Muñoz‐Leiva, F., Hernández‐Méndez, J., Sánchez‐Fernández, J. (2012), “Generalising user behaviour in online travel sites through the Travel 2.0 website acceptance model”, Online Information Review, Vol. 36 No. 6, pp. 879-902.

Muñoz‐Leiva, F., Luque‐Martínez, T., Sánchez‐Fernández, J. (2010), “How to improve trust toward electronic banking”, Online Information Review, Vol. 34 No. 6, pp. 907-934.

Optimizely (2020), “Optimization Glossary”, available at: https://www.optimizely.com/optimization-glossary/ (15 May 2021)

Palvou, P. A. (2003), “Consumer acceptance of electronic commerce: Integrating trust and risk with the technology acceptance model”, International Journal of Electronic Commerce, Vol. 7 No. 3, pp. 101-134.

Pengnate, S., Antonenko, P. (2013), “A Multimethod Evaluation of Online Trust and Its Interaction with Metacognitive Awareness: An Emotional Design Perspective”, International Journal of Human-Computer Interaction, Vol. 29 No. 9, pp. 582-593.

Rahimnia, F., Hassanzadeh, J. F. (2013), “The impact of website content dimension and e-trust on e-marketing effectiveness: The case of Iranian commercial saffron corporations”, Information and Management, Vol. 50 No. 5, pp. 240-247.

Rotter, J. B. (1967), “A new scale for the measurement of interpersonal trust”, Journal of personality, Vol. 35 No. 4, pp. 651-665.

Salam, A. F., Rao, H. R., Pegels, C. C. (2003), “Consumer-perceived risk in ecommerce transactions”, Communications of the ACM, Vol. 46 No. 12, pp. 325-331.

Seckler, M., Heinz, S., Forde, S., Tuch, A. N., Opwis, K. (2015), “Trust and distrust on the web – User experiences and website characteristics”, Computers in Human Behavior, Vol. 45, pp. 39-50.

Sivaji, A., Downe, A. G., Mazlan, M. F., Soo, S.-T., Abdullah, A. (2011), “Importance of incorporating fundamental usability with social and trust elements for E-Commerce website”, Proceedings of the International Conference on Business, Engineering and Industrial Applications, pp. 221-226.

Taddeo, M. (2009), “Defining Trust and E-Trust – From old theories to new problems”, International Journal of Technology and Human Interaction, Vol. 5 No. 2, pp. 23-35.

Tamimi, N., Sebastianelli, R. (2015), “The relative importance of e-tailer website attributes on the likelihood of online purchase”, Internet Research, Vol. 25 No. 2, pp. 169-183.

Urban, G. L., Sultan, F., Qualls, W. J. (2000), “Placing trust at the center of your internet strategy”, MIT Sloan Management Review, Vol. 42 No. 1, pp. 39-48.

Walia, N., Zahedi, F. M. (2013), “Success Strategies and Web Elements in Online Marketplaces: A Moderated-Mediation Analysis of Seller Types on eBay”, IEEE Transactions on Engineering Management, Vol. 60 No. 4, pp. 763-776.

Wang, Y. D., Emurian, H. H. (2005), “An overview of online trust: Concepts, elements and implications”, Computers in Human Behavior, Vol. 21 No. 1, pp. 105-125.

Zhang, Y., Fang, Y., Wei, K.-K., Ramsey, E., McCole, P., Chen, H. (2011), “Repurchase intention in B2C e-commerce - A relationship quality perspective”, Information and Management, Vol. 48 No. 6, pp. 192-200.

Downloads

Published

2022-03-29

How to Cite

Schmitt, L., Haupenthal, I., & Bin Ahmed, F. (2022). Website Design and Trust Elements: A/B Testing on a Start-up’s Website. ENTRENOVA - ENTerprise REsearch InNOVAtion, 7(1), 166–177. https://doi.org/10.54820/ZOWH5239

Issue

Section

Industrial Organization