Q-Method Evaluation of a European Health Data Analytic End User Framework
Keywords:
Q-Methodology, Realist Evaluation, Public Health Systems, Data Analytics, ICTAbstract
MIDAS (Meaningful Integration of Data Analytics and Services) project is developing a big data platform to facilitate the utilisation of a wide range of health and social care data to support better policy making. Our aim is to explore the use of Q-methodology as part of the evaluation of the implementation of the MIDAS project. Q-methodology is used to identify perspectives and viewpoints on a particular topic. In our case, we defined a concourse of statements relevant to project implementation and goals, by working from a logic model previously developed for the evaluation, and structured interviews with project participants. A 36-item concourse was delivered to participants, using the HTMLQ system. Analysis was done in the qmethod package. Participants had a range of professional backgrounds, and a range of roles in the project, including developers, end-users, policy staff, and health professionals. The q-sort is carried out at 14 months into the project, a few months before the intended first release of the software being developed. Sixteen people took part, 6 developers, 5 managers, 2 health professionals and 3 others. Three factors (distinct perspectives) were identified in the data. These were tentatively labelled ‘Technical optimism’, ‘End-user focus’ and ‘End-user optimism’. These loaded well onto individuals, and there were few consensus statements. Analysis of these factors loaded well onto individuals with a significant number of consensus statements identified.
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
References
Banna, S., Hasan, H., Meloche, J. (2010), “A subjective evaluation of attitudes towards E-health”, in the Proceedings of the 2010 International Conference on Innovation and Management (IAM), Taiwan, EBRC, pp. 1-12.
Brown, S. R. (1980), Political Subjectivity: Applications of Q Methodology in Political Science, Yale University Press, New Haven, CT.
Engler, N. (1996), “Bringing in the Users”, Computerworld, Vol. 30, No. 48, pp. 3-5.
Dakhli, S. B. D., Chouikha, M. B. (2009), “The knowledge-gap reduction in software engineering”, in the Proceedings of the 2009 Third International Conference on Research Challenges in Information Science, Fez, Morocco, IEEE, pp. 287-294.
Farrimond, H., Joffe, H., Stenner, P. (2010), “A Q-methodological study of smoking identities”, Psychology and Health, Vol. 25, No. 8, pp. 979-998.
Kampen, J. K., Tamas, P. (2014), “Overly ambitious: contributions and current status of Q methodology”, Quality & Quantity, Vol. 48, No. 3, pp. 3109–3126.
Kaplan, B., Shaw, N. T. (2002), “People, Organizational, and Social Issues: Evaluation as an exemplar”, Yearbook of Medical Informatics, Vol, 11, No. 1, pp. 91-102.
Kelly, S. E., Moher, D., Clifford, T. J. (2016), “Expediting evidence synthesis for healthcare decision-making: exploring attitudes and perceptions towards rapid reviews using Q methodology”, Peer J.
Kim, J., Bates, D. W. (2011), “Analysis of the definition and utility of personal health records using Q methodology”, Journal of Medical Internet Research, Vol. 13, No. 4.
King, J. (1995), “Sketchy plans, politics stall software development”, Computer World, Vol. 29, No. 25, p. 81.
Ilavarasan, P. V., Sharma, A. K. (2003), “Is software work routinized? Some empirical observations from Indian software industry”, Journal of Systems and Software, Vol. 66, No. 1, pp. 1-6.
Ladan, M. A., Wharrad, H., Windle, R. (2018), “Towards understanding healthcare professionals’ adoption and use of technologies in clinical practice: using Q-methodology and models of technology acceptance”, Journal of Innovation in Health Informatics, Vol. 25, No. 1, pp. 27-37.
Martin, G., Gupta, H., Wingreen, S. C., Mills, A. M. (2015), “An Analysis of Personal Information Privacy Concerns using Q-Methodology”, Paper presented at 2015 Australasian Conference on Information Systems, Adelaide, Australia.
Murdoch, T. B., Detsky, A. S. (2013), “The inevitable application of big data to health care”, Jama, Vol. 309, No. 13, pp. 1351-1352.
Rigby, M. (2006), “Evaluation–the Cinderella science of ICT in health”, Yearbook of medical informatics, Vol. 15, No. 1, pp. 114-120.
Stephenson, W. (1986a), “Protoconcursus: The Concourse Theory of Communication: I”, Operant Subjectivity, Vol. 9, No. 2, pp. 37-58.
Stephenson, W. (1986b), “Protoconcursus: The Concourse Theory of Communication: II”, Operant Subjectivity, Vol. 9, No. 3, pp. 73-96.
Studnicki, J., Berndt, D. J., Fisher, J. W. (2008), “Using information systems for public health administration”, in Benjamin, G. (Ed.), Public Health administration: Principles for Population-Based Management, 2nd edition, Jones and Bartlett, Sudbury, MA, pp. 353-380.
Tilahun, B., Kauppinen, T., Keßler, C., Fritz, F. (2014), “Design and Development of a Linked Open Databased Health Information Representation and Visualization System: Potentials and Preliminary Evaluation”, JMIR Medical Informatics, Vol. 2, No. 2.
Toffolon, C. (2000), “The software dimensions’ theory”, in Filipe, J. (Ed.), Enterprise Information Systems, Springer, Dordrecht, pp. 89-98.
Watts, S., Stenner, P. (2012), Doing Methodological Research: Theory, Method and Interpretation, Sage, London, UK.
Webler, T., Danielson, S., Tuler, S. (2009), Using Q Method to Reveal Social Perspectives in Environmental Research, Social and Environmental Research Institute, Greenfield, MA, available at: http://www.seri-us.org/sites/default/files Qprimer.pdf (04 April 2019).
Wingreen, S. C., LeRouge, C. L., Blanton, J. E. (2009), “Structuring Training for IT Professionals and the Firm: An Application of the Q-methodology”, International Journal of Global Management Studies, Vol. 1, No. 1, pp. 53-67.
Valenta, A. L., Wigger, U. (1997), “Q-methodology: definition and application in health care informatics”, Journal of the American Medical Informatics Association, Vol. 4, No. 6, pp. 501-510.
Zakkar, M., Sedig, K. (2017), “Interactive visualization of public health indicators to support policymaking: An exploratory study”, Online Journal of Public Health Informatics, Vol. 9, No. 2.
Ziemkiewicz, C., Ottley, A., Crouser, R. J., Chauncey, K., Su, S. L., Chang, R. (2012), “Understanding visualization by understanding individual users”, IEEE Computer Graphics and Applications, Vol. 32, No. 6, pp. 88-94.
