• Daniel Jara University of Murcia, Faculty of Sports Science
  • Miguel-Ángel Gómez Faculty of Physical and Sport Sciences, Polytechnic University of Madrid
  • Enrique Ortega University of Murcia, Faculty of Sports Science
  • Pilar Sainz de Baranda University of Murcia, Faculty of Sports Science


The aim of this study was to design and validate an observational instrument to analyse the behaviour of the goalkeeper in defence and attack. The validation and reliability processes were carried out by 12 experts, who were required to fulfill at least two of five selected requirements. Content validity was calculated using Aiken’s V. The Kappa Index was used to analyse reliability. The observational tool was divided into 3 different blocks: offensive actions, defensive actions, and actions taken before the defensive action of the goalkeeper. Only three of the total items achieved low values, with modifications, recording optimal values in accordance with Aiken’s V. Following the first step of the process taken by the experts, the new proposals were evaluated after a pilot test. The reliability test scored optimal values. An observational sheet was developed to manage the quantitative and qualitative assessments of the experts, and this tool was accepted as valid and reliable.


Aiken, L. (1985). Three coefficients for analyzing the reliability and validity of ratings. Educational and Psychological Measurement, 45(1), 131-142.

Aiken, L. R. (1980). Content Validity and Reliability of Single Items or Questionnaires. Educational and Psychological Measurement, 40(4), 955–959.

Altman, D. G. (1991). Some common problems in medical research. In D. G. Altman (Ed.), Practical statistics for medical research (pp. 403–409). London: Chapman & Hall.

Creswell, J. W. (2005). Research design: qualitative, quantitative, and mixed method approaches (2nd ed.). London: SAGE.

Cohen, J. (1925). Weighted Kappa: Nominal scale agreement with provision for scaled disagreement or partial credit. Psychological Bulletin, 70(4).

Condello, G., Lupo, C., Cipriani, A., & Tessitore, A. (2011). Activity profile of a no-professional goalkeeper during official matches. Annals of Research in Sport and Physical Activity, 2, 94.

Di Salvo, V., Benito, P. J., Calderón, F. J., Di Salvo, M., & Pigozzi, F. (2008). Activity profile of elite goalkeepers during football match-play. Journal of Sports Medicine and Physical Fitness, 48(4), 443–446.

García-Angulo, A., & Ortega, E. (2015). Análisis bibliométrico de la producción científica sobre el portero en fútbol. [Bibliometric analysis of scientific production over the goalkeeper in soccer]. Revista Iberoamericana de Psicología del Ejercicio y el Deporte, 10(2), 205–214.

Gómez, M. A., Lorenzo, A., Sampaio, J., Ibáñez, S., & Ortega, E. (2008). Game-related statistics that discriminated winning and losing teams from the Spanish men’s professional basketball teams. Collegium Antropologicum, 32(2), 451-456.

Hughes, M., Cooper, S. M., & Nevill, A. (2002). Analysis procedures for non-parametric data from performance analysis. International Journal of Performance Analysis in Sport, 2(1), 6-20.

Hughes, M., & Franks, I. M. (2004). Notational analysis of sport: Systems for better coaching and performance in sport. Oxon: Routledge.

Ibáñez, S. J., García, J., Feu, S., Parejo, I., & Cañadas, M. (2009). La eficacia del lanzamiento a canasta en la NBA: Análisis multifactorial. [Shot efficacy in the NBA: A multifactorial analysis]. Cultura, Ciencia y Deporte, 4(10), 39–47. 4.10

Liu, H., Gómez, M. A., & Lago-Peñas, C. (2015). Match Performance Profiles of Goalkeepers of Elite Football Teams. International Journal of Sports Science & Coaching, 10(4), 669-682.

Mackenzie, R., & Cushion, C. (2013). Performance analysis in football: A critical review and implications for future research. Journal of Sports Sciences, 31(6), 639-676.

Moreno, E., & Gómez, M. Á. (2017). Validación herramienta observacional para el análisis de rachas de lanzamiento en baloncesto. [Validation of an observational instrument for shooting streaks in basketball]. Revista de Psicología del Deporte, 26(3), 87–93.

O'Donoghue, P., Holmes, L., & Robinson, G. (2017). Doing a Research Project in Sport Performance Analysis. Oxon: Routledge.

Palao, J. M., Manzanares, P., & Ortega, E. (2015). Design, Validation, and Reliability of an Observation Instrument for Technical and Tactical Actions in Indoor Volleyball. European Journal of Human Movement, 34(1), 75–95.

Park, Y., Choi, M., Bang, S., & Park, J. (2016). Analysis of Shots on Target and Goals Scored in Soccer Matches: Implications for Coaching and Training Goalkeepers. South African Journal for Research in Sport, Physical Education and Recreation 38(1), 123–137.

Penfield, R. D., & Giacobbi, P. R. (2004) Applying a score confidence interval to Aiken’s item content-relevance index. Measurement in Physical Education and Exercise Science, 8(4), 213-225.

Sainz de Baranda, P., Llopis, L., & Ortega, E. (2005). Metodología global para el entrenamiento del portero de fútbol. [Global Methodology for the goalkeeper training in football]. Sevilla: Wanceulen.

Sainz de Baranda, P., Ortega, E., & Palao, J. M. (2008). Analysis of goalkeepers’ defence in the World Cup in Korea and Japan in 2002. European Journal of Sport Science, 8(3), 127–134.

Sainz de Baranda, P., Ortega, E., Llopis, L., Novo, J. F., & Rodríguez, D. (2005). Análisis de las acciones defensivas del portero en el fútbol 7. [Analysis of the defensive actions of the goalkeeper in u12 football]. Apunts: Educación Física y Deportes, (80), 45–52.

Sainz de Baranda, P., & Serrato, D. (2000). La utilidad de las Hojas de Observación en el Portero de Fútbol: Parte primera. [The utility of the observational sheets for the goalkeeper in football: first part]. Cuadernos del Entrenador. Revista de la Federación Española de Fútbol, 85, 34-51.

Sarmento, H., Marcelino, R., Anguera, M. T., Campaniço, J., Matos, N., & Leitão, J. C. (2014). Match analysis in football: a systematic review. Journal of Sports Sciences, 32(20), 1831–1843.

Seaton, M., & Campos, J. (2011). Distribution competence of a football club’s goalkeepers. International Journal of Performance Analysis in Sport, 11, 314–324.

Szwarc, A., Lipińska, P., & Chamera, M. (2010). The Efficiency Model of Goalkeeper’s Actions in Soccer. Baltic Journal of Health and Physical Activity, 2(2), 132–138.

Vilar, L., Araújo, D., Davids, K., & Button, C. (2012). The role of ecological dynamics in analysing performance in team sports. Sports Medicine, 42(1), 1-10.

Villarejo, D., Ortega, E., Gómez, M. Á., & Palao, J. M. (2014). Design, validation, and reliability of an observational instrument for ball possessions in rugby union. International Journal of Performance Analysis in Sport, 14(2002), 957–969.