Skoči na glavni sadržaj

Izvorni znanstveni članak

A Generic Procedure for Integration Testing of ETL Procedures

Igor Mekterović ; Department of Applied Computing, Faculty of Electrical Engineering and Computing, University of Zagreb, Unska 3, 10000, Zagreb, Croatia
Ljiljana Brkić ; Department of Applied Computing, Faculty of Electrical Engineering and Computing, University of Zagreb, Unska 3, 10000, Zagreb, Croatia
Mirta Baranović ; Department of Applied Computing, Faculty of Electrical Engineering and Computing, University of Zagreb, Unska 3, 10000, Zagreb, Croatia


Puni tekst: engleski pdf 1.449 Kb

str. 169-178

preuzimanja: 3.673

citiraj


Sažetak

In order to attain a certain degree of confidence in the quality of the data in the data warehouse it is necessary to perform a series of tests. There are many components (and aspects) of the data warehouse that can be tested, and in this paper we focus on the ETL procedures. Due to the complexity of ETL process, ETL procedure tests are usually custom written, having a very low level of reusability. In this paper we address this issue and work towards establishing a generic procedure for integration testing of certain aspects of ETL procedures. In this approach, ETL procedures are treated as a black box and are tested by comparing their inputs and outputs – datasets. Datasets from three locations are compared: datasets from the relational source(s), datasets from the staging area and datasets from the data warehouse. Proposed procedure is generic and can be implemented on any data warehouse employing dimensional model and having relational database(s) as a source. Our work pertains only to certain aspects of data quality problems that can be found in DW systems. It provides a basic testing foundation or augments existing data warehouse system’s testing capabilities. We comment on proposed mechanisms both in terms of full reload and incremental loading.

Ključne riječi

Data quality; Data warehouse; Dimensional model; ETL testing

Hrčak ID:

71300

URI

https://hrcak.srce.hr/71300

Datum izdavanja:

22.7.2011.

Podaci na drugim jezicima: hrvatski

Posjeta: 4.554 *