Web Mining Framework: Croatian Patents Case Study
Keywords:
web mining, data mining, crawling, patent miningAbstract
Patents are one of the most valuable sources of technical and commercial knowledge. Although patents are public and can be easily searched on the Web, for most countries, there is no easy way to download bulk patent data. The purpose of this paper is to create a web mining framework used to extract patent data from the Croatian State Intellectual Property Office. Even though framework was created for the purposes of extracting Croatian patents, it can be reused for other web mining cases. The architecture of the proposed framework combines the use of web crawler and big data tools, in order to provide a complete and flexible solution for building general-purpose web mining application. The biggest limitation of this framework comes from the programming knowledge required to implement it. Therefore, this framework is only available to the small number of researchers. Data extracted with web mining methods is only as good as the algorithm used to extract data. Nevertheless, the data from official sources should always be preferred to the one retrieved using web mining methods.
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
References
Arotariteia, D., Mitrab, S. (2004), “Web Mining: a Survey in the Fuzzy Framework”, Fuzzy Sets and Systems, Vol. 148, pp. 5-19.
Chun, T.Y., (1999), “World Wide Web Robots: an Overview”, Online & CD-ROM Review 23, Vol. 3, pp. 135-142.
Dean, J., Ghemawat, S. (2004), “MapReduce: Simplified Data Processing on Large Clusters”, Communications of the ACM - 50th anniversary issue: 1958 – 2008, Vol. 51 No.1, pp. 107-113.
EC, EPO, (2007), “Why Researchers Should Care about Patents”, European Commission and European Patent Office.
Etzioni, O., (1996), “The World Wide Web: Quagmire or Gold Mine”, Communications of the ACM, Vol. 39, pp. 65-68.
Melnik, S., et al., (2010) “Dremel: Interactive Analysis of Web-Scale Datasets”, Proc. Of the 36th International Conference on Very Large Data Bases, pp. 330-339.
Metz, C. (2011), “Google Go Boldly Goes Where No Code Has Gone Before”, available at: http://www.theregister.co.uk/2011/05/05/google_go/ (06/08/2016)
Mortensen, M., Langtangen H. P. (2016), “High performance Python for direct numerical simulations of turbulent flows”.
Tsenga, Y., et al., (2007), “Text mining techniques for patent analysis”, Information Processing and Management, Vol. 43, pp. 1216-1247.
