Closed sequential pattern mining for sitemap generation
- PDF / 1,509,685 Bytes
- 29 Pages / 439.642 x 666.49 pts Page_size
- 26 Downloads / 207 Views
Closed sequential pattern mining for sitemap generation Michelangelo Ceci1,2
· Pasqua Fabiana Lanotte1
Received: 24 July 2019 / Revised: 22 July 2020 / Accepted: 31 August 2020 / © The Author(s) 2020
Abstract A sitemap represents an explicit specification of the design concept and knowledge organization of a website and is therefore considered as the website’s basic ontology. It not only presents the main usage flows for users, but also hierarchically organizes concepts of the website. Typically, sitemaps are defined by webmasters in the very early stages of the website design. However, during their life websites significantly change their structure, their content and their possible navigation paths. Even if this is not the case, webmasters can fail to either define sitemaps that reflect the actual website content or, vice versa, to define the actual organization of pages and links which do not reflect the intended organization of the content coded in the sitemaps. In this paper we propose an approach which automatically generates sitemaps. Contrary to other approaches proposed in the literature, which mainly generate sitemaps from the textual content of the pages, in this work sitemaps are generated by analyzing the Web graph of a website. This allows us to: i) automatically generate a sitemap on the basis of possible navigation paths, ii) compare the generated sitemaps with either the sitemap provided by the Web designer or with the intended sitemap of the website and, consequently, iii) plan possible website re-organization. The solution we propose is based on closed frequent sequence extraction and only concentrates on hyperlinks organized in “Web lists”, which are logical lists embedded in the pages. These “Web lists” are typically used for supporting users in Web site navigation and they include menus, navbars and content tables. Experiments performed on three real datasets show that the extracted sitemaps are much more similar to those defined by website curators than those obtained by competitor algorithms. Keywords Automatic extraction of sitemaps · Sequential pattern mining · Web page hierarchies · Closed patterns · Website structure mining · Data extraction and integration
Michelangelo Ceci
[email protected] 1
Department of Computer Science, University of Bari Aldo Moro, Bari, Italy
2
Department of Knowledge Technologies, Joˇzef Stefan Institute, Ljubljana, Slovenia
World Wide Web
1 Introduction One of the main problems in Web mining concerns the automatic construction of Web page hierarchies, typically called sitemaps. A sitemap represents an explicit specification of the design concept codified by User Experience Designers and Information Architects, to define the knowledge organization of a website through grouping of related content [34]. This hierarchical organization of the content is coherent with the approach typically followed in the website navigation, where users start with the homepage or a Web page found through a search engine or linked from another website. They then
Data Loading...
