Preprint
Abstract
Identifying high-quality webpages is fundamental for real-world search engines, which can fulfil users' information need with the less cognitive burden. Early studies of \emph{webpage quality assessment} usually design hand-crafted features that may only work on particular categories of webpages (e.g., shopping websites, medical websites). They can hardly be applied to real-world search engines that serve trillions of webpages with various types and purposes. In this paper, we propose a novel layout-aware webpage quality assessment model currently deployed in our search engine. Intuitively, layout is a universal and critical dimension for the quality assessment of different categories of webpages. Based on this, we directly employ the meta-data that describes a webpage, i.e., Document Object Model (DOM) tree, as the input of our model. The DOM tree data unifies the representation of webpages with different categories and purposes and indicates the layout of webpages. To assess webpage quality from complex DOM tree data, we propose a graph neural network (GNN) based method that extracts rich layout-aware information that implies webpage quality in an end-to-end manner. Moreover, we improve the GNN method with an attentive readout function, external web categories and a category-aware sampling method. We conduct rigorous offline and online experiments to show that our proposed solution is effective in real search engines, improving the overall usability and user experience.Keywords
All Related Versions
This publication has 11 references indexed in Scilit:
- LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking2022
- WebQA: Multihop and Multimodal QA2022
- Semantic Models for the First-Stage Retrieval: A Comprehensive ReviewACM Transactions on Information Systems, 2022
- An Empirical Study of Predictive Model for Website Quality Analytics using Dataset of different Domains of WebsiteRecent Advances in Computer Science and Communications, 2020
- A Comprehensive Survey on Graph Neural NetworksIEEE Transactions on Neural Networks and Learning Systems, 2020
- Every Document Owns Its Structure: Inductive Text Classification via Graph Neural Networks2020
- Text Level Graph Neural Network for Text Classification2019
- A quality evaluation model for the design quality of online shopping websitesElectronic Commerce Research and Applications, 2013
- Representation Learning: A Review and New PerspectivesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- Assessing the quality of web sitesApplied Computing and Informatics, 2011