POMDP Modelling for Assessing Hierarchies
Preprint
Abstract
Hierarchical clustering has been shown to be valuable in many scenarios. Despite its usefulness to many situations, there is no agreed methodology on how to properly evaluate the hierarchies produced from different techniques, particularly in the case where ground-truth labels are unavailable. This motivates us to propose a framework for assessing the quality of hierarchical clustering allocations which covers the case of no ground-truth information. This measurement is useful, e.g., to assess the hierarchical structures used by online retailer websites to display their product catalogues. Our framework is one of the few attempts for the hierarchy evaluation from a decision-theoretic perspective. We model the process as a bot searching stochastically for items in the hierarchy and establish a measure representing the degree to which the hierarchy supports this search. We employ Partially Observable Markov Decision Processes (POMDP) to model the uncertainty, the decision making, and the cognitive return for searchers in such a scenario.Keywords
All Related Versions
This publication has 9 references indexed in Scilit:
- A Hierarchical Algorithm for Extreme Clustering2017
- Image-Based Recommendations on Styles and Substitutes2015
- A Decision-Theoretic Model of AssistanceJournal of Artificial Intelligence Research, 2014
- Understanding and Enhancement of Internal Clustering Validation MeasuresIEEE Transactions on Cybernetics, 2013
- Bayes-Adaptive Interactive POMDPsProceedings of the AAAI Conference on Artificial Intelligence, 2012
- Online Planning Algorithms for POMDPsJournal of Artificial Intelligence Research, 2008
- Bayesian hierarchical clustering2005
- Planning and acting in partially observable stochastic domainsArtificial Intelligence, 1998
- Efficient algorithms for agglomerative hierarchical clustering methodsJournal of Classification, 1984