Towards a general theory of similarity and association measures: Similarity, dissimilarity and correlation functions
- 19 October 2018
- journal article
- research article
- Published by SAGE Publications in Journal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology
- Vol. 36 (4) , 2977-3004
Abstract
Similarity, correlation and association measures play an important role in statistics, information retrieval, data mining and data science, classification and machine learning, recommender systems and decision-making. They have numerous applications in ecology, social and behavioral sciences, biology and bioinformatics, social network and time series analysis, image and natural language processing. Often the measures with the same name introduced on different domains have different properties, and the measures with the same properties have different names. To unify analysis of measures defined on different domains, this paper considers these measures as functions defined on universal domain and satisfying some sets of properties. The general properties of similarity functions (SF) and dissimilarity functions (DF) under the joint name of resemblance functions (RF) studied on universal domain and illustrated by examples on specific domains. The known and the new methods of construction of similarity measures are considered. This paper discusses the following aspects of RF: relationship with fuzzy (valued) relations, T-transitivity and triangle inequality, Minkowski distance and data transformation, cosine SF, RF on domains with involution (negation), aggregation and transformations of RF, visualization of RF. The paper considers also the lattice of RF, composition and min-transitive transformations of SF (fuzzy proximity relations), applications to hierarchical clustering and non-probabilistic entropy of RF. In addition, the paper proposes the method of construction of correlation functions (association measures) using SF. Pearson correlation and Yule’s Q association coefficients obtained as particular cases of the general method. One can use the paper as a survey of works on similarity and dissimilarity measures on specific domains, as a guide for constructing new similarity and correlation measures, as a base for the study of mathematical properties of resemblance functions on universal and specific domains, and also as a part of the course on Data Science.Keywords
This publication has 44 references indexed in Scilit:
- Elementary theory of similarities and its use in biology and geographyPattern Recognition and Image Analysis, 2012
- Similarity measures for binary and numerical data: a surveyInternational Journal of Knowledge Engineering and Soft Data Paradigms, 2009
- Comparison of similarity coefficients used for cluster analysis with dominant markers in maize (Zea mays L)Genetics and Molecular Biology, 2004
- Comparing resemblance measuresJournal of Classification, 1995
- A classification of presence/absence based dissimilarity coefficientsJournal of Classification, 1989
- Thirteen Ways to Look at the Correlation CoefficientThe American Statistician, 1988
- Metric and Euclidean properties of dissimilarity coefficientsJournal of Classification, 1986
- On the Utility of the E-Correlation Coefficient Concept in Psychological ResearchEducational and Psychological Measurement, 1978
- Features of similarity.Psychological Review, 1977
- Minimum Spanning Trees and Single Linkage Cluster AnalysisJournal of the Royal Statistical Society Series C: Applied Statistics, 1969