Similarity measures in scientometric research: The Jaccard index versus Salton's cosine formula

doi:10.1016/0306-4573(89)90048-4

Information Processing & Management

Volume 25, Issue 3, 1989, Pages 315-318

https://doi.org/10.1016/0306-4573(89)90048-4 Get rights and content

Abstract

It is shown that in most practical cases Salton's cosine formula yields a numerical value that is twice Jaccard's index.

References (13)

L.B. Doyle
The microstatistics of text
Information Storage and Retrieval
(1963)
A. Jacquesson et al.
Term association analysis on a large file of bibliographic data, using a highly controlled indexing vocabulary
Information Storage and Retrieval
(1973)
R.C. Dubes
How many clusters are best? —An experiment
Pattern Recognition
(1987)
M. Levandowsky et al.
Distance between sets
Nature
(1971)
P.H.A. Sneath et al.
Numerical taxonomy
(1973)
P. Jaccard
Etude comparative de la distribution florale dans une portion des Alpes et du Jura
Bulletin de la Société vaudoise des Sciences Naturelles
(1901)

There are more references available in the full text version of this article.

Cited by (332)

Multiple clusterings: Recent advances and perspectives
2024, Computer Science Review
Clustering is a fundamental data exploration technique to discover hidden grouping structure of data. With the proliferation of big data, and the increase of volume and variety, the complexity of data multiplicity is increasing as well. Traditional clustering methods can provide only a single clustering result, which restricts data exploration to one single possible partition. In contrast, multiple clustering can simultaneously or sequentially uncover multiple non-redundant and distinct clustering solutions, which can reveal multiple interesting hidden structures of the data from different perspectives. For these reasons, multiple clustering has become a popular and promising field of study. In this survey, we have conducted a systematic review of the existing multiple clustering methods. Specifically, we categorize existing approaches according to four different perspectives (i.e., multiple clustering in the original space, in subspaces and on multi-view data, and multiple co-clustering). We summarize the key ideas underlying the techniques and their objective functions, and discuss the advantages and disadvantages of each. In addition, we built a repository of multiple clustering resources (i.e., benchmark datasets and codes). Finally, we discuss the key open issues for future investigation.
Information disclosure, spillovers, and knowledge accumulation
2024, China Economic Review
In 2016, the China Industrial Economics (CIE) journal made a decision to publish the data and codes of relevant papers. We conducted an analysis to examine the causal effects between information disclosure and knowledge accumulation based on this policy change. The results showed a significant increase in both downloads and citations of CIE papers after implementing this policy. Furthermore, we observed that there was a notable increase in similarity between CIE papers and those that cited them, indicating that information disclosure contributes to generating new knowledge.Additionally, our findings revealed that the knowledge spillover effects of CIE papers were primarily driven by increased citations from second-tier journals. This suggests that information disclosure facilitates the dissemination and diffusion of existing knowledge, providing valuable learning opportunities for scientists who have limited access to resources.These findings highlight how information disclosure supports publication and knowledge production processes while promoting greater democratization of science within scientific communities.
Being together in place as a catalyst for scientific advance
2024, Research Policy
The COVID-19 pandemic necessitated social distancing at every level of society, including universities and research institutes, raising essential questions concerning the continuing importance of physical proximity for scientific and scholarly advance. Using customized author surveys about the intellectual influence of referenced work on scientists' own papers, combined with precise measures of geographical and semantic distance between focal and referenced works, we find that being at the same institution is strongly associated with intellectual influence on scientists' and scholars' published work. However, this influence increases with intellectual distance: the more different the referenced work done by colleagues at one's institution, the more influential it is on one's own. Universities worldwide constitute places where people doing very different work engage in sustained interactions through departments, committees, seminars, and communities. These interactions come to uniquely influence their published research, suggesting the need to replace rather than displace diverse engagements for sustainable advance.
Mining actionable concepts in concept lattice using Interestingness Propagation
2024, Journal of Computational Science
Mining important conceptual patterns is an essential task for understanding the context and content of complex data in many scientific and engineering applications. While exact relevance indices in Formal Concept Analysis provide accurate importance evaluation that can be used for extracting interesting concepts, they often have expensive algorithmic complexity (e.g., at least quadratic in the lattice size, which is exponential with respect to the context size). This frequently results in a computational bottleneck, rendering these indices inappropriate for large, dense contexts or small contexts with large concepts. In this paper, we introduce Interestingness Propagation ( $IP$ ), an efficient message passing strategy for identifying actionable concepts based on interesting and uninteresting information available from a very small portion of the concepts in lattices. From a conceptual perspective, $IP$ leverages the lattice local and global conceptual structures to maintain local and global consistency in the interesting or uninteresting labeling information among similar neighborhood concepts. Experiments on synthetic and real-world datasets show that $IP$ can accurately extract interesting concepts that are very competitive with ground truth ones computed using state-of-the-art exact interestingness indices, while being at least three times faster than certain indices like $CR$ and one order of magnitude faster than others like stability.
Detecting communities in higher-order networks by using their derivative graphs
2023, Chaos, Solitons and Fractals
Similar to what happens in the pairwise network domain, the communities of nodes of a hypergraph (also called higher-order network) are formed by groups of nodes that share many hyperedges, so that the number of hyperedges they share with the rest of the nodes is significantly smaller, and therefore these communities can be considered as independent compartments (or super-clusters) of the hypergraph. In this work we present a method, based on the so-called derivative graph of a hypergraph, which allows the detection of communities of a higher-order network without high computational cost and several simulations are presented that show the significant computational advantages of the proposed method over other existing methods.
An efficient entropy of sum approach for measuring diversity and interdisciplinarity
2023, Journal of Informetrics
Rousseau and Mutz argued that the existing researches on diversity measure methods, such as the Rao-Stirling index, DIV, etc., have shortcomings, and urged colleagues to find a better framework for diversity measure. Based on Shannon entropy and entropy of degree vector sum, in this contribution a new diversity measure EDVS (Entropy of Degree Vectors Sum) is proposed, which meets all requirements of variety, balance and disparity, and can directly calculate the value of diversity from the observed sample data without calculating the joint probability distribution of two random variables, or mutual information. The empirical results show that: (1) the ranking of the EDVS measure has a higher Spearman correlation coefficient with DIV and DIV* than with Shannon entropy. (2) The EDVS ranking is more relevant with DIV* than with DIV. (3) The diversity of soft science journals is higher than that of hard science journals, which indicates that the interdisciplinary research of social sciences and humanities is more common than that of hard sciences such as sciences and engineering sciences. (4) Rao-Stirling index and DIV index are more sensitive to sample size. The computational complexity of the Rao-Stirling index and DIV index is $O (n^{3})$ , while the computational complexity of the EDVS index is $O (n^{2})$ . This provides the feasibility for analyzing high-dimension networks and large data sets. Results of verification on different types of data sets show that EDVS can not only effectively measure the diversity of disciplines in interdisciplinary research, but also effectively measure the diversity of other entities.

View all citing articles on Scopus

View full text

Similarity measures in scientometric research: The Jaccard index versus Salton's cosine formula

Abstract

Information Storage and Retrieval

Information Storage and Retrieval

Pattern Recognition

Distance between sets

Nature

Numerical taxonomy

Etude comparative de la distribution florale dans une portion des Alpes et du Jura

Bulletin de la Société vaudoise des Sciences Naturelles