Clustering doc2vec output for topic-dimensionality reduction: A MITRE ATT&CK calibration
Preprint
Abstract
We introduce a novel approach to text classification by combining doc2vec embeddings with advanced clustering techniques to improve the analysis of specialized, high-dimensional textual data. We integrate unsupervised methods such as Louvain, K-means, and Spectral clustering with doc2vec to enhance the detection of semantic patterns across a large corpus. As a case study, we apply this methodology to cybersecurity risk analysis using the MITRE ATT\&CK framework to structure and reduce the dimensionality of cyberattack tactics. Louvain clustering proved the most effective among the tested methods, achieving the best balance between cluster coherence and computational efficiency. Our approach identifies four "super tactics," demonstrating how clustering improves thematic coherence and risk attribution. The results validate the utility of combining doc2vec with clustering, particularly Louvain, for enhancing topic modeling and text classification.Keywords
All Related Versions
This publication has 9 references indexed in Scilit:
- Firm‐Level Climate Change ExposureThe Journal of Finance, 2023
- Neural network embeddings on corporate annual filings for portfolio selectionExpert Systems with Applications, 2021
- Firm-Level Political Risk: Measurement and Effects*The Quarterly Journal of Economics, 2019
- How news and its context drive risk and returns around the worldJournal of Financial Economics, 2019
- Managers set the tone: Equity incentives and the tone of earnings press releasesJournal of Banking & Finance, 2016
- Word power: A new approach for content analysisJournal of Financial Economics, 2013
- Sentiment during RecessionsThe Journal of Finance, 2013
- Fast unfolding of communities in large networksJournal of Statistical Mechanics: Theory and Experiment, 2008
- Is All That Talk Just Noise? The Information Content of Internet Stock Message BoardsThe Journal of Finance, 2004