Improving Temporal Consistency in Text-Based Indices with Rank-Informed Calibration
Authors:
- Nathaniel KangNKNathaniel Kang
- Jiwoo KimJKJiwoo Kim
- Yugyeong LimYLYugyeong Lim
- Jaeyoung JangJJJaeyoung Jang
- Jongho ImJIJongho Im
Preprint
- 4 June 2026
- preprint
- Published by Elsevier in SSRN Electronic Journal
Abstract
Text-based indices from news and social media track latent constructs such as risk, sentiment, and uncertainty, but evolving language and coverage induce temporal measurement error that undermines longitudinal comparability.We cast calibration as a rank-constrained convex program: with partial ordinal information on a subset of time points, a convex monotone M-estimator yields a unique rank-consistent fit; the squared-loss specialization reduces to pool-adjacent-violators estimation with standard isotonic guarantees.Stochastic residual augmentation preserves expected ordering while restoring variability, and a regularized supervised model propagates the calibrated scale to the full series without additional rank labels.A semiconductor risk case study with expert anchors shows strong leave-one-out generalization, alignment with independent volatility proxies, and improved temporal coherence relative to distribution matching and regression-style comparators.Keywords
This publication has 20 references indexed in Scilit:
- News-based business sentiment and its properties as an economic indexInformation Processing & Management, 2022
- Deep learning for financial applications : A surveyApplied Soft Computing, 2020
- On a nonparametric notion of residual and its applicationsStatistics & Probability Letters, 2016
- Fine-grained analysis of explicit and implicit sentiment in financial news articlesExpert Systems with Applications, 2015
- Multiscale event detection in social mediaData Mining and Knowledge Discovery, 2015
- Text as Data: The Promise and Pitfalls of Automatic Content Analysis Methods for Political TextsPolitical Analysis, 2013
- Robust Statistics2009
- Unimodal regression via prefix isotonic regressionComputational Statistics & Data Analysis, 2008
- Bursty and Hierarchical Structure in StreamsData Mining and Knowledge Discovery, 2003
- Measurement Error Models1987