TYTong Yu

Tong Yu

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Tong Yu has a total of 10 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • $\mathtt{SpectralLeader}$: Online Spectral Learning for Single Topic Models

    by Tong Yu, Branislav Kveton, Zheng Wen, Hung Bui, Ole J. Mengshoel

  • Open Access

    SpectralLeader: Online Spectral Learning for Single Topic Models

    by Tong Yu, Branislav Kveton, Zheng Wen, Hung Bui, Ole J. Mengshoel

    We study the problem of learning a latent variable model from a stream of data. Latent variable models are popular in practice because they can explain observed data in terms of unobserved concepts. These models have been traditionally studied in the offline setting. In the online setting, on the other hand, the online EM is arguably the most popular algorithm for learning latent variable models. Although the online EM is computationally efficient, it typically converges to a local optimum. In this work, we develop a new online learning algorithm for latent variable models, which we call SpectralLeader. SpectralLeader always converges to the global optimum, and we derive a sublinear upper bound on its $n$-step regret in the bag-of-words model. In both synthetic and real-world experiments, we show that SpectralLeader performs similarly to or better than the online EM with tuned hyper-parameters.

  • Thompson Sampling for Optimizing Stochastic Local Search

    by Tong Yu, Branislav Kveton, Ole J. Mengshoel


  • Open Access

    Customized Nonlinear Bandits for Online Response Selection in Neural Conversation Models

    by Bing Liu, Tong Yu, Ian Lane, Ole J. Mengshoel

    Dialog response selection is an important step towards natural response generation in conversational agents. Existing work on neural conversational models mainly focuses on offline supervised learning using a large set of context-response pairs. In this paper, we focus on online learning of response selection in retrieval-based dialog systems. We propose a contextual multi-armed bandit model with a nonlinear reward function that uses distributed representation of text for online response selection. A bidirectional LSTM is used to produce the distributed representations of dialog context and responses, which serve as the input to a contextual bandit. In learning the bandit, we propose a customized Thompson sampling method that is applied to a polynomial feature space in approximating the reward. Experimental results on the Ubuntu Dialogue Corpus demonstrate significant performance gains of the proposed method over conventional linear contextual bandits. Moreover, we report encouraging response selection performance of the proposed neural bandit model using the Recall@k metric for a small set of online training samples.