Syntactic Recurrent Neural Network for Authorship Attribution
Preprint
Abstract
Writing style is a combination of consistent decisions at different levels of language production including lexical, syntactic, and structural associated to a specific author (or author groups). While lexical-based models have been widely explored in style-based text classification, relying on content makes the model less scalable when dealing with heterogeneous data comprised of various topics. On the other hand, syntactic models which are content-independent, are more robust against topic variance. In this paper, we introduce a syntactic recurrent neural network to encode the syntactic patterns of a document in a hierarchical structure. The model first learns the syntactic representation of sentences from the sequence of part-of-speech tags. For this purpose, we exploit both convolutional filters and long short-term memories to investigate the short-term and long-term dependencies of part-of-speech tags in the sentences. Subsequently, the syntactic representations of sentences are aggregated into document representation using recurrent neural networks. Our experimental results on PAN 2012 dataset for authorship attribution task shows that syntactic recurrent neural network outperforms the lexical model with the identical architecture by approximately 14% in terms of accuracy.Keywords
All Related Versions
This publication has 5 references indexed in Scilit:
- Surveying Stylometry Techniques and ApplicationsACM Computing Surveys, 2017
- The Effect of Different Writing Tasks on Linguistic Style: A Case Study of the ROC Story Cloze Task2017
- Authorship Attribution Using a Neural Network Language ModelProceedings of the AAAI Conference on Artificial Intelligence, 2016
- Effective Use of Word Order for Text Categorization with Convolutional Neural Networks2015
- Computational methods in authorship attributionJournal of the American Society for Information Science and Technology, 2008