Armin Bernstetter

The Virtual Fieldwork tool is an application developed in the game engine and 3D creation tool Unreal Engine. It is developed specifically for the ARENA2, a large, spatially immersive environment, and virtual reality using head-mounted displays. It contains a toolbox for quantitative measurements of visualized 3D model data. The application contains three different data sets from real-world use cases at GEOMAR.

The Digital Lab Book is a provenance visualization and management tool for immersive and collaborative cisual analytics. It acts as a direct companion to the Virtual Fieldwork Unreal Engine application providing a web-application that tracks interaction in the Unreal Engine. Each interaction in Unreal Engine triggers committing a visualization state to the DLB. The interaction history can be managed similar to a git repository by creating branches and stepping back to previous states in a visualized repository graph. The visualization states can be annotated, and organized in an internal mind-map tool. The resulting provenance repository can be exported as an archive and imported again, leading to simple shareability and thus better reproducibility of interactive sensemaking workflows.

In recent years, streaming platforms for video games have seen increasingly large interest, as so-called esports have developed into a lucrative branch of business. Like for other sports, watching esports has become a new kind of entertainment medium, which is possible due to platforms that allow gamers to live stream their gameplay, the most popular platform being Twitch.tv. On these platforms, users can comment on streams in real time and thereby express their opinion about the events in the stream. Due to the popularity of Twitch.tv, this can be a valuable source of feedback for streamers aiming to improve their reception in a gaming-oriented audience. In this work, we explore the possibility of deriving feedback for video streams on Twitch.tv by analyzing the sentiment of live text comments made by stream viewers in highly active channels. Automatic sentiment analysis on these comments is a challenging task, as one can compare the language used in Twitch.tv with that used by an audience in a stadium, shouting as loud as possible in sometimes nonorganized ways. This language is very different from common English, mixing Internet slang and gaming-related language with abbreviations, intentional and unintentional grammatical and orthographic mistakes, and emoji-like images called emotes . Classic lexicon-based sentiment analysis techniques therefore fail when applied to Twitch comments. To overcome the challenge posed by the nonstandard language, we propose two unsupervised lexicon-based approaches that make heavy use of the information encoded in emotes, as well as a weakly supervised neural network–based classifier trained on the lexicon-based outputs, which is supposed to help generalization to unknown words by use of domain-specific word embeddings. To enable better understanding of Twitch.tv comments, we analyze a large dataset of comments, uncovering specific properties of their language, and provide a smaller set of comments labeled with sentiment information by crowdsourcing. We present two case studies showing the effectiveness of our methods in generating sentiment trajectories for events live streamed on Twitch.tv that correlate well with specific topics in the given stream. This allows for a new kind of implicit real-time feedback gathering for Twitch streamers and companies producing games or streaming content on Twitch. We make our datasets and code publicly available for further research. ¹