Detecting buzz from time-sequenced document streams

Abstract

This paper presents a formal method of detecting emerging and changing interests that appear in document streams arriving continuously over time. Examples of such document streams include email, news articles, and weblogs (or blogs). We utilize the temporal information associated with documents in the streams and discover emerging issues and topics of interest and their change by detecting buzzwords in the documents. Buzzwords are terms that occur with strong momentum for a relatively short period of time. Our approachfor buzz detection is based on the notion of "burst of activities" proposed by Kleinberg [7]. The burst of activities is modeled using a weighted automaton. We propose an algorithm to discover buzzwords of high intensity measured by their momentum and relative duration of the bursts. The method is applied and validated on a stream of blog postings and we report the experiment results. © 2005 IEEE.