Smarter mobility integrated system: A real time processing framework for sensor data aggregation, analysis, and query

Abstract

With IT technology, many kinds of mobility data are available for Intelligent Transportation Systems, and the numerous sensors generate huge amounts of data each second. Some of the major challenges for an ITS infrastructure in this domain are (i) data collection, (ii) data analysis, and (iii) real time queries. By gathering, mining and querying this data in an ITS infrastructure as efficiently as possible, there are promising opportunities for many ITS applications, especially for safer transportation. In this paper, we propose a real time processing framework for sensor data aggregation, analysis, and query. The system has a capacity to handle many kinds of sensor data transport connections, and is scalable for real time processing and querying of various kinds of data sources. We implemented a prototype system and evaluated its performance and capacity. Our system handled over 10,000 messages per second from car sensors.