Lightweight monitoring of distributed streams

Arnon Lazerson, Daniel Keren, Assaf Schuster

Research output: Contribution to journalArticlepeer-review


As data becomes dynamic, large, and distributed, there is increasing demand for what have become known as distributed stream algorithms. Since continuously collecting the data to a central server and processing it there is infeasible, a common approach is to define local conditions at the distributed nodes, such that-as long as they are maintained-some desirable global condition holds. Previous methods derived local conditions focusing on communication efficiency. While proving very useful for reducing the communication volume, these local conditions often suffer from heavy computational burden at the nodes. The computational complexity of the local conditions affects both the runtime and the energy consumption. These are especially critical for resource-limited devices like smartphones and sensor nodes. Such devices are becoming more ubiquitous due to the recent trend toward smart cities and the Internet of Things. To accommodate for high data rates and limited resources of these devices, it is crucial that the local conditions be quickly and efficiently evaluated. Here we propose a novel approach, designated CB (for Convex/Concave Bounds). CB defines local conditions using suitably chosen convex and concave functions. Lightweight and simple, these local conditions can be rapidly checked on the fly. CB's superiority over the state-of-the-art is demonstrated in its reduced runtime and power consumption, by up to six orders of magnitude in some cases. As an added bonus, CB also reduced communication overhead in all the tested application scenarios.

Original languageEnglish
Article number3226113
JournalACM Transactions on Database Systems
Issue number2
StatePublished - Jul 2018

Bibliographical note

Publisher Copyright:
©2018 ACM.


  • Continuous Distributed Monitoring
  • Disributed Stream Mining

ASJC Scopus subject areas

  • Information Systems


Dive into the research topics of 'Lightweight monitoring of distributed streams'. Together they form a unique fingerprint.

Cite this