Monitoring distributed, heterogeneous data streams: The emergence of safe zones

Daniel Keren, Guy Sagy, Amir Abboud, David Ben-David, Assaf Schuster, Izchak Sharfman, Antonios Deligiannakis

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review


In many emerging applications, the data to be monitored is of very high volume, dynamic, and distributed, making it infeasible to collect the distinct data streams to a central node and process them there. Often, the monitoring problem consists of determining whether the value of a global function, which depends on the union of all streams, crossed a certain threshold. A great deal of effort is directed at reducing communication overhead by transforming the monitoring of the global function to the testing of local constraints, checked independently at the nodes. Recently, geometric monitoring (GM) proved to be very useful for constructing such local constraints for general (non-linear, non-monotonic) functions. Alas, in all current variants of geometric monitoring, the constraints at all nodes share an identical structure and are, thus, unsuitable for handling heterogeneous streams, which obey different distributions at the distinct nodes. To remedy this, we propose a general approach for geometric monitoring of heterogeneous streams (HGM), which defines constraints tailored to fit the distinct data distributions at the nodes. While optimally selecting the constraints is an NP-hard problem, we provide a practical solution, which seeks to reduce running time by hierarchically clustering nodes with similar data distributions and then solving more, but simpler, optimization problems.

Original languageEnglish
Title of host publicationApplied Algorithms - 1st International Conference, ICAA 2014, Proceedings
EditorsProsenjit Gupta, Christos Zaroliagis
PublisherSpringer Verlag
Number of pages12
ISBN (Electronic)9783319041254
StatePublished - 2014
Event1st International Conference on Applied Algorithms, ICAA 2014 - Kolkata, India
Duration: 13 Jan 201415 Jan 2014

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Conference1st International Conference on Applied Algorithms, ICAA 2014

Bibliographical note

Publisher Copyright:
© Springer International Publishing Switzerland 2014.

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science


Dive into the research topics of 'Monitoring distributed, heterogeneous data streams: The emergence of safe zones'. Together they form a unique fingerprint.

Cite this