A key challenge to the successful application of the data modeling, storage and retrieval is the processing of relevant media to determine the events that are represented by them. Towards this goal, we developed a heterogeneous media events processing system that combines human expertise with algorithmic processing capabilities. In doing so, we seek to leverage the fact that computers are good at fast low level processing and humans are good at high level analysis and understanding. Our approach to bridging the “signal-to-symbol” barrier is based on a 3-layered event-processing architecture composed of a lower data event layer, higher domain event layer, and an elemental event layer in the middle, which links data and domains with symbolic indices (see [3] for details). Two important challenges in this context are providing humans with an interactive interface to do a domain level event tagging, and providing computers with methods to construct computational causality models based on tagged events. Towards this, in our demonstration, we first showed how our system detects events and we provide user-tagging environment on top of these detected events. Later, we introduced our distributed media processing networks and specific domain based event search system, which may show a way to change existing limited PowerPoint like presentation methods.

Main publications

  1. Pilho Kim and Ramesh Jain, Heterogeneous media events processing systems, ETP ‘04: Proceedings of the 2004 ACM SIGMM workshop on Effective Telepresence, New York, NY, USA, pp. 52-54, 2004. ACM Portal
  2. Pilho Kim, Ullas Gargi, and Ramesh Jain, “Event-based multimedia chronicling systems,” in Proc. of the 2nd ACM workshop on Capture, Archival and Retrieval of Personal Experiences, Hilton, Singapore, pp. 1-12, 2005. ACM Portal
  1. Pilho Kim and Ramesh Jain, Category-based functional information modeling for echronicles, in Proc. IEEE 22nd International Conference on Data Engineering Workshops, Atlanta, USA, pp. 1-8, 2006. IEEE XPlore
  2. Pilho Kim, Mark Podlaseck, and Gopal Pingali, Personal chronicling tools for enhancing information archival and collaboration in enterprises, in Proc. of the 1st ACM workshop on continuous archival and retrieval of personal experiences, pp. 55-65, 2004. ACM Portal
  3. Amarnath Gupta, Bin Liu, Pilho Kim, and Ramesh Jain, Using stream semantics for continuous queries in media stream processors, in ICDE ‘04: Proceedings of the 20th International Conference on Data Engineering: IEEE Computer Society, p. 854, 2004. IEEE Xplore
  4. Rahul Singh, Zhao Li, Pilho Kim, Derik Pack, and Ramesh Jain, Event-based modeling and processing of digital media, International Workshop on Computer Vision meets Databases, Maison de la Chimie, Paris, France, pp. 19-26, 2004. ACM Portal
  5. Ramesh Jain and Pilho Kim, Experiential meeting system, ETP ‘03: Proceedings of the 2003 ACM SIGMM workshop on Experiential Telepresence, Berkeley, California, USA, pp. 1-12, 2003. ACM Portal