Experiential meeting system

ems_design_source_data.png ems_design_integrated_data.png


EMS represents the Experiential Meeting System and this was the project supported by HP Labs for three years from 2002-2004. A meeting system requires the integration of heterogeneous media including video, audio, texts, etc. over the time line to search related materials changing or progressing spatio-temporally. The meeting itself is also a rather unstructured event typically a collection of events associated in an unstructured manner. The goal of the project is developing the theoretical backgrounds to design the proper storage and query methods to handle meeting related data to provide users enhanced experiences on meeting.


One of the greatest challenges in enterprises today is the lack of dynamic and ongoing information about individuals’ activities, interests, and expertise. Availability of such “personal chronicles” can provide rich benefits at both an individual and enterprise level. For example, personal chronicles can help individuals to far more effectively retrieve and review their activities and interactions, while at an enterprise level they can be data-mined to identify groups of common and complementary interests and skills, or to identify. We are developing experiential meeting systems to allow people to be tele-present in a remote meeting and to be able to review proceedings of a meeting or of several meetings using all the data recorded in a meeting. We consider this as a problem in management and experiential access to all multimedia data acquired in a meeting. The data includes video, audio, presentations, text material, databases and websites related to people and the discussions in the meeting, and any other data or information that could be obtained related to the events in the meeting. For experiential access to live and archived meetings, we propose detecting and storing events at three levels, domain, elemental, and data. We address issues in organizing information at domain level and using current signal processing algorithms for detecting events at data level. We show that to provide better specifications for processing algorithms for video and audio, it is essential to identify what is expected from them and define the environment and expectations very clearly. We also believe that while data processing algorithms are being developed for automatic detection of events, it may be essential to build tagging environments that will allow rapid semiautomatic tagging of data at all three levels so practical meeting systems could be implemented. Use of tagging environment is not only required to enable development of meeting systems in near future, but for defining environments for automatic detection of events in multifarious data. In this paper we present our ideas and experience with different techniques and outline our future directions. implicit work processes that are commonplace in every enterprise. Today’s existing tools are very limited in their support for dynamic capture of ongoing activities, in the organization and presentation of captured information, and in supporting rich annotation, search, retrieval, and publication of this information.

Main publications

  1. Ramesh Jain, Pilho Kim and Zhao Li, Experiential meeting system, ETP ‘03: Proceedings of the 2003 ACM SIGMM workshop on Experiential Telepresence, Berkeley, California, USA, pp. 1-12, 2003. ACM Portal
  1. Pilho Kim and Ramesh Jain, Category-based functional information modeling for echronicles, in Proc. IEEE 22nd International Conference on Data Engineering Workshops, Atlanta, USA, pp. 1-8, 2006. IEEE XPlore
  2. Pilho Kim, Ullas Gargi, and Ramesh Jain, “Event-based multimedia chronicling systems,” in Proc. of the 2nd ACM workshop on Capture, Archival and Retrieval of Personal Experiences, Hilton, Singapore, pp. 1-12, 2005. ACM Portal
  3. Pilho Kim and Ramesh Jain, Heterogeneous media events processing systems, ETP ‘04: Proceedings of the 2004 ACM SIGMM workshop on Effective Telepresence, New York, NY, USA, pp. 52-54, 2004. ACM Portal
  4. Pilho Kim, Mark Podlaseck, and Gopal Pingali, Personal chronicling tools for enhancing information archival and collaboration in enterprises, in Proc. of the 1st ACM workshop on continuous archival and retrieval of personal experiences, pp. 55-65, 2004. ACM Portal
  5. Amarnath Gupta, Bin Liu, Pilho Kim, and Ramesh Jain, Using stream semantics for continuous queries in media stream processors, in ICDE ‘04: Proceedings of the 20th International Conference on Data Engineering: IEEE Computer Society, p. 854, 2004. IEEE Xplore
  6. Rahul Singh, Zhao Li, Pilho Kim, Derik Pack, and Ramesh Jain, Event-based modeling and processing of digital media, International Workshop on Computer Vision meets Databases, Maison de la Chimie, Paris, France, pp. 19-26, 2004. ACM Portal