MENU

CodeMM

Collaborative knowledge in big communities (known as Wisdom of the crowds) and self-organization of huge amount of networked participants have shown a lot of potential in diverse fields of computer science and information systems. Still, there are many scenarios, in particular in highly professional applications, where a critical mass of users (experts) cannot be found in order to safely create this knowledge. In several scenarios a top down model  providing generally agreed domain knowledge can be used as common ground for communication. However, for other scenarios, diversity in terms of interest, motivation, information need, and many other characteristics prevent top down approaches, for which an à priori consensus between participating members must be found. Within the project at hand we focus on small and medium sized groups of people, who (i) have common interests but are too diverse for applying a commonly agreed model and (ii) who are bound to use multimedia systems to satisfy their needs. Further, we consider these people being experts with intense domain knowledge, such as medical doctors.

In our project we plan to investigate (i) how communities of domain experts can be supported by multimedia information systems and (ii) how to leverage self-organization within those groups to a new level by novel and innovative multimedia services. With the help of our project partner, the KARL STORZ GmbH & Co KG, we will employ our research results to a real world scenario: a multimedia information system for endoscopic videos supporting surgeons spread all over the world. While content storage can be regarded as a solved problem, intelligent and specialized content annotation, retrieval, and analysis methods are totally missing in this domain. Tools for exchanging information  among the domain experts are missing as well.

The research objectives in the project are divided into three major parts. (i) In the user part we focus on the user context and investigate individual as well as emergent group intentions. We will facilitate our research on intentions to leverage emergent semantics and self-organization within multimedia information systems. (ii) In the content part we will develop novel and innovative multimedia tools and techniques that integrate contextual information as well as domain-specific knowledge and emergent semantics to provide enhanced multimedia services in the (iii) scenario part to support surgeons in their daily routine.

With the proposed project we extend and intensify the partnership with KARL STORZ, one of the leading endoscope manufacturers in the world. Based on the CODE-MM Lakeside Labs project, which is proposed in addition to an ongoing applied research project, funded directly by KARL STORZ, we aim at consolidating and fostering basic and applied research competence in multimedia information systems for medical scenarios in Carinthia. In case of success, a number of exiting scientific and economic opportunities will unfold. Long term goal is the establishment of a center of expertise in this field – at least partially funded by KARL STORZ – or a new company dedicated to industry-oriented development and research and world-wide delivery of software tools for medical multimedia information systems. The high engagement of KARL STORZ in the project is by all means a strong indication of this excellent future potential.

This project is supported by Lakeside Labs GmbH, Klagenfurt, Austria and funding from the European Regional Development Fund and the Carinthian Economic Promotion Fund (KWF) under grant KWF – 20214 22573 33955.

Publications

  • Instrument Classification in Laparoscopic Videos
    Manfred Jürgen Primus, Klaus Schoeffmann, Laszlo Böszörmenyi, Instrument Classification in Laparoscopic Videos, In 13th International Workshop on Content-Based Multimedia Indexing (Tomas Skopal, Jakub Lokoc, eds.), IEEE Computer Society, Los Alamitos, CA, USA, pp. 1-6, 2015.
  • What are the Salient Keyframes in Short Casual Videos? An Extensive User Study using a new Video Dataset
    Jakub Lokoc, Bernd Münzer, Klaus Schoeffmann, Manfred del Fabro, Manfred Jürgen Primus, Tomas Skopal, Jan Lansky, What are the Salient Keyframes in Short Casual Videos? An Extensive User Study using a new Video Dataset, In Proceedings of the 2015 IEEE International Conference on Multimedia & Expo Workshops (ICMEW) (Matteo Cesana, ed.), IEEE, Los Alamitos, CA, pp. 1-6, 2015.
  • Multimodal Synchronization of Image Galleries
    M Zaharieva, M Riegler, M Del Fabro, Multimodal Synchronization of Image Galleries, In Working Notes Proceedings of the MediaEval 2014 Workshop (F De Natale, V Mezaris, N Conci, eds.), CEUR-WS, Vol-1263, pp. 1-2, 2014.
  • Clustering and Retrieval of Social Events in Flickr
    M Zaharieva, M Schopfhauser, M Del Fabro, M Zeppelzauer, Clustering and Retrieval of Social Events in Flickr, In Working Notes Proceedings of the MediaEval 2014 Workshop (G Petkos, S Papadopoulos, G Rizzo, V Mezaris, R Troncy, eds.), CEUR-WS, Vol-1263, pp. 1-2, 2014.
  • The Video Browser Showdown: a live evaluation of interactive video search tools
    Klaus Schoeffmann, David Ahlström, Werner Bailer, Claudiu Cobarzan, Frank Hopfgartner, Kevin McGuinness, Cathal Gurrin, Christian Frisson, Duy-Dinh Le, Manfred Del Fabro, Hongliang Bai, Wolfgang Weiss, The Video Browser Showdown: a live evaluation of interactive video search tools, In International Journal of Multimedia Information Retrieval, Springer, Berlin, Germany, pp. 1-15, 2013.
  • Content-Based Video Browsing with Collaborating Mobile Clients
    Claudiu Cobarzan, Marco Andrea Hudelist, Manfred Del Fabro, Content-Based Video Browsing with Collaborating Mobile Clients, In MultiMedia Modeling, 20th Anniversary International Conference (C Gurrin, F Hopfgartner, W Hurst, H Johansen, H Lee, N O'Connor, eds.), Springer, Berlin, Germany, pp. 402-406, 2014.
  • Unsupervised Clustering of Social Events
    Matthias Zeppelzauer, Maia Zaharieva, Manfred Del Fabro, Unsupervised Clustering of Social Events, In MediaEval 2013 – Multimedia Benchmark Workshop (Martha Larson, Xavier Anguera, Timo Reuter, Gareth Jones, Bogdan Ionescu, Markus Schedl, Tomas Piatrik, Claudia Hauff, Mohammad Soleymani, eds.), CEUR-WS.org/Vol-1043, Aachen, Germany, pp. 1-2, 2013.
  • Segmentation of Recorded Endoscopic Videos by Detecting Significant Motion Changes
    Manfred Jürgen Primus, Klaus Schoeffmann, Laszlo Böszörmenyi, Segmentation of Recorded Endoscopic Videos by Detecting Significant Motion Changes, In 11th International Workshop on Content-Based Multimedia Indexing (Laszlo Czuni, ed.), IEEE Computer Society, Los Alamitos, CA, USA, pp. 223-228, 2013.
  • A Filtering Tool to Support Interactive Search in Internet Video Archives
    Manfred Del Fabro, Klaus Schoeffmann, Mario Guggenberger, Mario Taschwer, A Filtering Tool to Support Interactive Search in Internet Video Archives, In 11th International Workshop on Content-Based Multimedia Indexing (Laszlo Czuni, ed.), IEEE Computer Society, Los Alamitos, CA, USA, pp. 7-10, 2013.
  • State-of-the-art and future challenges in video scene detection: a survey
    Manfred Del Fabro, Laszlo Böszörmenyi, State-of-the-art and future challenges in video scene detection: a survey, In Multimedia Systems, Springer-Verlag, vol. 19, no. 5, Berlin, Heidelberg, New York, pp. 427-454, 2013.
  • AAU Video Browser with Augmented Navigation Bars
    Manfred Del Fabro, Bernd Münzer, Laszlo Böszörmenyi, AAU Video Browser with Augmented Navigation Bars, In Advances in Multimedia Modeling (Shipeng Li, Abdulmotaleb El-Saddik, Meng Wang, Tao Mei, Nicu Sebe, Shuicheng Yan, Richang Hong, Cathal Gurrin, eds.), Springer, Berlin Heidelberg, pp. 544-546, 2013.
  • Smart Video Browsing With Augmented Navigation Bars
    Manfred Del Fabro, Bernd Münzer, Laszlo Böszörmenyi, Smart Video Browsing With Augmented Navigation Bars, In Advances in Multimedia Modeling (Shipeng Li, Abdulmotaleb El-Saddik, Meng Wang, Tao Mei, Nicu Sebe, Shuicheng Yan, Richang Hong, Cathal Gurrin, eds.), Springer, Berlin Heidelberg, pp. 88-98, 2013.
  • Interactive Evaluation of Video Browsing Tools
    Werner Bailer, Klaus Schoeffmann, David Ahlström, Wolfgang Weiss, Manfred Del Fabro, Interactive Evaluation of Video Browsing Tools, In Advances in Multimedia Modeling (Shipeng Li, Abdulmotaleb El-Saddik, Meng Wang, Tao Mei, Nicu Sebe, Shuicheng Yan, Richang Hong, Cathal Gurrin, eds.), Springer, Berlin Heidelberg, pp. 81-91, 2013.
  • ITEC-UNIKLU Known-Item Search Submission 2012
    Manfred Del Fabro, Mathias Lux, Klaus Schoeffmann, Mario Taschwer, ITEC-UNIKLU Known-Item Search Submission 2012, In Proceedings of TRECVID 2012 (Paul Over, George Awad, Martial Michel, Jonathan Fiscus, Greg Sanders, Barbara Shaw, Wessel Kraaij, Alan Smeaton, Georges Quénot, eds.), National Institute of Standards and Technology (NIST), Gaithersburg, USA, pp. 11, 2012.
  • A User Study on Image Browsing on Touchscreens
    David Ahlström, Marco Andrea Hudelist, Klaus Schoeffmann, Gerald Schaefer, A User Study on Image Browsing on Touchscreens, In Proceedings of the 20th ACM international conference on Multimedia (Noboru Babaguchi, Kiyoharu Aizawa, John Smith, eds.), ACM Digital Library, New York, USA, pp. pp. 925-928, 2012.
  • A closer look at photographers' intentions: a test dataset
    Mathias Lux, Mario Taschwer, Oge Marques, A closer look at photographers' intentions: a test dataset, In Proceedings of the ACM multimedia 2012 workshop on Crowdsourcing for multimedia (Kiyoharu Aizawa, Noboru Babaguchi, John Smith, eds.), ACM, New York, NY, USA, pp. 17-18, 2012.
  • Classification of photos based on good feelings: ACM MM 2012 multimedia grand challenge submission
    Mathias Lux, Mario Taschwer, Oge Marques, Classification of photos based on good feelings: ACM MM 2012 multimedia grand challenge submission, In Proceedings of the 20th ACM international conference on Multimedia (Kiyoharu Aizawa, Noboru Babaguchi, John Smith, eds.), ACM, New York, NY, USA, pp. 1367-1368, 2012.
  • Why did you record this video? An exploratory study on user intentions for video production
    Mathias Lux, Jochen Huber, Why did you record this video? An exploratory study on user intentions for video production, In Image Analysis for Multimedia Interactive Services (WIAMIS), 2012 13th International Workshop on (Noel O'Connor, Petros Daras, Fernando Pereira, eds.), IEEE, Los Alamitos, CA, USA, pp. 1-4, 2012.
  • Finding Image Regions with Human Computation and Games with a Purpose
    Mathias Lux, Mario Guggenberger, Alexander Müller, Finding Image Regions with Human Computation and Games with a Purpose, In Proceedings of the Eighth Artificial Intelligence and Interactive Digital Entertainment International Conference (AIIDE 2012) (Mark Riedl, Gita Sukthankar, eds.), Association for the Advancement of Artificial Intelligence (AAAI Press), Palo Alto, California, USA, pp. 220, 2012.
  • Visual information retrieval using Java and LIRE
    Oge Marques, Mathias Lux, Visual information retrieval using Java and LIRE, In Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval (William Hersh, Jamie Callan, Yoelle Maarek, Mark Sanderson, eds.), ACM, New York, NY, USA, pp. 1193-1193, 2012.
  • The video summary GWAP: summarization of videos based on a social game
    Alexander Müller, Mathias Lux, Laszlo Böszörmenyi, The video summary GWAP: summarization of videos based on a social game, In Proceedings of the 12th International Conference on Knowledge Management and Knowledge Technologies (Stefanie Lindstaedt, Michael Granitzer, eds.), ACM, New York, NY, USA, pp. 15:1-15:7, 2012.
  • Robust image retrieval using bag of visual words with fuzzy codebooks and fuzzy assignment
    Marian Kogler, Mathias Lux, Robust image retrieval using bag of visual words with fuzzy codebooks and fuzzy assignment, In i-KNOW '12 Proceedings of the 12th International Conference on Knowledge Management and Knowledge Technologies (Stefanie Lindstaedt, ed.), ACM, New York, NY, USA, pp. 34.1 – 34.4, 2012.
  • A Demonstration of A Hierarchical Multi-Layout 3D Video Browser
    Christopher Mueller, Martin Smole, Klaus Schoeffmann, A Demonstration of A Hierarchical Multi-Layout 3D Video Browser, In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME 2012) (Jian Zhang, Dan Schonfeld, David Dagan Feng, Jianfei Cai Nanyang, Alan Hanjalic, Enrico Magli, Mark Pickering, Gerald Friedland, Xian-Sheng Hua, eds.), IEEE Computer Society, Los Alamitos, CA, USA, pp. 665, 2012.
  • Summarization of Real-Life Events Based on Community-Contributed Content
    Manfred Del Fabro, Anita Sobe, Laszlo Böszörmenyi, Summarization of Real-Life Events Based on Community-Contributed Content, In Proceedings of the Fourth International Conferences on Advances in Multimedia (MMEDIA 2012) (Philip Davies, David Newell, eds.), IARIA, France, pp. 119-126, 2012.
  • Self-organizing content sharing at social events
    Anita Sobe, Wilfried Elmenreich, Manfred Del Fabro, Self-organizing content sharing at social events, In European Meeting on Cybernetics and Systems Research Book of Abstracts (Robert Bichler, Stefan Blachfellner, Wolfgang Hofkirchner, eds.), EMCSR, Vienna, pp. 197-200, 2012.
  • Mobile Image Browsing on a 3D Globe
    Klaus Schoeffmann, Marco Andrea Hudelist, Gerald Schaefer, Manfred Del Fabro, Mobile Image Browsing on a 3D Globe, In Proceedings of the 2nd ACM International Conference on Multimedia Retrieval (H S Ip Horace, Yong Rui, eds.), ACM, New York, NY, USA, pp. 61:1-61:2, 2012.
  • Using a Cylindrical Interface for Image Browsing to Improve Visual Search Performance
    Klaus Schoeffmann, David Ahlström, Using a Cylindrical Interface for Image Browsing to Improve Visual Search Performance, In Proceedings of The 13th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS 2012) (Noel O'Connor, Petros Daras, Fernando Pereira, eds.), IEEE, Los Alamitos, CA, USA, pp. 1-4, 2012.
  • A Visual Search User Study on the Influences of Aspect Ratio Distortion of Preview Thumbnails
    David Ahlström, Klaus Schoeffmann, A Visual Search User Study on the Influences of Aspect Ratio Distortion of Preview Thumbnails, In Proceedings of the 2012 IEEE International Conference on Multimedia and Expo Workshops (Jian Zhang, Dan Schonfeld, David Dagan Feng, Jianfei Cai Nanyang, Alan Hanjalic, Enrico Magli, Mark Pickering, Gerald Friedland, Xian-Sheng Hua, eds.), IEEE Computing Society, Los Alamitos, CA, USA, pp. 546-551, 2012.
  • 3D Storyboards for Interactive Visual Search
    Klaus Schoeffmann, David Ahlström, Laszlo Böszörmenyi, 3D Storyboards for Interactive Visual Search, In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME 2012) (Jian Zhang, Dan Schonfeld, David Dagan Feng, Jianfei Cai Nanyang, Alan Hanjalic, Enrico Magli, Mark Pickering, Gerald Friedland, Xian-Sheng Hua, eds.), IEEE Computer Society, Los Alamitos, CA, USA, pp. 848-853, 2012.