Multimedia Support for Decision-Making Processes

Multimedia for Decision-Making

In the era of Cognitive Computing

The increasing momentum towards cognitive computing unlocks a diverse set of opportunities and challenges for multimedia research. MuSDeMP (Multimedia Support for Decision-Making Processes) workshop intends to be multidisciplinary and we hope to inspire participation from a variety of researchers from industry and academia.

Submit your paper

Only electronic submission will be accepted. Technical paper authors MUST submit their manuscripts through CMT. Please follow the link CMT FOR MuSDeMP2016 (please register if not a CMT user). Manuscripts may only be submitted in PDF format. A copyright form needs to be submitted upon acceptance of the paper.

General Information

The increasing momentum towards cognitive computing unlocks a diverse set of opportunities and challenges for multimedia research. IBM Watson™, Google Chauffeur and Baby X are just some examples of systems including multimedia-related technologies that hold a lot of potential to impact business and society. An important aspect of cognitive computing is that it also offers a number of possibilities to augment human capacity and understanding in decision-making processes.

Decision-making can be seen as a cognitive process of making choices by setting goals, identifying and gathering information (evidence), reflecting and choosing alternatives to take actions. In this context, the role of multimedia research goes far beyond an isolated analysis of multimedia content to improve, for instance, indexing and retrieval. In fact, multimedia plays a key role in the signification process (i.e. semantic qualification) of unstructured data demanded for making decisions. To decision makers, effectively producing and consuming semantically structured and relevant multimodal information is key. Producing structured data, building knowledge from it, and making decisions based on this knowledge is challenging and involves sophisticated multimedia and cognitive processes. To address this challenge it is necessary to explore multimedia through different perspectives such as Visualization, Computer Vision, Natural Language Processing, speech recognition, social media, Machine Learning, Internet of Things, Human-Centered Computing, and the Synchronization in space and time of multimodal input interfaces, multiple distributed exhibition devices, sensors and actuators.

The workshop will be held in conjunction with ISM 2016 in San Jose, CA, USA on December 11-13, 2016. The page limit for workshop publications is 6 pages (see the manuscript preparation instructions). MuSDeMP papers will be presented at IEEE ISM2016, and included in the symposium Proceedings.

Paper selection process

A scientific committee will select short and full papers suitable for presentation on the MuSDeMP 2016. Authors are expected to submit papers until the date of final paper submission. The paper must follow the IEEE ISM 2016 guidelines and templates. After submission, at least two independent reviewers will evaluate the quality of the paper. The selection will be based on:

  • Suitability of the topic for the workshop;
  • Research repeatability and reproducibility;
  • Demo-driven presentation intent;
  • Originality of the research;
  • Usage of proper methodology and Language clarity.

  • Manuscript preparation instructions

    Manuscripts must be written in English. Your papers MUST be formatted to IEEE Computer Society Proceedings Manuscript Formatting Guidelines. Please click on the link below for Formatting Instructions from the IEEE Computer Society Press.

    For MS-Word users: 8.5" x 11" DOC Template
    For Latex users: LaTex Formatting Macros

    All papers should be in Adobe portable document format (PDF).

    Important Dates

    Submission date: September 09, 2016 September 24, 2016 (extended)

    Notification date: September 30, 2016

    Camera ready: October 07, 2016

    Topics of Interest

    The MuSDeMP (Multimedia Support for Decision-Making Processes) workshop intends to be multidisciplinary and we hope to inspire participation from a variety of researchers from industry and academia. Much of the workshop will concentrate on discussing the intersection between multimedia technologies with different phases of decision-making, in the following topics of interest (not limited to):

    Human-Centered Computing (HCC) in Multimedia

    Human aspects of knowledge building on multimedia. Human-centered multimedia, capturing and representing user intent and communicability models and ontologies. Novel interaction modalities for decision makers. Interpretive trails registration and representation

    Cognitive Computing Systems in Multimedia

    Communication, integration and APIs between multimedia and cognitive computing systems. Interpretive thinking. Inferring and extracting user intent. Multimedia assisting intellectual progress. Extracting and presenting highlights from decision-making processes


    Use of multi-sensorial media (mulsemedia) to improve Quality of Experience (QoE) of decision makers

    Media Synchronism and IoT

    Synchronizing media objects in time and space using exhibition devices, sensors and actuators. Location-aware feedback

    Computer Vision, Natural Language Processing, Machine Learning, and Visualization techniques

    Recognizing and Tracking multiple persons and activities. Inferring semantics from activities and content. Modeling and rendering epistemic objects in real-time to support “reasoning through doing”. Augmented and virtual reality to support decision-making processes. Attention detection – eye and head tracking. Recognition of decision makers’ expressions, gestures, voice-commands, etc. Data Visualization and representation. Multiple user processes and interpretive trails visualization

    Decision-making frameworks, models, tools, and applications in Multimedia

    The role of multimedia to support design thinking. Hypermedia languages and conceptual models to support authoring of decision-making multimedia applications. Content annotations. Methods and techniques for assessing cognitive aspects of decision-making processes


    Marcio Ferreira Moreno
    IBM Research | Brazil
    mmoreno (at)

    Rafael Brandão
    IBM Research | Brazil
    rmello (at)

    Rodrigo Laiola Guimarães
    IBM Research | Brazil
    rlaiola (at)

    Renato Cerqueira
    IBM Research | Brazil
    rcerq (at)

    Clarisse de Souza
    PUC-Rio | Brazil
    clarisse (at)

    Technical Program Committee

    Ahmed Mostafa (University of Calgary, Canada)
    Ana Fucs (IBM Research, Brazil)
    Cagatay Demiralp (IBM Research, USA)
    Carlos Soares Neto (LAWS/UFMA, Brazil)
    Carlos Ferraz (UFPE, Brazil)
    Carlos Eduardo Batista (UFPB, Brazil)
    Cesar Teixeira (UFSCAR, Brazil)
    Daniel Salles Chevitarese (IBM Research, Brazil)
    Debora Muchaluad (UFF, Brazil)
    Eduard Groller (TU, Austria)
    Eduardo Barrere (LAPIC/UFJF, Brazil)
    Emilio Brazil (IBM Research, Brazil)
    Jack Jansen (CWI, The Netherlands)
    Juliana Jansen Ferreira (IBM Research, Brazil)
    Luciano Barbosa (IBM Research, Brazil)
    Marcelo Moreno (UFJF, Brazil)
    Maria Pimentel (USP, Brazil)
    Mario Montagud (CWI, The Netherlands)
    Pablo Cesar (CWI, The Netherlands)
    Pablo Mendes (IBM Research, USA)
    Rene Kaiser (JOANNEUM RESEARCH, Austria)
    Romualdo Monteiro (LAPIC/UFJF, Brazil)
    Sergio Colcher (PUC-Rio, Brazil)
    Youssef Drissi (IBM Research, USA)