Tuesday, 7th September

09h00-17h30 . Coffee breaks: 10h00-10h30; 16h00-16h30 . Lunch: 13h00-14h00

Here http://www.comp.lancs.ac.uk/~rukzio/mobilehci2010tutorials/ you can find the links to the slides and videos of the tutorial presenters.

During the tutorial day leading researchers will give an overview of the state of the art in timely topics. The intended audience includes new students starting a PhD in Mobile HCI, practitioners wanting a quick survey of the state of the art and educators wishing to get an overview of Mobile HCI for their own teaching.

Tutorials will be held on Tuesday, September 7th, 2010. The tutorial day registration includes access to all the tutorials listed below, as well as coffee/tea and lunch during the breaks. If you wish to register for the tutorials, you should register for the conference as well. Check the registration page for futher information and to register.

Tutorials Overview
(Room: Castelo IX)

09h00-10h00: 1.Mobile Games and Playful Experiences, Paul Coulton
10h30-11h30: 2.User Experience of Mobile Services, Kaisa Väänänen-Vainio-Mattila
11h30-12h30: 3.Hands-Free Interfaces: The Myths, Challenges, and Opportunities
of Speech-Based Interaction
, Cosmin Munteanu  & Gerald Penn
14h00-15h00: 4.Mobile Phone Augmented Reality, Alessandro Mulloni, Daniel Wagner
15H00-16h00: 5.Adaptation and Continuity in Multi-Device User Interfaces, Fabio Paternò
16h30-17h30: 6.Mobile Services in the Developing World, Gary Marsden

Chairs: Enrico Rukzio, University of Duisburg-Essen, Germany / Lancaster Univ., UK & Oscar Mayora, CREATE-NET, Italy

1. Mobile Games and Playful Experiences

Paul Coulton, Lancaster University, UK

Mobile gaming is still in relative infancy with the first, Snake, only appearing in 1997 and whilst early games predominantly mimicked PC and console games it has become apparent that many of these genres do not readily transfer to the mobile and more social and casually orientated experiences are required. As mobile phones are now equipped with an array of sensors such as RFID/NFC, cameras, GPS, 3-D accelerometers, magnetometers etc they offer unique possibilities for creating new gaming and playful experiences in a wider range of social contexts. However, a novel interaction modality alone is not enough to create a good gaming experience and in this tutorial we will explore not only the possibilities of these technologies through practical demonstrations and examples but also how they can be married to the underlying principles of good game design.

Paul Coulton has over 15 years’ research experience in mobile and is Senior Lecturer at Lancaster University and leads the Mobile Experiences Group of the Nokia Innovation Network which is an elite group of 20 universities around the world selected by Nokia . Paul was selected as one of 50 most talented mobile developers worldwide from a community of over 2 million to be a founding Nokia Champion in 2006 and was re-selected for this honour in 2007, 2008, 2009, and 2010. The main focus of his research surrounds innovative mobile experiences design with a particular emphasis on games and play. Paul was the first academic invited to speak at the Mobile section of the Game Developers Conference and seen as a leading innovator in the field.

2. User Experience of Mobile Services

Kaisa Väänänen-Vainio-Mattila, Tampere University of Technology, Finland

Mobile devices and services have spread to people’s everyday lives both at work and in leisure time. Still, many services fail to gain user acceptance for various reasons such as: The device-service combination may be too complex to use, the input/output modalities are not appropriate for mobile usage contexts, or the service may fail to provide pleasurable experiences to the user. This tutorial gives an overview of various issues related to user experience (UX) of mobile services. We will first define UX, and in specific, the factors of mobile service UX. Then we will go through examples of mobile services which illustrate the key issues of mobile service UX, such as mobile interaction design, context-awareness, social UX of mobile services, and cross-platform service UX. Finally, we will briefly discuss design and evaluation methods for mobile service UX. We will also point out future directions of UX of mobile services.

Kaisa Väänänen-Vainio-Mattila is a full professor of usability and user experience in Tampere University of Technology, department of Software Systems, where she’s leading the unit of Human-Centered Technology. Kaisa has approximately 20 years experience in human-centered design and user experience research, both in academia and industry. Kaisa’s industrial experience includes 10 years with Nokia Inc and research cooperation with over 20 companies. Kaisa’s research interests cover user experience and user-centered design methods in product development, with emphasis on design and evaluation of mobile communication products and services. Currently Kaisa is also a part-time visiting professor at Nokia Research Center, focusing on user experience of mobile services.

3. Hands-free Interfaces:
The Myths, Challenges, and Opportunities of Speech-based Interaction

Cosmin Munteanu, National Research Council, Canada
Gerald Penn, University of Toronto, Canada

Speech remains the "holy grail" of interaction, as this is the most natural form of communication that humans employ. Unfortunately, it is also one of the most difficult modalities to be understood by machines, mainly due to its complex nature. This is particularly prevalent for unconstrained tasks and under adverse environments - common situations when interacting with mobile devices. While the accuracies of understanding speech input are still discouraging, several interesting areas are yet to be explored that could make speech-based interaction truly hands-free. The goal of this tutorial is to inform the MobileHCI community of the current state of speech and natural language research, to dispel some of the myths surrounding speech-based interaction, as well as to provide an opportunity for researchers and practitioners to learn more about how speech recognition works, what are its limitations, and to explore how it could enhance current mobile interaction paradigms.

Cosmin Munteanu is a Research Officer with the National Research Council Canada - Institute for Information Technology, where he is part of the Voice & Multimodal and Mobile HCI labs. Cosmin leads several research projects that explore speech and natural language interaction for mobile devices and mixed reality systems. His area of expertise is at the intersection of Automatic Speech Recognition (ASR) and Human-Computer Interaction, having extensively studied the human factors of using imperfect speech recognition systems, and having designed and evaluated systems that consider humans as an important part of the ASR process. He has authored numerous publications in HCI, ASR, and Computational Linguistics.

Gerald Penn is an Associate Professor of Computer Science at the University of Toronto. His area of expertise is in the study of human languages, both from a mathematical and computational perspective. Gerald is one of the leading scholars in Computational Linguistics, with significant contributions to the formal study of natural languages. His publications cover many areas, from Theoretical Linguistics, to Mathematics, and to Automatic Speech Recognition, as well as Human-Computer Interaction.

4. Mobile Phone Augmented Reality

Alessandro Mulloni, Graz University of Technology
Daniel Wagner, Qualcomm Inc

In his talk Alessandro will present best practices in mobile phone Augmented Reality development. The following topics will be covered:

  • Enabling techniques for AR on mobile phones
  • Mobile phone platforms relevant for research
  • Mobile phone sensors for AR
  • AR application development on mobile phones
  • Potential future mobile phone hardware and how it will be relevant to AR


Alessandro Mulloni is a PhD student at the Graz University of Technology. He works at the Christian Doppler Laboratory for Handheld Augmented Reality, one of the leading laboratories in the field. During the last years he actively contributed to the fields of tracking and interaction for Augmented Reality. He is also one of the core architects of the multi-platform Studierstube ES software.

Daniel Wagner is a Principal Engineer in the Corporate Research & Development group of Qualcomm Inc. He was a senior postdoctoral researcher at Graz University of Technology. He is very well known for jump-starting the Augmented Reality research on mobile phones. During his PhD study he developed the first marker tracker and first 6DOF natural feature tracker running in real-time on PDAs and mobile phones. He was also the lead architect of the multi-platform Studierstube ES software.

5. Adaptation and Continuity in Multi-Device User Interfaces

Fabio Paternò, National Research Council, Italy

This tutorial aims to help user interface designers and developers to understand the issues involved in multi-device interactive applications, which can be accessed through both mobile and stationary devices even exploiting different interaction modalities (graphical, vocal, gesture, ...). It will provide a discussion of the possible solutions in terms of concepts, techniques, languages, and tools, with particular attention to Web environments. The tutorial will deal with the various strategies in order to adapt the user interface according to the interaction resources available, also discussing what results can be obtained through model-based approaches when multi-device interfaces are considered. It will consider how to address such issues both when authoring multi-device interfaces and when user interfaces for different devices are dynamically adapted and can even migrate seamlessly across them to follow the mobile user. Thus, it will discuss how to support task continuity across multiple devices in examples of distributed and migratory interfaces and related usability issues.

Fabio Paternò is Research Director and Head of the Laboratory on Human Interfaces in Information Systems at ISTI-CNR. His reserach work in the last decade has focused on user interfaces for ubiquitous environments, model-based design and development, tools and methods for multi-device interactive applications, migratory interfaces, mobile guides, and end-user development. In these areas he has also coordinated several international projects and the development of various tools for supporting design of multi-device interfaces or automatic adaptation, and is currently active in the EU OPEN, ServFace, and SERENOA Projects and in W3C working groups. He has published over one hundred-seventy papers in refereed international conferences or journals. He has participated in the Programme Committee of the main international HCI conferences and has recently been appointed ACM Distinguished Scientist.

6. Mobile Services in the Developing World

Gary Marsden, University of Cape Town, South Africa

This tutorial will present ways of doing mobile interaction design in the developing world. The tutorial will cover the following areas:

  • Context: An overview of the mobile landscape in the developing world, with a particular focus on Africa.
  • Methods: How to engage users, who may be illiterate and have no experience of technology, to become active participants in the design process. We look at how familiar methods need to be adapted in different contexts.
  • Guidelines and pitfalls: A look at some successful designs and how they came into being. We also reflect on how to avoid pitfalls common to many projects.

This tutorial would be ideal not only for those interested in creating mobile services and applications for the developing world, but also for those working with other non-traditional user groups or those at the margins of society.

Gary Marsden is a professor in the Computer Science Department at the University of Cape Town. His research interests are in Mobile Interaction Design and ICT for Development. He has co-authored a book, with Matt Jones titled "Mobile Interaction Design" which was published in 2006. He is currently director of the UCT ICT4D research centre and the UCT-Hasso Plattner Research School. He won the 2007 ACM SIGCHI Social Responsiveness award for his research in using mobile technology in the developing world. Despite all of this, he still cannot use all the features on his mobile phone.