This book constitutes the thoroughly refereed post-proceedings of the Third International Workshop on Machine Learning for Multimodal Interaction, MLMI 2006, held in Bethesda, MD, USA, in May 2006. The papers are organized in topical sections on multimodal processing, image and video processing, HCI and applications, discourse and dialogue, speech and audio processing, and NIST meeting recognition evaluation.