Class

Reading

Assignments

IMPORTANT NOTE: THIS IS A BASELINE SYLLABUS - TOPICS & READINGS WILL BE ADJUSTED AS A
FUNCTION OF COURSE PARTICIPANTS

[1] September 26
Course Introduction

First day of class

[2] October 3rd
Introduction: Theories of Grounding in Conversation

• Clark, H. H. (1996). Using language. Chapters 2-4, pp. 29-121.
• Schober, M., & Brennan, S. (2003). Processes of interactive spoken discourse: The role of the partner.
• Clark, H. H., & Brennan, S. E. (1991). Grounding in communication.

Optional - Additional Readings: Computational Models of Reference

• Tetreault, J. R. (2001). A corpus-based evaluation of centering and pronoun resolution. Computational Linguistics, 27(4), 507-520.
• Chai, J. Y., Prasov, Z., Blaim, J., & Jin, R. (2005). Linguistic theories in efficient multimodal reference resolution: An empirical investigation.
• Byron, D. K., Mampilly, T., Sharma, V., & Xu, T. (2005). Utilizing visual attention for cross-modal coreference interpretation. Fifth International and Interdisciplinary Conference on Modeling and Using Context (CONTEXT-05). Paris, France.
• Gergle, D., Rosé, C. P., & Kraut, R. E. (2007). Modeling the impact of shared visual information on collaborative reference. ACM Conference on Human Factors in Computing Systems (CHI 2007) (pp. 1543-1552). NY: ACM Press.

[3] October 10
Visual, Social and Biological Factors in Grounding

• Gergle, D., Kraut, R. E., & Fussell, S. R. (2004). Language efficiency and visual technology: Minimizing collaborative effort with visual information.
• Tickle-Degnen, L., & Rosenthal, R. (1990). The nature of rapport and its nonverbal correlates.
• Cassell, J., Gill, A., & Tepper, P. (2007). Coordination in conversation and rapport.
• Horton, W. S., & Spieler, D. H. (2007). Age-related differences in communication and audience design.
• Hupet, M., Chantraine, Y., & Nef, F. (1993). References in conversation between young and old normal adults.

Class leaders: Patti Bao & Aleata Hubbard

[4] October 17
Eye-gaze, Gesture and Facial Expressions during Collaborative Dialogue

Guest presentation: David Nguyen (Berkeley) on the MultiView system

• Nguyen, D. (2007). MultiView: Improving Trust in Group Video Conferencing Through Spatial Faithfulness. Proceedings of the SIGCHI conference on Human factors in computing systems.
• Brennan, S. E. (2005). How conversation is shaped by visual and spoken evidence.
• Veinott, E. S., Olson, J. S., Olson, G. M., & Fu, X. (1999).Video helps remote work: speakers who need to negotiate common ground benefit from seeing each other. Proceedings of the SIGCHI conference on Human factors in computing systems (pp. 302-309).
• Richardson, D. C., & Dale, R. (2005). Looking to understand: The coupling between speakers' and listeners' eye movements and its relationship to discourse comprehension. Cognitive Science.
• Holler, J. & Stevens, R. (2007) The Effect of Common Ground on How Speakers Use Gesture and Speech to Represent Size Information.

Class leader: Brian Keegan

[5] October 24
Behavioral Coding Schemes and Tools for Coding and Annotation

• Carletta, J., Isard, A., Isard, S. D., Kowtko, J. C., Doherty-Sneddon, G., & Anderson, A. H. (1996). HCRC Dialogue structure coding manual. Edinburgh, Scotland: University of Edinburgh.
• Core, M. G., & Allen, J. (1997). Coding dialogs with the DAMSL annotation scheme. Working notes of the AAAI Fall Symposium on Communicative Action in Humans and Machines.

Class leaders: Lauren Scissors & Katya Otis

• Clark, H. H., & Schaefer, E. F. (1989). Contributing to discourse.
• Schiffrin (1994). Appendix 1 - Collecting Data.
• Schiffrin (1994). Appendix 2 - Transcription Conventions.
• Ochs (1979). Transcription as theory.

Class leader: Celina Troutman

[7] November 7
Conversational Protocols and Embodied Conversational Agents

• Jurafsky, D., & Martin, J. H. (2000). Dialogue and conversational agents - Chapter 24. In Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics and Speech Recognition.
• Cassell, J., Bickmore, T., Vilhjalmsson, H., & Yan, H. (2001). More than just a pretty face: Conversational protocols and the affordances of embodiment.

Class leader: Joaquin Aguilar

[8] November 14 Computational Approaches to Grounding and Dialogue

• Garrod, S. & Pickering, M. (2004). Why is Conversation so Easy?

• Pickering, M. & Garrod, S. (2006). Alignment as the Basis for Successful Communication.

• Dillenbourg, P., Traum, D. R., & Schneider, D. (1996). Grounding in multi-modal task-oriented collaboration.

• Paek, T., & Horvitz, E. (1999). Uncertainty, utility and misunderstanding: A decision-theoretic perspective on grounding in conversational systems.

• Nakano, Y. I., Reinstein, G., Stocky, T., & Cassell, J. (2003). Towards a model of face-to-face grounding.

Optional - Extra reading: Novel Approaches to Modeling Collaborative Dialogue

• Devault, D., Kariaeva, N., Kothari, A., Oved, I., & Stone, M. (2005). An information-state approach to collaborative reference.An information-state approach to collaborative reference.

• Williams, J., & Young, S. (2007). Partially observable Markov decision processes for spoken dialogue systems.

Class leaders: Chris Karr & Chi Yin Cheung

[9]November 20
Research Practicum: Collaborative eye-tracking.

** Class on Tuesday November 20. **

• Tanenhaus, M. Spivey-Knowlton, M., Eberhard, K., Sedivy, J. (1995). Integration of visual and linguistic information in spoken language comprehension. Science.

   

   

Assignment 3 Due: Eye Tracking

[10] November 28
Preliminary project presentations and discussion

[11] December 5
Final Project Resource Day

Optional Final Project Presentation Day (contact Brooke if you would like to give your final presentation this week instead of next week.)

Exam Week
December 12

Final Project Presentations & Papers Due