Publications

2024

• Muhammad Umair, Vasanth Sarathy, and Jan Ruiter. 2024. Large Language Models Know What To Say But Not When To Speak. In Findings of the Association for Computational Linguistics: EMNLP 2024, pages 15503–15514, Miami, Florida, USA. Association for Computational Linguistics.
• Umair M, Mertens JB, Warnke L, de Ruiter JP. Can Language Models Trained on Written Monologue Learn to Predict Spoken Dialogue? Cogn Sci. 2024 Nov;48(11):e70013. doi: 10.1111/cogs.70013. PMID: 39587969.

2023

• Warnke, L., de Ruiter, J.P. Top-down effect of dialogue coherence on perceived speaker identity

2022

• Rabb, N., Cowen, L., de Ruiter, J. P., & Scheutz, M. (2022). Cognitive cascades: How to model (and potentially counter) the spread of fake news.
• Warnke, L. & de Ruiter, J.P. (2022) Speech Act Prediction in Conversation 
• Threlkeld, C., Umair, M., & de Ruiter, J.P. (2022) Using Transition Duration to Improve Turn-taking in Conversational Agents
• Threlkeld, C. & de Ruiter, J.P. (2022) The Duration of a Turn Cannot be Used to Predict When It Ends
• Threlkeld, C. & de Ruiter, J.P. (2022) Assessing the Literal Force Hypothesis in Unconstrained Conversation
• Threlkeld, C., Warnke, L., de Ruiter, J.P. (2022). Indirect Speech Acts Do Not Change FTOs in Conversation
• Umair, M., Mertens, J. B., Albert, S., & de Ruiter, J. P. (2022). GailBot: An automatic transcription system for Conversation Analysis.

2021

• (Mertens & de Ruiter, 2021) Cognitive and social delays in the initiation of conversational repair.

2020

• De Beer, C., Hogrefe, M., Hielscher-Fastabend, M., & De Ruiter, J.P. (2020). Evaluating models of gesture and speech production for people with aphasia.

2019

•  De Ruiter, J.P. (2019). Turn-Taking. In: Cummins, C. & Katsos, N.
  (eds.), Oxford Handbook of Experimental Semantics and Pragmatics.

2018

• Albert, S. & De Ruiter, J.P. (2018). Improving Human Interaction Research through Ecological Grounding. Collabra:Psychology 4(1): 1-14

• . Using conversation analysis to improve hypothesis formation in the study of human interaction
• De_Ruiter_How_not_to_give_a_talk_geo.brief
•  Redefine or Justify? Comments on the Alpha debate.
•  Albert, S., & de Ruiter, J. P. (2018). Improving Human Interaction Research through Ecological Grounding. Collabra: Psychology, 4(1), 24. DOI: http://doi.org/10.1525/collabra.132
• Albert, S. and Ruiter, J. P. (2018), Repair: The Interface Between Interaction and Cognition. Top Cogn Sci, 10: 279-313. 
•  Language as shaped by the brain
•  Healey, P. G., De Ruiter, J. P., & Mills, G. J. (2018). Editors’ Introduction: Miscommunication. Topics in cognitive science, 10(2), 264-278.
•  Loth, S., Guliani, M., Jettka, K., Kopp, S. & De Ruiter, J.P. (2018). Confidence in uncertainty: Error cost and commitment in early speech hypotheses. PLoS One.

2017

•  De Ruiter, J.P. & De Ruiter, L.E. (2017). Don’t shoot the giant on whose shoulders we are standing. Commentary on Branigan & Pickering. Behavioral and Brain Sciences.
•  De Ruiter, J.P. & Albert, S. (2017). An Appeal for a Methodological Fusion of Conversation Analysis and Experimental Psychology. Research in Language and Social Interaction 50(1).
•  De Ruiter, J.P. (2017). The asymmetric redundancy of gesture and speech. In Church, R.B., Alibali, M.W., & Kelly, S.D. (eds). Why gesture? How the hands function in speaking, thinking and communicating John Benjamins Publishing Company, Amsterdam.

•  De Ruiter, J. P., & Albert, S. (2017). An appeal for a methodological fusion of conversation analysis and experimental psychology. Research on Language and Social Interaction, 50(1), 90-107.
•  Albert, S. & De Ruiter, J. P. (2017). Legal Harking: theoretical  grounding in interaction research. Proceedings of the 39th Annual Meeting of the Cognitive Science Society, London.
•  de Beer, C., Carragher, M., van Nispen, K., Hogrefe, K., De Ruiter, J. P., & Rose, M. L. (2017). How much information do people with aphasia convey via gesture? American Journal of Speech-Language Pathology, 26(2), 483-497.
•  De Ruiter, J. P. (2017). The asymmetric redundancy of gesture and speech. Why Gesture?: How the hands function in speaking, thinking and communicating, 7, 59.
•  Loth, S., Jettka, K., Giuliani, M., & De Ruiter, J. (2017). Unsichere, Frühe Sprachhypothesen in der Mensch-Maschine-Interaktion. In Beiträge zum 6. Interdisziplinären Workshop Kognitive Systeme.
•  Magyari, Lilla, Jan P. De Ruiter, and Stephen C. Levinson. “Temporal preparation for speaking in question-answer sequences.” Frontiers in psychology 8 (2017).
•  De Ruiter, J.P. (2017). The asymmetric redundancy of gesture and speech. In Church, R.B., Alibali, M.W., & Kelly, S.D. (eds). Why gesture? How the hands function in speaking, thinking and communicating John Benjamins Publishing Company, Amsterdam.
•  Magyari, L., De Ruiter, J.P., & Levinson, L. (2017). Temporal Preparation for Speaking in Question-Answer Sequences. Frontiers in Psychology 8.

2016

•  Loth, S., & De Ruiter, J. P. (2016). Editorial: Understanding Social Signals: How Do We Recognize the Intentions of Others. Front. Psychol. 7: 281. doi: 10.3389/fpsyg.

2015

•  Cummins, C., & De Ruiter, J. P. (2014). Computational Approaches to the Pragmatics Problem. Language and Linguistics Compass, 8(4), 133-143.
• Cummins, C., & De Ruiter, J.P. (2015). Teaching and Learning Guide for “Computational Approaches to the Pragmatics Problem“. Language and Linguistics Compass.
•  Loth, S., Jettka, K., Giuliani, M., & De Ruiter, J. P. (2015). Ghost-in-the-Machine reveals human social signals for human–robot interaction. Frontiers in Psychology, 6. http://doi.org/10.3389/fpsyg.2015.01641

2014

•  Cummins, C., & De Ruiter, J. P. (2014). Computational Approaches to the Pragmatics Problem. Language and Linguistics Compass, 8(4), 133-143.

2013

•  De Ruiter, J. P. (2013). Methodological paradigms in interaction research. In Wachsmuth, I., De Ruiter, J. P., Jaecks, P., & Kopp, S. (Eds.), Alignment in Communication: Towards a New Theory of Communication (pp. 11-32). Amsterdam: Benjamins.
•  An integrated theory of language production and comprehension
•  De Ruiter, J. P., & De Beer, C. (2013). A critical evaluation of models of gesture and speech production for understanding gesture in aphasia. Aphasiology, 27(9), 1015–1030.
•  Johannsen, K., & De Ruiter, J. P. (2013). The role of scene type and priming in the processing and selection of a spatial frame of reference. Frontiers in Psychology, 4, 182.
•  Johannsen, K., & De Ruiter, J. P. (2013). Reference frame selection in dialogue: priming or preference? Frontiers in Human Neuroscience, 7, 667.
•  Loth, S., Huth, K., & De Ruiter, J. P. (2013). Automatic detection of service initiation signals used in bars. Frontiers in Psychology, 4 (557). http://doi.org/10.3389/fpsyg.2013.00557

2012

•  Enfield, N. J., Brown, P., & De Ruiter, J. P. (2012). Epistemic dimensions of polar questions: sentence- final particles in comparative perspective. In De Ruiter, J. P. (Ed.), Questions: formal, functional, and interactional perspectives (pp. 193-221). Cambridge: Cambridge University Press.
•  Ziegler, L., Johannsen, K., Swadzba, A., De Ruiter, J. P., & Wachsmuth, S. (2012). Exploiting spatial descriptions in visual scene analysis. Cognitive Processes 13, 369-374.
•  Gaschler, A., Huth, K., Giuliani, M., Kessler, I., De Ruiter, J. P., & Knoll, A. (2012, March 5-8). Modelling State of Interaction from Head Poses for Social Human-Robot Interaction. In Proceedings of the Gaze in Human-Robot Interaction Workshop held at the 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI 2012), Boston, USA
•  Gaschler, A. Jentzsch, S., Giuliani, M., Huth, K., De Ruiter, J. P., Knoll, A. (2012, October 7-11), Social Behavior Recognition using body posture and head pose for Human-Robot Interaction (pp. 2128-2133). Proceedings of the 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Vilamoura-Algarve, Portugal.
•  De Ruiter, J. P. (2012). Questions are what they do. In De Ruiter, J. P. (Ed.), Questions: formal, functional, and interactional perspectives (pp. 1-9). Cambridge: Cambridge University Press.
•  De Ruiter, J. P., Bangerter, A., & Dings, P. (2012). The interplay between gesture and speech in the production of referring expressions: Investigating the Tradeoff Hypothesis. Topics in Cognitive Science 4, 232-248.
•  DeRuiter_2012_Geobrief_6
•  De Ruiter, J. P. (2012). How (not) to give a talk. Geo.brief 6.
•  De Ruiter, J. P., Bangerter, A., & Dings, P. (2012). The interplay between gesture and speech in the production of referring expressions: Investigating the Tradeoff Hypothesis. Topics in Cognitive Science 4, 232-248.
•  De Ruiter, J. P., & Cummins, C. (2012, September 19-21). A model of intentional communication: AIRBUS (Asymmetric Intention Recognition with Bayesian Updating of Signals). In S. Brown- Schmidt, J. Ginzburg & S. Larsson (Eds.), Proceedings of SemDial 2012 (SeineDial): The 16th Workshop on the Semantics and Pragmatics of Dialogue. Workshop Series on the Semantics and Pragmatics of Dialogue (SEMDIAL-12), Paris, France (pp. 149-150).
•  Jansen, S., Wesselmeier, H., De Ruiter, J. P., & Mueller, H. M. (2014). Using the readiness potential of button-press and verbal response within spoken language processing. Journal of Neuroscience Methods, 232, 24-29.
•  Magyari, L., & De Ruiter, J. P. (2012). Prediction of turn-ends based on anticipation of upcoming words. Frontiers in Psychology 3, 376.

2011

•  Pragmatic factors in a Bayesian model of dialogue act recognition

2010

•  De Ruiter, J. P., Noordzij, M. L., Newman-Norlund, S. E., Newman-Norlund, R. D., Hagoort, P., Levinson, S. C., & Toni, I. (2010). Exploring the cognitive infrastructure of communication. Interaction Studies, 11, 51-77.
•  Carletta, J., Nicol, C., Taylor, T., Hill, R., De Ruiter, J. P., & Bard, E. (2010). Eyetracking for two-person tasks with manipulation of a virtual world. Behavior Research Methods, 42(1), 254-265.
•  De Ruiter, J. P., Noordzij, M. L., Newman-Norlund, S. E., Newman-Norlund, R. D., Hagoort, P., Levinson, S. C., & Toni, I. (2010). Exploring the cognitive infrastructure of communication. Interaction Studies, 11, 51-77.

2008

•  De Ruiter, J. P., & Levinson, S. C. (2008). A biological infrastructure for communication underlies the cultural evolution of languages. Behavioral and Brain Sciences commentary, 31, 518.

2007

•  Chen, A., Den Os, E., & De Ruiter, J. P. (2007). Pitch accent type matters for online processing of information status: Evidence from natural and synthetic speech. The Linguistic Review, 24, 317- 344.
•  De Ruiter, J. P., & Enfield, N. (2007, July 22-27). The BIC model: a blueprint for the communicator. In Stephanidis, C. (Ed.), Proceedings of the 4th International Conference on Universal Access in Human- Computer Interaction: Universal Access in Human-Computer Interaction. Applications and Services Lecture Notes in Computer Science (pp. 251-258). Berlin: Springer.
•  On the origin of intentions
•  De Ruiter, J. P. (2007). Postcards from the mind: the relationship between speech, imagistic gesture, and thought. Gesture, 7(1), 21-38.
•  De Ruiter, J. P., Noordzij, M., Newman-Norlund, S. E., Hagoort, P., & Toni, I. (2007). On the origin of intentions. In Haggart, P. Rosetti, Y., & Kawato, M. (Eds.), Attention & Performance XXII. Sensorimotor foundation of higher cognition (pp. 593-610). Oxford: Oxford University Press.
•  De Ruiter, J. P. (2007, January 25-26). Some multimodal signals in humans. In Van der Sluis, I., Theune, M., Reiter, E., & Krahmer, E. (Eds.), Proceedings of the Workshop on Multimodal Output Generation MOG 2007 (pp. 141-148), Aberdeen, UK.
•  Enfield, N., Kita, S., & De Ruiter, J. P. (2007). Primary and secondary pragmatic functions of pointing gestures. Journal of Pragmatics, 39, 1722-1741.

2006

•  De Ruiter, J. P. (2006). Can gesticulation help aphasic people speak, or rather, communicate? Advances in Speech-Language Pathology, 8(2), 124-127.
• De Ruiter, J. P., Mitterer, H., & Enfield, N. J. (2006). Predicting the end of a speaker’s turn; a cognitive cornerstone of conversation. Language, 82(3), 515-535.

2004

•  De Ruiter, Jan Peter. 2004. Response systems and signals of recipiency. In Asifa Majid (ed.), Field Manual Volume 9, 53-55. Nijmegen: Max Planck Institute for Psycholinguistics.

•  De Ruiter, J. P. (2004, May 25). On the primacy of language in multimodal communication. In. Workshop Proceedings on Multimodal Corpora: Models of Human Behaviour for the Specification and Evaluation of Multimodal Input and Output Interfaces (pp. 38-41). Paris: ELRA – European Language Resources Association.

2003

•  De Ruiter, J. P., Rossignol, S., Vuurpijl, L., Cunningham, D., & Levelt, W. (2003). SLOT: A research platform for investigating multimodal communication. Behavior Research Methods, Instruments, & Computers, 35(3), 408-419.
•  The function of hand gesture in spoken conversation
•  De Ruiter, J. P., Rossignol, S., Vuurpijl, L., Cunningham, D., & Levelt, W. (2003). SLOT: A research platform for investigating multimodal communication. Behavior Research Methods, Instruments, & Computers, 35(3), 408-419.
•  De Ruiter, J. P. (2003). A quantitative model of Störung. In Kümmel, A., & Schüttpelz, E. (Eds.), Signale der Störung (pp. 67-81). Munich: Wilhelm Fink.

2001

•  Bente, G., Krämer, N., Petersen, N., & De Ruiter, J. P. (2001). Computer animated movement and person perception: methodological advances in nonverbal behavior research. Journal of Nonverbal Behavior, 25(3), 151-166.

•  Bente, G., Petersen, A., Krämer, N., & De Ruiter, J. P. (2001). Transcript-based computer animation of movement: Evaluating a new tool for nonverbal behavior research. Behavior Research Methods, Instruments, & Computers, 33(3), 303-310.

Projects

• AMLAP 2020 conference poster presentation: GailBot: An automated system for Jeffersonian transcription. Umair, Mertens, Albert, & de Ruiter
• GailBot: an automatic transcription system for Conversation Analysis
• Saul Albert, Laura E. De Ruiter, and J.P. De Ruiter (2015) CABNC: the Jeffersonian transcription of the Spoken British National Corpus. https://saulalbert.github.io/CABNC/.