Hermann Ackermann, Wolfram Ziegler
Audra Ames, Sara Wielandt, Dianne Cameron, Stan Kuczaj
David Ardell, Noelle Anderson, Bodo Winter
Rie Asano, Edward Ruoyang Shi
Mark Atkinson, Kenny Smith, Simon Kirby
Andreas Baumann, Christina Prömer, Kamil Kazmierski, Nikolaus Ritt
Christian Bentz
Aleksandrs Berdicevskis, Hanne Eckhoff
Richard A. Blythe, Alistair H. Jones, Jessica Renton
Cedric Boeckx, Constantina Theofanopoulou, Antonio Benítez-Burraco
Megan Broadway, Jamie Klaus, Billie Serafin, Heidi Lyn
Jon W. Carr, Kenny Smith, Hannah Cornish, Simon Kirby
Federica Cavicchio, Livnat Leemor, Simone Shamay-Tsoory, Wendy Sandler
Zanna Clay, Jahmaira Archbold, Klaus Zuberbuhler
Katie Collier, Andrew N. Radford, Balthasar Bickel, Marta B. Manser, Simon W. Townsend
Jennifer Culbertson, Simon Kirby, Marieke Schouwstra
Christine Cuskley, Vittorio Loreto
Christine Cuskley, Bernardo Monechi, Pietro Gravino, Vittorio Loreto
Dan Dediu, Scott Moisik
Sabrina Engesser, Amanda R. Ridley, Simon W. Townsend
Dankmar Enke, Roland Mühlenbernd, Igor Yanovich
Kerem Eryilmaz, Hannah Little, Bart de Boer
Nicolas Fay, Shane Rogers
Maryia Fedzechkina, Becky Chu, T. Florian Jaeger, John Trueswell
Olga Feher, Kenny Smith, Elizabeth Wonnacott, Nikolaus Ritt
Piera Filippi, Sebastian Ocklenburg, Daniel Liu Bowling, Larissa Heege, Albert Newen, Onur Güntürkün, Bart de Boer
Piera Filippi, Jenna V. Congdon, John Hoang, Daniel Liu Bowling, Stephan Reber, Andrius Pašukonis, Marisa Hoeschele, Sebastian Ocklenburg, Bart de Boer, Christopher B. Sturdy, Albert Newen, Onur GÜntÜrkÜn
Molly Flaherty, Katelyn Stangl, Susan Goldin-Meadow
Marlen Fröhlich, Paul H Kuchenbuch, Gudrun Müller, Barbara Fruth, Takeshi Furuichi, Roman M Wittig, Simone Pika
Victor Gay, Daniel Hicks, Estefania Santacreu-Vasut
Andreea Geambasu, Michelle J. Spierings, Carel ten Cate, Clara C. Levelt
Matt Hall, Russell Richie, Marie Coppola
Stefan Hartmann, Peeter Tinits, Jonas Nölle, Thomas Hartmann, Michael Pleyer
Wolfram Hinzen, Joana Rosselló
Rick Janssen, Bodo Winter, Dan Dediu, Scott Moisik, Sean Roberts
Rick Janssen, Dan Dediu, Scott Moisik
Jasmeen Kanwal, Kenny Smith, Jennifer Culbertson, Simon Kirby
Deborah Kerr, Kenny Smith
Buddhamas Kriengwatana, Paola Escudero, Anne Kerkhoven, Carel ten Cate
Adriano Lameira, Jeremy Kendal, Marco Gamba
Molly Lewis, Michael C. Frank
Casey Lister, Tiarn Burtenshaw, Nicolas Fay, Bradley Walker, Jeneva Ohan
Hannah Little, Kerem Eryılmaz, Bart de Boer
Hannah Little, Kerem Eryılmaz, Bart de Boer
Giuseppe Longobardi, Armin Buch, Andrea Ceolin, Aaron Ecay, Cristina Guardiano, Monica Irimia, Dimitris Michelioudakis, Nina Radkevich, Gerhard Jaeger
Heidi Lyn, Stephanie Jett, Megan Broadway, Mystera Samuelson
Michael Mcloughlin, Luca Lamoni, Ellen Garland, Simon Ingram, Alexis Kirke, Michael Noad, Luke Rendell, Eduardo Miranda
Adrien Meguerditchian, Damien Marie, Konstantina Margiotoudi, Scott A. Love, Alice Bertello, Romain Lacoste, Muriel Roth, Bruno Nazarian, Jean-Luc Anton, Olivier Coulon
Jérôme Michaud
Ashley Micklos
Marie Montant, Johannes Ziegler, Benny Briesemeister, Tila Brink, Bruno Wicker, Aurélie Ponz, Mireille Bonnard, Arthur Jacobs, Mario Braun
Yasamin Motamedi, Marieke Schouwstra, Kenny Smith, Simon Kirby
Roland Mühlenbernd, Johannes Wahle
Tomoya Nakai, Kazuo Okanoya
Savithry Namboodiripad, Daniel Lenzen, Ryan Lepic, Tessa Verhoef
Alan Nielsen, Dieuwke Hupkes, Simon Kirby, Kenny Smith
Bill Noble, Raquel Fernández
Irene M. Pepperberg, Katia Zilber-Izhar, Scott Smith
Lynn Perry, Marcus Perlman, Gary Lupyan, Bodo Winter, Dominic Massaro
Ljiljana Progovac
Andrea Ravignani, Tania Delgado, Simon Kirby
Terry Regier, Alexandra Carstensen, Charles Kemp
Lilia Rissman, Laura Horton, Molly Flaherty, Marie Coppola, Annie Senghas, Diane Brentari, Susan Goldin-Meadow
Gareth Roberts, Mariya Fedzechkina
Carmen Saldana, Simon Kirby, Kenny Smith
Carlos Santana
William Schueller, Pierre-Yves Oudeyer
Catriona Silvey, Christos Christodoulopoulos
Katie Slocombe, Stuart Watson, Anne Schel, Claudia Wilke, Emma Wallace, Leveda Cheng, Victoria West, Simon Townsend
Ruth Sonnweber, Andrea Ravignani
Michelle Spierings, Carel ten Cate
Kevin Stadler, Elyse Jamieson, Kenny Smith, Simon Kirby
Monica Tamariz, Joleana Shurley
Monica Tamariz, Jon W. Carr
Bill Thompson, Heikki Rasilo
Oksana Tkachman, Carla L. Hudson Kam
Simon Townsend, Andrew Russell, Sabrina Engesser
Francesca Tria, Vittorio Loreto, Vito Servedio, S. Mufwene Salikoko
Anu Vastenius, Jordan Zlatev, Joost Van de Weijer
Tessa Verhoef, Carol Padden, Simon Kirby
Slawomir Wacewicz, Przemyslaw Zywiczynski, Arkadiusz Jasinski
Bodo Winter, David Ardell
Bodo Winter, Lynn Perry, Marcus Perlman, Gary Lupyan
Marieke Woensdregt, Kenny Smith, Chris Cummins, Simon Kirby
Eva Zehentner, Andreas Baumann, Nikolaus Ritt, Christina Prömer
Keywords: Silent Gesture, Bayesian Inference, Semantics, Word Order
Short description: Word order variability influences interpretation of verbs in silent gesture. Bayesian Inference explains how.
Abstract:
Silent gesture, a lab methodology in which adult hearing participants describe simple events using only their hands, has shown to be valuable for investigating the origins of word order (the ordering of Subject, Object and Verb) in language. In particular, recent experiments using this methodlogy have uncovered word order biases in silent gesture production: people prefer SOV order when they describe extensional transitive events (boy-pail-swing; Goldin-Meadow et al., 2008), but prefer SVO order for events with different semantic properties, such as intensional events (man-think of-ball, witch-build-house; Schouwstra & de Swart, 2014). However, a core underexplored question is whether these biases also feature in silent gesture intepretation. In our presentation we describe experimental and computational analyses of silent gesture interpretation: first, we examine the influence of word order variation on silent gesture interpretation; second, we develop a Bayesian computational account of the results that allows us to directly compare production and interpretation behaviour.
In our experiment, we recorded silent gestures of ambiguous actions (e.g., a gesture that could mean build as well as climb). For each ambiguous action, we composed ambiguous gesture strings describing transitive events: one in SVO and one in SOV order (e.g., witch-climb/build-house and witch-house-climb/build). We predicted that participants would be more likely to interpret SVO ordered videos as intensional events than as extensional events, and vice versa. Forty one Dutch and forty Turkish participants watched twelve videos (6 in SVO and 6 in SOV order; we used two different versions to make sure that all participants saw each video in only one order), and were asked, after each video, tochoose an interpretation from two line drawings of the two target events (one intensional and one extensional). We found that, independently of native language, for SOV sequences, an extensional interpretation was given significantly more often (M=.711, SE=.019) than for SVO sequences (M=.569, SE=.020).
When people interpret silent gesture, they use word order as a key to the semantic distinction between intensional and extensional events: their preferences are semantically conditioned, like in silent gesture production. However, a key aspect of our findings is that this effect is much weaker in interpretation than in production. We propose a computational account for this finding, based on the idea that silent gesture interpretation can be understood as inductive inference under uncertainty. A Bayesian model allows us to specify the influence of word order biases – or prior beliefs – on judgements about the unseen intentions of another gesturer – or posterior beliefs which are updated after observing data. We specify two versions of the model: one in which participants are assumed to rely solely on their own biases during interpretation, as in production (model M1); and another which assumes participants account rationally for the uncertainty that surrounds the speaker’s usage of word order – consistent with the idea that the learner entertains emerging linguistic rules in this context (model M2). Our analysis is in two parts: first, we estimate an appropriate prior from production experiments and contrast the predictions of the two interpretation models (and their fit to the empirical data) under this prior (see figure 1); second, we fit both interpretation models to the entire dataset of productions and interpretations. Both analyses support model M2 over M1, suggesting that silent gesture interpretation is underpinned by domain-independent computational principles that balance word order biases with communicative uncertainty.
Citation:
Thompson B., Schouwstra M. and de Swart H. (2016). Interpreting Silent Gesture. In S.G. Roberts, C. Cuskley, L. McCrohon, L. Barceló-Coblijn, O. Fehér & T. Verhoef (eds.) The Evolution of Language: Proceedings of the 11th International Conference (EVOLANG11). Available online: http://evolang.org/neworleans/papers/94.html