Hermann Ackermann, Wolfram Ziegler
Audra Ames, Sara Wielandt, Dianne Cameron, Stan Kuczaj
David Ardell, Noelle Anderson, Bodo Winter
Rie Asano, Edward Ruoyang Shi
Mark Atkinson, Kenny Smith, Simon Kirby
Andreas Baumann, Christina Prömer, Kamil Kazmierski, Nikolaus Ritt
Christian Bentz
Aleksandrs Berdicevskis, Hanne Eckhoff
Richard A. Blythe, Alistair H. Jones, Jessica Renton
Cedric Boeckx, Constantina Theofanopoulou, Antonio Benítez-Burraco
Megan Broadway, Jamie Klaus, Billie Serafin, Heidi Lyn
Jon W. Carr, Kenny Smith, Hannah Cornish, Simon Kirby
Federica Cavicchio, Livnat Leemor, Simone Shamay-Tsoory, Wendy Sandler
Zanna Clay, Jahmaira Archbold, Klaus Zuberbuhler
Katie Collier, Andrew N. Radford, Balthasar Bickel, Marta B. Manser, Simon W. Townsend
Jennifer Culbertson, Simon Kirby, Marieke Schouwstra
Christine Cuskley, Vittorio Loreto
Christine Cuskley, Bernardo Monechi, Pietro Gravino, Vittorio Loreto
Dan Dediu, Scott Moisik
Sabrina Engesser, Amanda R. Ridley, Simon W. Townsend
Dankmar Enke, Roland Mühlenbernd, Igor Yanovich
Kerem Eryilmaz, Hannah Little, Bart de Boer
Nicolas Fay, Shane Rogers
Maryia Fedzechkina, Becky Chu, T. Florian Jaeger, John Trueswell
Olga Feher, Kenny Smith, Elizabeth Wonnacott, Nikolaus Ritt
Piera Filippi, Sebastian Ocklenburg, Daniel Liu Bowling, Larissa Heege, Albert Newen, Onur Güntürkün, Bart de Boer
Piera Filippi, Jenna V. Congdon, John Hoang, Daniel Liu Bowling, Stephan Reber, Andrius Pašukonis, Marisa Hoeschele, Sebastian Ocklenburg, Bart de Boer, Christopher B. Sturdy, Albert Newen, Onur GÜntÜrkÜn
Molly Flaherty, Katelyn Stangl, Susan Goldin-Meadow
Marlen Fröhlich, Paul H Kuchenbuch, Gudrun Müller, Barbara Fruth, Takeshi Furuichi, Roman M Wittig, Simone Pika
Victor Gay, Daniel Hicks, Estefania Santacreu-Vasut
Andreea Geambasu, Michelle J. Spierings, Carel ten Cate, Clara C. Levelt
Matt Hall, Russell Richie, Marie Coppola
Stefan Hartmann, Peeter Tinits, Jonas Nölle, Thomas Hartmann, Michael Pleyer
Wolfram Hinzen, Joana Rosselló
Rick Janssen, Bodo Winter, Dan Dediu, Scott Moisik, Sean Roberts
Rick Janssen, Dan Dediu, Scott Moisik
Jasmeen Kanwal, Kenny Smith, Jennifer Culbertson, Simon Kirby
Deborah Kerr, Kenny Smith
Buddhamas Kriengwatana, Paola Escudero, Anne Kerkhoven, Carel ten Cate
Adriano Lameira, Jeremy Kendal, Marco Gamba
Molly Lewis, Michael C. Frank
Casey Lister, Tiarn Burtenshaw, Nicolas Fay, Bradley Walker, Jeneva Ohan
Hannah Little, Kerem Eryılmaz, Bart de Boer
Hannah Little, Kerem Eryılmaz, Bart de Boer
Giuseppe Longobardi, Armin Buch, Andrea Ceolin, Aaron Ecay, Cristina Guardiano, Monica Irimia, Dimitris Michelioudakis, Nina Radkevich, Gerhard Jaeger
Heidi Lyn, Stephanie Jett, Megan Broadway, Mystera Samuelson
Michael Mcloughlin, Luca Lamoni, Ellen Garland, Simon Ingram, Alexis Kirke, Michael Noad, Luke Rendell, Eduardo Miranda
Adrien Meguerditchian, Damien Marie, Konstantina Margiotoudi, Scott A. Love, Alice Bertello, Romain Lacoste, Muriel Roth, Bruno Nazarian, Jean-Luc Anton, Olivier Coulon
Jérôme Michaud
Ashley Micklos
Marie Montant, Johannes Ziegler, Benny Briesemeister, Tila Brink, Bruno Wicker, Aurélie Ponz, Mireille Bonnard, Arthur Jacobs, Mario Braun
Yasamin Motamedi, Marieke Schouwstra, Kenny Smith, Simon Kirby
Roland Mühlenbernd, Johannes Wahle
Tomoya Nakai, Kazuo Okanoya
Savithry Namboodiripad, Daniel Lenzen, Ryan Lepic, Tessa Verhoef
Alan Nielsen, Dieuwke Hupkes, Simon Kirby, Kenny Smith
Bill Noble, Raquel Fernández
Irene M. Pepperberg, Katia Zilber-Izhar, Scott Smith
Lynn Perry, Marcus Perlman, Gary Lupyan, Bodo Winter, Dominic Massaro
Ljiljana Progovac
Andrea Ravignani, Tania Delgado, Simon Kirby
Terry Regier, Alexandra Carstensen, Charles Kemp
Lilia Rissman, Laura Horton, Molly Flaherty, Marie Coppola, Annie Senghas, Diane Brentari, Susan Goldin-Meadow
Gareth Roberts, Mariya Fedzechkina
Carmen Saldana, Simon Kirby, Kenny Smith
Carlos Santana
William Schueller, Pierre-Yves Oudeyer
Catriona Silvey, Christos Christodoulopoulos
Katie Slocombe, Stuart Watson, Anne Schel, Claudia Wilke, Emma Wallace, Leveda Cheng, Victoria West, Simon Townsend
Ruth Sonnweber, Andrea Ravignani
Michelle Spierings, Carel ten Cate
Kevin Stadler, Elyse Jamieson, Kenny Smith, Simon Kirby
Monica Tamariz, Joleana Shurley
Monica Tamariz, Jon W. Carr
Bill Thompson, Heikki Rasilo
Oksana Tkachman, Carla L. Hudson Kam
Simon Townsend, Andrew Russell, Sabrina Engesser
Francesca Tria, Vittorio Loreto, Vito Servedio, S. Mufwene Salikoko
Anu Vastenius, Jordan Zlatev, Joost Van de Weijer
Tessa Verhoef, Carol Padden, Simon Kirby
Slawomir Wacewicz, Przemyslaw Zywiczynski, Arkadiusz Jasinski
Bodo Winter, David Ardell
Bodo Winter, Lynn Perry, Marcus Perlman, Gary Lupyan
Marieke Woensdregt, Kenny Smith, Chris Cummins, Simon Kirby
Eva Zehentner, Andreas Baumann, Nikolaus Ritt, Christina Prömer
Keywords: Deep learning, syntax, evolution of grammar
Abstract:
Researchers that assume discrete, symbolic models of syntax, tend to reject gradualist accounts in favor of a 'saltationist' view, where the crucial machinery for learning and processing syntactic structure emerges in a single step (as a side-effect of known or unknown brain principles or as a macro-mutation). A key argument for the last position is that the vast amount of work on describing the syntax of different natural languages makes use of symbolic formalisms like minimalist grammar, HPSG, categorical grammar etc., and that it is difficult to imagine process of any sort that moves gradually from a state without to a state with their key components. The most often repeated version of this argument concerns 'recursion' or 'merge', which is said to be an all or nothing phenomenon where you can't have just a little bit of it.
In my talk I will review this argument in the light of recent developments in computational linguistics where a class of models has become popular that we can call 'vector grammars', that include the Long-Short Term Memory networks, Gated Recurrent Networks and Recursive Neural Networks (e.g., Socher et al., 2010). These models have over the last two years swept to prominence in many areas of NLP and shown state of the art results on many benchmark tests including constituency parsing, dependency parsing, sentiment analysis and question classification.
Citation:
Zuidema W. (2016). Deep Learning Models Of Language Processing And The Evolution Of Syntax. In S.G. Roberts, C. Cuskley, L. McCrohon, L. Barceló-Coblijn, O. Fehér & T. Verhoef (eds.) The Evolution of Language: Proceedings of the 11th International Conference (EVOLANG11). Available online: http://evolang.org/neworleans/papers/151.html