News & Events

Fall 2017 Colloquium:

Making Deep Neural Networks more Neural: Temporal Dynamics, Top-Down Feedback and Synchronous Oscillations

Dr. Garrett T. Kenyon, Los Alamos National Laboratory

Friday, November 17th, 4:00 pm, Tolentine 215

reception to follow

Abstract

Although the vast majority of synapses in the cerebral cortex convey lateral or top-down feed-back, most convolutional neural networks (CNNs), especially if trained by backpropagating a classification error, are based on feed-forward architectures.  Even recurrent CNNs (RCNNs), which utilize state-dependent feedback, are often based on a feed-forward backbone.  In a similar vein, although cortical receptive fields are richly dynamic and combine temporal with other types of information, most CNNs employ purely static representations in which temporal information is ignored.  Input to biological neural systems is also event or spike based, which preserves fine spatiotemporal correlations produced when images and objects slide across the pixel array.  Finally, whereas CNNs trained with backprop require large amounts of labeled training data, biological systems learn primarily from raw, unlabeled sensory inputs.  Here, I describe how we are investigating the hypothesis that fundamental improvements in the performance of neurally-inspired computer algorithms can be achieved by incorporating lateral and top-down feedback, spatiotemporal representations and event-driven dynamics into hierarchical neural networks, enabling the unsupervised learning of internal representations that model the deep structure of the environment in which they are embedded.

 

Previous Cognitive Science Speakers

2016-2017 Academic Year Speakers

  • Spring, 2017, Dr. Carrie Figdor, University of Iowa
  • Fall, 2016, Dr. Christian Schunn, University of Pittsburg

 

2015-2016 Academic Year Speakers

  • Spring, 2016, Dr. Susan Schneider, University of Connecticut
  • Fall, 2015, Dr. Ani Patel, Tufts University
  • Fall, 2015, Dr. Roger Remington, University of Queensland


2014-2015 Academic Year Speakers

  • Spring 2015, Dr. Art Kramer, Beckman Institute, University of Illinois

  • Fall, 2014, Dr. Brenda Rapp, Johns Hopkins University


2013-2014 Academic Year Speakers

  • Spring 2014, Dr. Brian Scassellati, Yale University

  • Fall 2013, Dr. Julio Villa-Garcia, Villanova University


2011-2012 Academic Year Speakers

  • Spring 2012, Dr. Larry Barsalou, Emory University

  • Fall 2011, Dr. Georg Theiner, Villanova University


2010-2011 Academic Year Speakers

  • Spring 2011, Dr. Russell Romeo, Michigan State University

  • Spring 2011 - Dr. Lance Kriegsfeld, University of California – Berkeley

  • Fall 2010 - Dr. Anjan Chatterjee, The University of Pennsylvania
    Dr. Brian J. Scholl
    Department of Psychology, Yale University
    http://www.yale.edu/perception/

  • Spring, 2009 - Dr. Brian Scholl, Yale University


2007-2008 Academic Year Speakers

  • Dr. Susan Goldin-Meadow, University of Chicago

     

2006-2007 Academic Year Speakers

  • February 22, 2007 - Dr. Paul Thagard, University of Waterloo Emotional Consciousness

  • December 1, 2006 - Dr. Steven Sloman, Brown University Causal Models of Reasoning and Choice