Selected works

  1. Exact Learning Dynamics of In-Context Learning in Linear Transformers and Its Application with L. Teixeira · arXiv We derive exact stochastic gradient dynamics for a linear transformer, which reveal staged learning and conservation laws, and then use the same measurements to study nonlinear models.
  2. Universal statistics of hippocampal place fields across species and dimensionalities with R. da Silveira and Y. Burak · Neuron Across species and environments, the statistics of hippocampal place fields are captured by threshold crossings of a Gaussian process.
  3. Statistical mechanics of deep learning with F. Behrens and others
  4. Automated Classification of Modes of Moral Reasoning in Judicial Decisions with collaborators