Boltzman Machines

Boltzmann machines are a type of stochastic recurrent neural network invented in 1983 by Geoffrey Hinton and Terry Sejnowski, and later popularized in cognitive sciences by Hinton, Sejnowski, and Yann LeCun. Inspired by their construction in statistical physics,...

First Conv Neural Networks

K. Fukushima's 1980 paper, “Neocognitron: A Self-organizing Neural Network Model for a Mechanism of Pattern Recognition Unaffected by Shift in Position,” published in Biological Cybernetics, introduces a groundbreaking neural network model designed to...

First Modern Backpropagation

In his 1976 paper “Taylor Expansion of the Accumulated Rounding Error,” S. Linnainmaa presented a novel approach for addressing rounding errors in numerical calculations through the use of Taylor series expansion. By systematically expanding the rounding...

GPT-4

The GPT-4 Technical Report by OpenAI details the development of GPT-4, a multimodal model that processes both text and image inputs to produce text outputs. GPT-4 shows human-level performance on various professional and academic benchmarks, including scoring in the...