Resources
In-Place 32×32 Matrix Transpose on Tenstorrent
articleDeep dive into Tenstorrent's AI accelerators and tile-based low-level APIs.
Floating Point from Scratch: Hard Mode
articleBuilding floating point systems from the ground up for hardware architecture.
Exploring Flow-Lenia Universes with a Curiosity-driven AI Scientist
articleAutomated discovery of diverse ecosystem dynamics in self-organizing systems.
A Proof that there's No Constructive Proof of the Intermediate Value Theorem
articleAnalysis of non-constructive proofs and foundational mathematical logic.
Beyond Softmax: The Future of Attention Mechanisms
videoPosition: Categorical Deep Learning is an Algebraic Theory of All Architectures
paperA framework for studying deep learning architectures through category theory.
Universal Causal Inference in a Topos
paperFormulating causal models within the structural framework of a topos.
The First Real Application of Category Theory #SoME3
videoAn introduction to algebraic topology applications using categorical constructs.
Attention Is All You Need
paperThe seminal paper on Transformers.
Reverse Mathematics
articleDetermining which axioms are necessary to prove specific mathematical theorems.