
37.4× backward80.7× end-to-end110× rematerialization20+ layers
O(log T) · ATLAS · Speculative Forward
Research·July 2026
Tachyon: Parallelizing Discrete Spiking Neural Networks via Associative Operators & Bounded Discretization
Spiking Neural Networks (SNNs) represent a promising frontier for high-efficiency, event-driven artificial intelligence. However, training deep spiking architectures on modern accelerator clusters has long been constrained by two fundamental computational walls: the temporal unrolling bottleneck in discrete time steps and the activation memory explosion in continuous-time event processing.
Read paper →