Building the science of predictive systems for AI safety

Author

Adam Shai

Published

July 16, 2024

Abstract
Computational mechanics is a framework from physics useful for talking formally about structure in stochastic processes. We will explore some initial work applying this framework to transformer neural networks, and then expand into a number of interesting extensions, following the conversation wherever it happens to go.