Residual design and latent propagation
A visual background on residual routing, latent feedback, their training costs, and the opportunity to design them together.
6 residual designs · 4 latent mechanisms · 3 recurrent layers
Notes
Notes on machine learning, residual design, and latent propagation.
2026
My Research Plan
Residual backbones, ideas from time recurrences, and scaling laws for latent propagation, starting from the s3e42 architecture.
3 hypotheses · planned experiments
Work in progress
Drafts that are still changing.
Experiment Worklog
Eighteen Setting 3 runs in five sets, newest first: latent feedback paths, training schedules, bank width, depth controls, and the 16-layer foundations.
18 runs · 5 sets