Local large deviations for linear-region growth in random piecewise-linear networks

Recep Özkan, Christian Hirsch

Abstract

We study a random compositional model for the growth of affine regions in deep piecewise-linear networks. The model is generated by i.i.d.\ perturbations of the symmetric height-one tent map, and the main observable is the number \(N_n\) of affine pieces after \(n\) layers. We prove the existence of a submultiplicative pressure for \(N_n\), yielding exponential upper bounds for both tails of \(n^{-1}\log N_n\). The same argument applies to abstract submultiplicative complexity observables and gives higher-dimensional extensions for convex-polytopal affine-cover counts and worst-line affine-piece counts. Since the true branch count has no matching supermultiplicative inequality, lower bounds require a separate certified construction. We introduce a finite-state defect process that records branches whose future splitting can be guaranteed, and use bridge words to obtain constructive upper-tail lower bounds. In a uniformly favorable small-noise regime, this process is governed by a companion matrix whose Perron root tends to \(2\), implying eventual exclusion of lower tails below \(\log 2-ξ\).

Disclosure

“22 LARGE DEVIATIONS FOR LINEAR REGIONS Declarations Acknowledgements. The authors used OpenAI’s ChatGPT during the preparation of this man- uscript. All mathematical statements, proofs, computations, references, and conclusions were in- dependently checked and verified by the authors, who take full responsibility for the content of the manus”

PDF page 22
Classification
Brainstorming or outlining
Multiplier
2
Verified

Structural counts

Pages 23 pdf
Theorems 10 pdf fallback
Lemmas 5 pdf fallback
Propositions 5 pdf fallback
Corollaries 0 pdf fallback
Definitions 0 pdf fallback
Displayed equations 132 pdf fallback
Bibliography entries 24 pdf fallback
Appendix pages 0 estimated

Count notes

  • arXiv source was unavailable; PDF-text fallbacks were used.
  • Appendix pages include the first PDF page with an explicit Appendix heading through the final page.