Random Quadratic Form with random forcing: Metastable synchronization by noise

Anna Shalova

Abstract

We study the Random Quadratic Form (RQF) on a sphere in the presence of random Brownian forcing. We show that the forcing does not effectively change the law of the process but affects the synchronization properties of the system. While the RQF without forcing exhibits partial synchronization due to the intrinsic symmetries, the introduction of an arbitrarily small forcing results in long-term symmetry breaking and leads to full synchronization. In this work we focus on the small forcing regime and recover the multiscale behavior of the two-point process. We show that in the first stage the model converges to an anti-polar configuration due to the symmetries of the RQF and in the second stage the two clusters meet due to the symmetry breaking phenomenon. The model is motivated by continuous-time machine learning models such as Neural ODEs and continuous-time formulations of transformers. In particular, the results of this work explain the role of the bias and the scale of its initialization.

Disclosure

“mics’. I used AI at different stages of the manuscript preparation. In particular, the use of a regularized function in Lemma 3.2 and Proposition 3.8 was suggested by an AI and the code used to produce illustrations was generated by an LLM. The paper was written entirely by me and all mistakes are mine. 2 Notation and Preliminaries In this section we introduce the notation and give the necessary theoretical background on SDEs and random dynamical systems. We refer the”

PDF page 7
Classification
Proof ideas or individual proof-step assistance
Multiplier
8
Verified

Structural counts

Pages 27 pdf
Theorems 6 source
Lemmas 5 source
Propositions 7 source
Corollaries 0 source
Definitions 5 source
Displayed equations 117 source
Bibliography entries 49 source
Appendix pages 0 estimated

Count notes

  • Source counts use the expanded primary TeX file main.tex.
  • Appendix pages include the first PDF page with an explicit Appendix heading through the final page.