One paper gets accepted by ICML 2024. From Self-Attention to Markov Models: Unveiling the Dynamics of Generative Transformers