You're right, the recent memory of the LLM is the state, that's why it needs to ...

		coliveira 8 months ago \| parent \| context \| favorite \| on: Markov chains are the original language models You're right, the recent memory of the LLM is the state, that's why it needs to be so deep to be effective compared to a traditional MC.