If LLMs can internally do "step through the program" like a human does, they will become vastly better programmers.

Interesting that they had to make it functional and immutable because they can't mutate the past tokens.