I can believe that they manage to get useful general code out of an AI, but I don't think that it's gonna be as simple as just training an LLM on English-code mapping. Like, part of the job is gonna be identifying edge conditions, and that can't be just derived from the English alone; or from a lot of other code. It has to have some kind of deep understanding of the subject matter on which it's working.
Might be able to find limited-domain tasks where you can use an LLM.
But I think that a general solution will require not just knowing the English task description and a lot of code. An AI has to independently know something about the problem space for which it's writing code.