He revisited it a little later.
Robert Musil, in his Man Without Qualities, wrote that a Soul is “That which crawls away and hides whenever someone mentions algebra.”…
I'm not sure i can articulate this very well, but i think maybe it has to with the shift to monotheism, away from creation myths that more closely resembled human interactions, towards a single divine Father who creates without the need for a maternal figure, or even procreativity. So this represents a big advance in abstract thinking - maybe for the first time creativity is symbolised as a name, an abstract concept - God said "let there be light" and there was.
Later God bestows the secondary creative power of naming onto Man, who names all the living creatures, giving order and meaning to the world that God breathed life into with the Word.
So maybe the primacy of the Word as a symbol in the biblical scriptures, rather than a shape or a number, has to do with the power of naming that came about through this historical development in abstract thought.
Does that make sense?