Sometimes I feel quite dumb or oddly incurious, because I never thought about this.

Today I learned that the reason why LLMs naturally favoured em-dashes, semi colons and 3 questions is because so much training data comes from academic papers where it's considered professional to do so. Apparently academic papers are the largest group of bodies of text on the web.