> What counts as part of the language?

Very simple: the arbitrary set of requirements documented in the reference manual for the language and (consequently) provided in the implementation.