You are right. However, I have heard different performances of this symphony, one of them from a live broadcast, and none had more movements than this. It is true that the Violin Concerto, from the same period, is unambiguously in D Major. However, the Fourth Symphony from two years later, nominally in D minor, also uses some kind of progressive tonality: the whole beginning is tonally very ambiguous. The Third starts in E minor and ends in C flat minor, the relative not of E minor, but of E major. From what I know of his harmonic language, this kind of biased correspondence seems likely enough.
Where can I find the violin concerto you mentioned?