Maybe it was too difficult? It really is a fast and furious finale.
If I recall what was said by John Purser in his biography on Chisholm, he referred to the final as 'too clever by half' and thought it was sensible that it was dropped and that Chisholm must have approved the move.
In awaiting the aborted Hyperion recording I was hoping the 4th movement would be included as Purser's comments made the final a fascinating prospect for me. Bear in mind Purser had never heard the Violin Concerto and was basing his comments on the manuscript and his knowledge of the Concerto's (two) performance history.
Fast and furios sounds great! :D