If you do the drive, be aware that the mileage will cost and there will probably be a drop off fee for one way drives. I'd look into flying into Montreal for a few days, then taking the train to Toronto for another few days.

When you're in Halifax, try and find a few days to visit Cape Breton Island. The drive is gorgeous, similar to the Great Ocean Road, just no Apostles