Try to book one night, at least, in Old Quebec (inside the walls). One full day and evening wandering up and down (literally) the old city will be an unforgettable experience.
On the drive between Quebec City and Montreal, visit Saint-Jean-Port-Joli, the center of artistic wood carving, and Montmagny, the site of the world-famous accordion museum.