Ordinary time merely means ordered time. It does not come with less significance. After all, Jesus did spend 30 years in what we would think of as living an ordinary life. Easter is important and so is Christmas, but if it does not change our everyday life, then we are no better off.
We live our Christian lives in ordinary life. That is where we become holy. That is where we work towards Heaven. Though difficult, our everyday life is where we work out our salvation. After all, if we are not working for holiness and Heaven, what are we working for? Every day is a step towards Heaven or towards Hell.