The sun does not shine 24 hours a day. Therefore, if you want to run a power grid 24 hours a day, you need expensive batteries to hold energy collected during peak production. Fossil fuels can be burned continuously, lessening the need for energy storage
Solar is not intermittent (the sun shines every day). Making your grid reliable is expensive, thus drives costs.