Does it cost more to use electricity at certain times of the day?

Generally yes.  Electricity contracts have different rates for peak and off-peak.  Peak is usually between 7am and 11pm on weekdays, while off-peak covers all other periods.  Off-peak rates are usually a third the price of peak-rates, so costs can be reduced by shifting usage to off-peak times.