Victoria's Country Fire Authority predicts the number of properties to be damaged by fire will rise to 20 with four homes already lost.