'So many memories': Over 500 homes feared destroyed by fire