Former residents of one facility are still haunted by their experiences and want to see it demolished