It comes as the first batch of residents are scheduled to start returning home from Monday, while others will do so on other dates until early May.
Earlier, some residents expressed hope that they could go home more than once.
Deputy Chief Secretary Warner Cheuk said officials had decided on the latest arrangement after inter-departmental discussions.
He said around 6,000 people have registered to make the trips home, with less than a quarter of them elderly people.
The minister said 47 households have decided not to do so after going through pictures of their homes taken by the authorities.
In an exclusive interview with RTHK, Cheuk said 97 percent of people would make the trip during the timeslots allocated to them.
“Generally speaking, we will be able to allow residents go up and down more than once, making it more convenient for them to collect their belongings,” the minister said.
“Because there’s a need to protect other residents and their property, everyone going in and out of the buildings must be accompanied by police officers or the civil aid service.”
Cheuk said residents must not enter the homes of others nor take pictures of other units and anyone in public areas.
He said the idea is to avoid affecting the emotions of other residents.
The minister added officials are aware that some journalists have asked to tag along, but the government would try and prevent them from covering the trips because it thinks residents deserve privacy.
“Some residents have told us that they think returning home is a difficult, sad moment,” he said.
“They will get emotional, and hope that they wouldn’t be affected or disturbed, not to mention that such scenes being captured on camera would affect their privacy.”
Cheuk went on to say that fewer than 10 households said they couldn’t make the timeslots they were given, and officials would arrange for their return on a separate occassion.
