Family members lit incense and laid flowers underneath the viaduct near the eastern city of Wenzhou where four train carriages fell about 30m (100ft).
Some mourners expressed dismay at the Railways Ministry's handling of the tragedy, in which 40 people died.
Officials believe a faulty signal may have caused the crash.
Six carriages derailed and four fell between 20m to 30m from the viaduct after Saturday night's crash, which injured nearly 200 people.
The crash has provoked an outpouring of anger over the conduct of the government in pushing for rapid development of high-speed train lines.
Many web users, and even some state-media outlets, have accused officials of putting economic development above the safety of the people.
Punishment promised.
On Friday, about two dozen relatives gathered at the crash site to lay flowers and incense.
Some also gathered at the mortuary where the bodies of the victims were taken.
One of the mourning relatives at the mortuary criticised the Railways Ministry over its handling of the compensation negotiations with families.
"Today, the district office told us that if we do not sign [the compensation agreement], they are going to leave," Zhang Meilan, who lost her niece, told Reuters news agency.
"They said if we want to wait, we can wait here but they would not care about us. What kind of rationale is this?"
Another relative told journalists how her husband, Chen Wei, had last spoken to her on the telephone while he was on the train, telling here he would be home in time for dinner.
"I kept calling out to him but there was no response. He just left us, a wife and son, like this," said 40-year-old Liu Canlan.
"How could this happen? How can this high-speed train be so lousy? It's just like a tiger that eats people up."
The accident came four years after the country's first high-speed trains began operating.
Chinese Premier Wen Jiabao, who visited the crash site on Thursday, vowed to "severely punish" those responsible.
Mr Wen earlier promised to take steps to improve safety on the high-speed rail network - one of the government's flagship projects.
Rail experts had warned against the rush to build the world's longest and fastest high-speed rail network in record time amid safety concerns.
Critics of the government allege that corners were cut during construction because of corruption, raising questions about infrastructure across the country.
