The Beautiful Birds were able to level matters through Sipho Sibiya after the Vhadau Vha Damani defence was exposed on the stroke of half-time.
Joseph Mhlongo set-up Sibiya, who headed past Washington Arubi to make it 1-1 heading into the half-time break - scoring his second goal of the campaign in the process.
It took just seven minutes for the hosts to restore their lead through Rhulani Manzini, who ended his six-match goal drought.
Mogakolodi Ngele was the provider as the Botswana international s cross was headed home by Manzini to make it 2-1 to Tshakhuma.
The goal did not deter the Beautiful Birds as they launched attacks and they managed to restore parity through Vuyo Mere.
Nedbank Cup Wrap: Tshakhuma Tsha Madzivhandila and Cape Town All Stars reach quarter-finals goal.com - get the latest breaking news, showbiz & celebrity photos, sport news & rumours, viral videos and top stories from goal.com Daily Mail and Mail on Sunday newspapers.