"We declared courts gun free zones and yesterday's [Wednesday] incident was an attempt to disrupt the justice system," Lamola said.
On Wednesday guns were drawn at the Johannesburg Magistrates Court when rival gangs from Westbury got into a fight. The rival gang members had been due in court. The fracas was captured on video.
"We can not allow gangs and criminals to disrupt the justice system. They were searched and weapons were found," said Lamola.
The minister said the challenges faced in courts could be resolved. He said the department would be engaging with the police to ensure that witnesses were safe.
"This issue was foreseen, but unfortunately there was a lapse with the gangs being brought to court at the same time."
He said that most courts were able to handle the challenges they faced but they just needed to improve on the administrative side of things.