Demonstrators opposed to the neo-Nazis are also expected to gather, but the number is uncertain.
Members of the “No Nazi Newnan” are made up of local and out-of-town activists, which includes Atlanta Antifascists.
"I cannot allow myself to stand idly by," said counterprotester Samantha Binion. "I'm hoping as many people as possible feel empowered to come and join us."
More than 400 police officers and sheriff's deputies will be in and around the park during the rally to make sure there's no trouble.
Many businesses have closed for the day out of fear that there will be clashes.
Somewhere between 50 and 100 members of the group will rally in the Greenville Street Park starting at 3 p.m. Authorities are urging residents to stay away from the area through 5 p.m.
Follow WSBTV.com for live updates throughout the day on the official WSB-TV Facebook page.