GASTONIA -- "The lunatic in Charleston did not understand our flag!"

Those words were spoken by Bill Starnes, commander of the Major Charles Q. Petty Camp of the Sons of Confederate Veterans, as dozens gathered to hold high, wave and wear the Confederate battle flag in front of the Gaston County Courthouse on Saturday.

Across the country, people are calling for the flags to come down after 21-year-old Dylann Roof was seen photographed with the flag.

Roof is accused of killing nine people inside a Charleston, South Carolina church weeks ago

Rally organizers said they stand with the victims and they don't agree with those calling them racist.

"A stark-raving mad lunatic committed unspeakable deeds. We shouldn't be going through this right now. We should all be praying for those victims and those families. We should all be coming together in love and harmony," said Starnes. "Once we've comforted those families in every way we can, let's sit down and have a nice, cool, calm, unemotional discussion about what were the true causes of the war."

Saturday was a peaceful protest of speeches and prayer against what ralliers call a stigma around the flag and Roof's affiliation.

"Because he had a flag? Well, what about his Timberland boots or his Gold's Gym T-shirt?" asked protester Gabby Mintz.

Many at the rally said that the actions of the Charleston shooter were criminal but they also say that shouldn't cause hatred to be turned on what they call a symbol of their heritage.

"My great-great grandfather and his brother joined on the same day and they were killed on the same day in Gettysburg in wheat fields," said protester John Seagle. "I do it to honor them."

"We are being attacked from every angle, from our mayor all the way to the White House, and I'm glad to see this bunch of people out here," 91-year-old Clifford Hamm said.

While this rally may not solve the nationwide debate, those participating are urging people to know their flag celebrates history, not hate.

"I'm not prejudiced," Seagle said. "I want them to have their rights. I want me to have mine. That's the only thing I want."