Former Vice President Joe Biden said Thursday he no longer supports a controversial ban that blocked the use of federal funds for some abortions, reversing a position that put him at odds with many Democrats.

The White House hopeful told Democratic donors at an Atlanta fundraiser that anti-abortion measures adopted in Georgia and other states are a signal that Republicans are not going to “let up” on adopting aggressive abortion restrictions.

“I can’t justify leaving millions of women without access to the care they need and the ability to (access) their constitutionally protected right,” Biden said.

"If I believe health care is a right, as I do, I can no longer support an amendment that makes that right dependent on someone's zip code," he said.

Related: A day of live updates from the campaign trail 

Photos: Top Democratic presidential contenders campaign in Atlanta

Related: Which Democratic candidates have raised the most in Georgia

Map:  Georgia Presidential candidate visit tracker

The Hyde Amendment is a four-decade-old law that prevents government health programs, such as Medicaid, from using federal funds for abortions except in cases of rape, incest or to save the life of the woman.

Biden’s campaign said Wednesday he still supported the amendment, a stance that was sharply criticized by abortion rights supporters, party activists and other Democratic presidential candidates.

Some of the most biting criticism came from former Rep. Beto O'Rourke, who attended the same IWillVote fundraiser. He told CBS News that Biden was "absolutely wrong" for supporting the amendment.

Biden has often cited his Catholic religion for explaining his abortion stances, which include a 1981 vote for a constitutional amendment that would have allowed states to overturn the Supreme Court decision that legalized abortion.

But he said he was forced to shift his stance because “women’s rights and women’s health are under assault like we haven’t seen in the last 50 years.”

“Folks, times have changed,” Biden said. “I don’t think these guys are going to let up.”