Lee Ok-sun, 88, and Kang Il-chul, 87, told reporters Tuesday that the agreement neglected the victims' feelings and was "wrong."
The December agreement included an indirect apology from Abe and Tokyo's pledge of 1 billion yen ($8 million) fund for the South Korean victims.
The two women are among tens of thousands of Asian women sexually abused in Japan's military-run brothel system during the World War II.
The Japanese government set up a fund in 1995 but that was not seen as sincere by some, especially in South Korea.
Related story
Hong Kong protesters slam leader’s apology, demand she quit
