TOKYO - Japanese Prime Minister Shinzo Abe and South Korean President Moon Jae In agreed Tuesday to take a tough stance in dealing with North Korea's provocative acts, with the latter saying now is not the time to hold dialogue with Pyongyang, a Japanese government source said.