Where can you withdraw cash with a foreign card in Japan?
At a convenience store or a post office. Bank machines on the street often refuse foreign cards, while the machines inside 7-Eleven, Lawson, FamilyMart and Japan Post accept them, run in English and are open when the banks are not. Take out enough for the cash-only days rather than queueing again for every festival stall.
Where this answer comes from
Say it in Japanese
Show the card to the staff. The Japanese, how to read it, and the recorded voice.