Through the years living in Japan, I heard many non-Japanese friends complain of staring in public. One such incident inspired this, a book cover for a fictional book called Why Do Japanese People Stare At Foreigners? by fictional author Masao Suzuki (coincidentally the ex-president of department store Matsuzakaya shares the same name).
The idea is simple, print out this cover and wrap it around a suitable book. Then once you get stared at in public to the point of discomfort, take out the book and start reading with the cover facing the starer. The person is then made aware of the situation in the most Japanese of ways, through non-confrontation.