Who actually was "Big in Japan"?

At least as far back as Spinal Tap, and with numerous songs about it (Alphaville, Tom Waits), there has long been the joke about bands that didn't make it globally, but who somehow hit the big time in Japan.

Is this joke true about any bands? Which ones? Did they eventually reach a wider audience, or did their fame stay only in Japan?