Shigeru Miyamoto felt the plumbers had reached their limits on Swap