Nvidia explores ways of cramming many GPUs onto one package
 

As fast as modern GPUs are, there will always demand for more horsepower. Beyond gamers looking to drive multiple 4K displays with one graphics card, there are researchers and businesses with an ever-increasing thirst for greater compute acceleration. Judging from a recent research publication, Nvidia thinks it's rapidly approaching the limits of its current GPU architectural model, so it's looking for a way forward. The idea is still in the simulation stage, but the paper proposes a Multi-Chip Module GPU (MCM-GPU) that would comprise several GPU modules integrated as a single package.

http://techreport.com/news/32189/nvi...to-one-package