One way to battle the power-wall is to move toward application-specific hardware (Accelerators).

Apple A8 Application Processor. 1/3 of the chip is dedicated to accelerators. ITRS 2015

Robobees (A project by Harvard University – “from Biology to robotics and back.”