Vanishing point: the rise of the invisible computer

In 1971, Intel, then an obscure firm in what would only later come to be known as Silicon Valley, released a chip called the 4004. It was the world’s first commercially available microprocessor, which meant it sported all the electronic circuits necessary for advanced number-crunching in a single, tiny package. It was a marvel of its time, built from 2,300 tiny transistors, each around 10,000 nanometres (or billionths of a metre) across – about the size of a red blood cell. A transistor is an electronic switch that, by flipping between “on” and “off”, provides a physical representation of the 1s and 0s that are the fundamental particles of information.

In 2015 Intel, by then the world’s leading chipmaker, with revenues of more than $55bn that year, released its Skylake chips. The firm no longer publishes exact numbers, but the best guess is that they have about 1.5bn–2 bn transistors apiece. Spaced 14 nanometres apart, each is so tiny as to be literally invisible, for they are more than an order of magnitude smaller than the wavelengths of light that humans use to see.

Everyone knows that modern computers are better than old ones. But it is hard to convey just how much better, for no other consumer technology has improved at anything approaching a similar pace. The standard analogy is with cars: if the car from 1971 had improved at the same rate as computer chips, then by 2015 new models would have had top speeds of about 420 million miles per hour. That is roughly two-thirds the speed of light, or fast enough to drive round the world in less than a fifth of a second. If that is still too slow, then before the end of 2017 models that can go twice as fast again will begin arriving in showrooms.

This blistering progress is a consequence of an observation first made in 1965 by one of Intel’s founders, Gordon Moore. Moore noted that the number of components that could be crammed onto an integrated circuit was doubling every year. Later amended to every two years, “Moore’s law” has become a self-fulfilling prophecy that sets the pace for the entire computing industry. Each year, firms such as Intel and the Taiwan Semiconductor Manufacturing Company spend billions of dollars figuring out how to keep shrinking the components that go into computer chips. Along the way, Moore’s law has helped to build a world in which chips are built in to everything from kettles to cars (which can, increasingly, drive themselves), where millions of people relax in virtual worlds, financial markets are played by algorithms and pundits worry that artificial intelligence will soon take all the jobs.

But it is also a force that is nearly spent. Shrinking a chip’s components gets harder each time you do it, and with modern transistors having features measured in mere dozens of atoms, engineers are simply running out of room. There have been roughly 22 ticks of Moore’s law since the launch of the 4004 in 1971 through to mid-2016. For the law to hold until 2050 means there will have to be 17 more, in which case those engineers would have to figure out how to build computers from components smaller than an atom of hydrogen, the smallest element there is. That, as far as anyone knows, is impossible.

Yet business will kill Moore’s law before physics does, for the benefits of shrinking transistors are not what they used to be. Moore’s law was given teeth by a related phenomenon called “Dennard scaling” (named for Robert Dennard, an IBM engineer who first formalised the idea in 1974), which states that shrinking a chip’s components makes that chip faster, less power-hungry and cheaper to produce. Chips with smaller components, in other words, are better chips, which is why the computing industry has been able to persuade consumers to shell out for the latest models every few years. But the old magic is fading.

Shrinking chips no longer makes them faster or more efficient in the way that it used to. At the same time, the rising cost of the ultra-sophisticated equipment needed to make the chips is eroding the financial gains. Moore’s second law, more light-hearted than his first, states that the cost of a “foundry”, as such factories are called, doubles every four years. A modern one leaves little change from $10bn. Even for Intel, that is a lot of money.

The result is a consensus among Silicon Valley’s experts that Moore’s law is near its end. “From an economic standpoint, Moore’s law is dead,” says Linley Gwennap, who runs a Silicon Valley analysis firm. Dario Gil, IBM’s head of research and development, is similarly frank: “I would say categorically that the future of computing cannot just be Moore’s law any more.” Bob Colwell, a former chip designer at Intel, thinks the industry may be able to get down to chips whose components are just five nanometres apart by the early 2020s – “but you’ll struggle to persuade me that they’ll get much further than that”.


One of the most powerful technological forces of the past 50 years, in other words, will soon have run its course. The assumption that computers will carry on getting better and cheaper at breakneck speed is baked into people’s ideas about the future. It underlies many technological forecasts, from self-driving cars to better artificial intelligence and ever more compelling consumer gadgetry. There are other ways of making computers better besides shrinking their components. The end of Moore’s law does not mean that the computer revolution will stall. But it does mean that the coming decades will look very different from the preceding ones, for none of the alternatives is as reliable, or as repeatable, as the great shrinkage of the past half-century.

Moore’s law has made computers smaller, transforming them from room-filling behemoths to svelte, pocket-filling slabs. It has also made them more frugal: a smartphone that packs more computing power than was available to entire nations in 1971 can last a day or more on a single battery charge. But its most famous effect has been to make computers faster. By 2050, when Moore’s law will be ancient history, engineers will have to make use of a string of other tricks if they are to keep computers getting faster.

There are some easy wins. One is better programming. The breakneck pace of Moore’s law has in the past left software firms with little time to streamline their products. The fact that their customers would be buying faster machines every few years weakened the incentive even further: the easiest way to speed up sluggish code might simply be to wait a year or two for hardware to catch up. As Moore’s law winds down, the famously short product cycles of the computing industry may start to lengthen, giving programmers more time to polish their work.

Another is to design chips that trade general mathematical prowess for more specialised hardware. Modern chips are starting to feature specialised circuits designed to speed up common tasks, such as decompressing a film, performing the complex calculations required for encryption or drawing the complicated 3D graphics used in video games. As computers spread into all sorts of other products, such specialised silicon will be very useful. Self-driving cars, for instance, will increasingly make use of machine vision, in which computers learn to interpret images from the real world, classifying objects and extracting information, which is a computationally demanding task. Specialised circuitry will provide a significant boost.

IBM reckons 3D chips could allow designers to shrink a supercomputer that now fills a building to something the size of a shoebox.
IBM reckons 3D chips could allow designers to shrink a supercomputer that now fills a building to something the size of a shoebox. Photograph: Bloomberg/Bloomberg via Getty Images

However, for computing to continue to improve at the rate to which everyone has become accustomed, something more radical will be needed. One idea is to try to keep Moore’s law going by moving it into the third dimension. Modern chips are essentially flat, but researchers are toying with chips that stack their components on top of each other. Even if the footprint of such chips stops shrinking, building up would allow their designers to keep cramming in more components, just as tower blocks can house more people in a given area than low-rise houses.

The first such devices are already coming to market: Samsung, a big South Korean microelectronics firm, sells hard drives whose memory chips are stacked in several layers. The technology holds huge promise.

Modern computers mount their memory several centimetres from their processors. At silicon speeds a centimetre is a long way, meaning significant delays whenever new data need to be fetched. A 3D chip could eliminate that bottleneck by sandwiching layers of processing logic between layers of memory. IBM reckons that 3D chips could allow designers to shrink a supercomputer that currently fills a building to something the size of a shoebox.

But making it work will require some fundamental design changes. Modern chips already run hot, requiring beefy heatsinks and fans to keep them cool. A 3D chip would be even worse, for the surface area available to remove heat would grow much more slowly than the volume that generates it. For the same reason, there are problems with getting enough electricity and data into such a chip to keep it powered and fed with numbers to crunch. IBM’s shoebox supercomputer would therefore require liquid cooling. Microscopic channels would be drilled into each chip, allowing cooling liquid to flow through. At the same time, the firm believes that the coolant can double as a power source. The idea is to use it as the electrolyte in a flow battery, in which electrolyte flows past fixed electrodes.


There are more exotic ideas, too. Quantum computing proposes to use the counterintuitive rules of quantum mechanics to build machines that can solve certain types of mathematical problem far more quickly than any conventional computer, no matter how fast or high-tech (for many other problems, though, a quantum machine would offer no advantage). Their most famous application is cracking some cryptographic codes, but their most important use may be accurately simulating the quantum subtleties of chemistry, a problem that has thousands of uses in manufacturing and industry but that conventional machines find almost completely intractable.

A decade ago, quantum computing was confined to speculative research within universities. These days several big firms – including Microsoft, IBM and Google – are pouring money into the technology all of which forecast that quantum chips should be available within the next decade or two (indeed, anyone who is interested can already play with one of IBM’s quantum chips remotely, programming it via the internet).

A Canadian firm called D-Wave already sells a limited quantum computer, which can perform just one mathematical function, though it is not yet clear whether that specific machine is really faster than a non-quantum model.

Like 3D chips, quantum computers need specialised care and feeding. For a quantum computer to work, its internals must be sealed off from the outside world. Quantum computers must be chilled with liquid helium to within a hair’s breadth of absolute zero, and protected by sophisticated shielding, for even the smallest pulse of heat or stray electromagnetic wave could ruin the delicate quantum states that such machines rely on.

Each of these prospective improvements, though, is limited: either the gains are a one-off, or they apply only to certain sorts of calculations. The great strength of Moore’s law was that it improved everything, every couple of years, with metronomic regularity. Progress in the future will be bittier, more unpredictable and more erratic. And, unlike the glory days, it is not clear how well any of this translates to consumer products. Few people would want a cryogenically cooled quantum PC or smartphone, after all. Ditto liquid cooling, which is heavy, messy and complicated. Even building specialised logic for a given task is worthwhile only if it will be regularly used.

But all three technologies will work well in data centres, where they will help to power another big trend of the next few decades. Traditionally, a computer has been a box on your desk or in your pocket. In the future the increasingly ubiquitous connectivity provided by the internet and the mobile-phone network will allow a great deal of computing power to be hidden away in data centres, with customers making use of it as and when they need it. In other words, computing will become a utility that is tapped on demand, like electricity or water today.

The ability to remove the hardware that does the computational heavy lifting from the hunk of plastic with which users actually interact – known as “cloud computing” – will be one of the most important ways for the industry to blunt the impact of the demise of Moore’s law. Unlike a smartphone or a PC, which can only grow so large, data centres can be made more powerful simply by building them bigger. As the world’s demand for computing continues to expand, an increasing proportion of it will take place in shadowy warehouses hundreds of miles from the users who are being served.

Google’s data centre in Dalles, Oregon. ‘As the world’s demand for computing continues to expand, an increasing proportion of it will take place in shadowy warehouses hundreds of miles from the users who are being served.’
Google’s data centre in Dalles, Oregon. ‘As the world’s demand for computing continues to expand, an increasing proportion of it will take place in shadowy warehouses hundreds of miles from the users who are being served.’ Photograph: Uncredited/AP

This is already beginning to happen. Take an app such as Siri, Apple’s voice-powered personal assistant. Decoding human speech and working out the intent behind an instruction such as “Siri, find me some Indian restaurants nearby” requires more computing power than an iPhone has available. Instead, the phone simply records its user’s voice and forwards the information to a beefier computer in one of Apple’s data centres. Once that remote computer has figured out an appropriate response, it sends the information back to the iPhone.

The same model can be applied to much more than just smartphones. Chips have already made their way into things not normally thought of as computers, from cars to medical implants to televisions and kettles, and the process is accelerating. Dubbed the “internet of things” (IoT), the idea is to embed computing into almost every conceivable object.

Smart clothes will use a home network to tell a washing machine what settings to use; smart paving slabs will monitor pedestrian traffic in cities and give governments forensically detailed maps of air pollution.

[Source:-The Guardian]