Welcome to DU!
The truly grassroots left-of-center political community where regular people, not algorithms, drive the discussions and set the standards.
Join the community:
Create a free account
Support DU (and get rid of ads!):
Become a Star Member
Latest Breaking News
General Discussion
The DU Lounge
All Forums
Issue Forums
Culture Forums
Alliance Forums
Region Forums
Support Forums
Help & Search
The World's Largest Computer Chip
In the race to accelerate A.I., the Silicon Valley company Cerebras has landed on an unusual strategy: go big.Deep learning, the artificial-intelligence technology that powers voice assistants, autonomous cars, and Go champions, relies on complicated neural network software arranged in layers. A deep-learning system can live on a single computer, but the biggest ones are spread over thousands of machines wired together into clusters, which sometimes live at large data centers, like those operated by Google. In a big cluster, as many as forty-eight pizza-box-size servers slide into a rack as tall as a person; these racks stand in rows, filling buildings the size of warehouses. The neural networks in such systems can tackle daunting problems, but they also face clear challenges. A network spread across a cluster is like a brain thats been scattered around a room and wired together. Electrons move fast, but, even so, cross-chip communication is slow, and uses extravagant amounts of energy.
Eric Vishria, a general partner at Benchmark, a venture-capital firm in San Francisco, first came to understand this problem in the spring of 2016, while listening to a presentation from a new computer-chip company called Cerebras Systems. Benchmark is known for having made early investments in companies such as Twitter, Uber, and eBaythat is, in software, not hardware. The firm looks at about two hundred startup pitches a year, and invests in maybe one. Were in this kissing-a-thousand-frogs kind of game, Vishria told me. As the presentation started, he had already decided to toss the frog back. Im, like, Why did I agree to this? Were not gonna do a hardware investment, he recalled thinking. This is so dumb.
Andrew Feldman, Cerebrass co-founder, began his slide deck with a cover slide, then a team slide, catching Vishrias attention: the talent was impressive. Then Feldman compared two kinds of computer chips. First, he looked at graphics-processing units, or G.P.U.schips designed for creating 3-D images. For a variety of reasons, todays machine-learning systems depend on these graphics chips. Next, he looked at central processing units, or C.P.U.sthe general-purpose chips that do most of the work on a typical computer. Slide 3 was something along the lines of, G.P.U.s actually suck for deep learningthey just happen to be a hundred times better than C.P.U.s, Vishria recalled. And, as soon as he said it, I was, like, facepalm. Of course! Of course! Cerebras was proposing a new kind of chipone built not for graphics but for A.I. specifically.
Vishria had grown used to hearing pitches from companies that planned to use deep learning for cybersecurity, medical imaging, chatbots, and other applications. After the Cerebras presentation, he talked with engineers at some of the companies that Benchmark had helped fund, including Zillow, Uber, and Stitch Fix; they told him that they were struggling with A.I. because training the neural networks took too long. Google had begun using super-fast tensor-processing units, or T.P.U.sspecial chips it had designed for artificial intelligence. Vishria knew that a gold rush was under way, and that someone had to build the picks and shovels.
https://www.newyorker.com/tech/annals-of-technology/the-worlds-largest-computer-chip
InfoView thread info, including edit history
TrashPut this thread in your Trash Can (My DU » Trash Can)
BookmarkAdd this thread to your Bookmarks (My DU » Bookmarks)
0 replies, 1017 views
ShareGet links to this post and/or share on social media
AlertAlert this post for a rule violation
PowersThere are no powers you can use on this post
EditCannot edit other people's posts
ReplyReply to this post
EditCannot edit other people's posts
Rec (2)
ReplyReply to this post