PARTNER CONTENT
METI
MeetMETI

- Where our mission meets our passion -

July 11, 2024

Legendary software engineer Jim Keller on the significance of an alliance with Rapidus

Main Image

In the semiconductor industry, Jim Keller is legendary for his engineering prowess. His accomplishments are enormous. He has developed cutting-edge semiconductors for Apple, AMD, Tesla, and Intel.

Keller is today the CEO of Tenstorrent, a US start-up based in Texas. Tenstorrent develops AI-related semiconductors and has announced an alliance with Rapidus, a Japanese company established to mass-produce 2 nm-generation semiconductors.

To date, only 3 nm-generation chips have been mass-produced and only by companies in Taiwan and South Korea. No company has yet mass-produced 2 nm chips. The potentially game-changing alliance between Rapidus and Tenstorrent arose out of an approach to Keller by a Ministry of Economy, Trade and Industry (METI) official while Keller visited Japan in 2023.

▶The Jim Keller I Encountered: Hisashi Saito, Deputy Director, IT Industry Division, Commerce and Information Policy Bureau, METI

In an email interview, Keller responds to our questions and clarifies the strategy behind the alliance. He tells us why he elected to tie up with Rapidus, with its ambitious target, and discourses on the future of the semiconductor industry.

Keller's legendary status emerged from his parallel development of computers and semiconductors

Q.

You are known in Japan as a legendary engineer for your development of various innovative chips. How did you become interested in semiconductors, and why have you been so successful?

A.

I started working on semiconductors in college because my advisor at Penn State ran a small semiconductor lab, and I took all of the courses on semiconductor physics. The cool thing in the lab was we got to literally make transistors. To be able to not only study electrical engineering but to actually build electronics is great. And then when I joined a semiconductor group at Digital Equipment I was there as a computer architect, but we also co-designed the fab and the process with the architecture. And that was really interesting because we made some really interesting trade-offs. Then over the years, I've been involved with a number of projects where we're doing computer design but we're also working with process development. So it just keeps coming back that even when you build computers, we always have to keep in mind what we're building it on and that's been really interesting. And it's basically been going on for me for over 40 years.

The aim is to reduce the cost of AI and build AI into more products

Q.

Semiconductors have changed society in many ways. You are developing semiconductors for AI that have capabilities beyond GPUs. What kind of changes will your new AI chips bring to society and the market?

A.

AI is on a very steep technology curve. You can read in the news that the current high-end AI is very expensive; people are talking about it, and companies are raising hundreds of millions and billions of dollars to build it. That means that AI will be for big things and that users can only use it if they're running on somebody else's computer. Tenstorrent would like to greatly reduce the cost of AI and make AI available to many more companies to build into their own products. So we've been focused on superefficient low-cost technology choices and licensing and partnering with quite a number of companies so they can build AI into their own products, and I think that will let AI be more part of normal product development and use.

Exchange of opinions

Jim Keller (left) exchanges views with Satoshi Nohara (middle, right), the director-general of METI's Commerce and Information Policy Bureau, and others while in Japan in February 2024.

Japan remains a leader in semiconductor technology, and “the future is bright”

Q.

Japan was a leader in the global semiconductor industry until the 1980s but is no longer in that position. What are your views on Japan's current and future status in the semiconductor industry?

A.

I don't know that Japan stopped being one of the leaders of technology development. They provide equipment in all the factories. Japan is one of the world's leaders on materials used in semiconductors. Obviously, PlayStation, Nintendo, lots of the top gaming companies, gaming computers, and product development is done in Japan, and Japan has been one of the leaders in HPC computing continuously through that whole period.[*] Some of the top computer designers in the world are from Japan and went to Japanese universities, including some who work at Tenstorrent. So we think the possibilities are quite open and interesting, and one reason we've been working in Japan is because the government and the many businesses are very interested in the next big wave of innovation, and we think the future is bright.

*HPC stands for high-performance computing, which makes use of supercomputers and other highly advanced computers to process vast amounts of data at far greater speeds than possible with personal computers or servers.

Foundry partner Rapidus shares a focus on speed

Q.

What was the reason for your decision to form an alliance with Rapidus, which has no track record in this field? What specific actions do you plan to take to develop semiconductors for AI based on the 2 nm generation agreed on with Rapidus?

A.

Rapidus is interesting for a bunch of reasons. First of all, if you want to do something new, you need to work with some new players. That's really important. Second, the CEO and the team are very experienced, and they've done a lot of technology development. And third is one thing they said is that they wanted to really focus on speed-the speed of building the fab, the speed of the time to make a chip and the speed to get to 2 nm. I think that's really, really important, and when we got to meet them it was really good conversations, and we thought we could work together. One of the things I want to do is be able to build computers faster, and having a foundry partner that also believes we need to do this faster is really important.

Rapidus was established in August 2022 as a foundry to make leading-edge semiconductors for other companies. In October 2022, Rapidus received a technology transfer from IBM and funding from eight companies: Kioxia, Sony, Toyota Motor, SoftBank, Denso, NEC, NTT, and MUFG Bank. As a national project, Rapidus is also receiving as much as 920 billion yen in cumulative support from METI as of 2024. Rapidus's success in achieving mass production will help to correct the overconcentration of production sites making the world's most advanced semiconductors and is expected to bolster Japan's economic security.

Tenstorrent CEO Jim Keller

Tenstorrent CEO Jim Keller (left) and Rapidus president Atsuyoshi Koike conduct a signing ceremony for their alliance on AI semiconductor development in November 2023. In February 2024, they decided to collaborate on manufacturing as well.

The basics and internships are essential for human resources development

Q.

In Japan, the challenge is to attract talented people to the semiconductor industry. What are the important aspects of human resource development related to semiconductors? Could you give your message to the youth of Japan?

A.

A career in computer design, semiconductors and chip design-it's a long process. You need to attract talented students out of high school, to have colleges that really teach people the basics like math, physics, chemistry. There are some basics like programming and computer architecture that people need to really learn well. Then you need a good path for students to be interns at companies that are doing new and innovative things and then a place for people to go and have valuable careers. And you can't leave any piece of that out. We hire dozens of interns every year, they often return multiple times and join us when they start their careers. Being engaged at the university level through internships and partnerships is what makes that happen. To the youth of Japan, I would say I am a technology optimist. We are building computers and tools that are going to make life essentially more interesting, and there're many, many opportunities to do design going forward. Find companies and places that are doing new things with new groups of people and new arrangements. When companies become very successful, they become very set in their ways. Every generation needs to stake out some new territory and do something new, so make some new partnerships and make some new friends.

Profile

Jim Keller, the CEO of Tenstorrent, is active at the pinnacle of hardware engineering. Before joining Tenstorrent, initially as its chief technology officer, he was for two years the senior vice president of Intel's Silicon Engineering Group. Keller has also been Tesla's vice president of Autopilot and Low Voltage Hardware, the corporate vice president and chief cores architect at AMD, and the vice president of Engineering and chief architect at P.A. Semi, which was acquired by Apple. He has led multiple successful silicon designs over the decades, including the DEC Alpha processors, the AMD K7/K8/K12, the HyperTransport, the AMD Zen family, and the Apple A4/A5 processors and Telsa's self-driving car chip.

The Jim Keller I Encountered: Hisashi Saito, Deputy Director, IT industry Division, Commerce and Information Policy Bureau, METI

In June 2023, people from the world of computers gathered in Tokyo for the RISC-V Day Tokyo conference. Checking the day's program ahead of the event, I noticed the name of Jim Keller among the presenters.

Before joining METI in 2021, I spent around 10 years in the private sector as a semiconductor engineer and thus was quite familiar with Mr. Keller's career. Seeing this as a great opportunity to introduced him to what was going on in Japan and to speak with him about possible tie-ups, I asked the conference organizer to set up a venue for discussions with him.

I described for Mr. Keller Japan's semiconductor policies and what I thought to be issues going forward. What surprised me was the speed at which he made decisions and took action. During our discussions, plans were already being formulated for potential cooperation of various kinds. Talks thereafter proceeded at an astonishing pace, and then, in November 2023, the alliance with Rapidus was confirmed.

My responsibility at METI is strategies and policies for semiconductor technology development. We at METI are proceeding with a sense of urgency toward the revitalization of Japan's semiconductor industry, for the present and with a vision for the future.

TOP