AI has pushed an explosion of latest quantity codecs—the methods through which numbers are represented digitally. Engineers are taking a look at each doable manner to save computation time and energy, together with shortening the variety of bits used to symbolize information. However what works for AI doesn’t essentially work for scientific computing, be it for computational physics, biology, fluid dynamics, or engineering simulations. IEEE Spectrum spoke with Laslo Hunhold, who not too long ago joined Barcelona-based Openchip as an AI engineer, about his efforts to develop a bespoke quantity format for scientific computing.
LASLO HUNHOLD
Laslo Hunhold is a senior AI accelerator engineer at Barcelona-based startup Openchip. He not too long ago accomplished a Ph.D. in pc science from the College of Cologne, in Germany.
What makes quantity codecs fascinating to you?
Laslo Hunhold: I don’t know one other instance of a discipline that so few are considering however has such a excessive impression. When you make a quantity format that’s 10 p.c extra [energy] environment friendly, it could possibly translate to all purposes being 10 p.c extra environment friendly, and it can save you a variety of vitality.
Why are there so many new quantity codecs?
Hunhold: For many years, pc customers had it very easy. They might simply purchase new methods each few years, and they might have efficiency advantages at no cost. However this hasn’t been the case for the final 10 years. In computer systems, you might have a sure variety of bits used to symbolize a single quantity, and for years the default was 64 bits. And for AI, firms seen that they don’t want 64 bits for every quantity. So they’d a robust incentive to go right down to 16, 8, and even 2 bits [to save energy]. The issue is, the dominating customary for representing numbers in 64 bits shouldn’t be properly designed for decrease bit counts. So within the AI discipline, they got here up with new codecs that are extra tailor-made towards AI.
Why does AI want totally different quantity codecs than scientific computing?
Hunhold: Scientific computing wants excessive dynamic vary: You want very massive numbers, or very small numbers, and really excessive accuracy in each circumstances. The 64-bit customary has an extreme dynamic vary, and it’s many extra bits than you want more often than not. It’s totally different with AI. The numbers normally observe a particular distribution, and also you don’t want as a lot accuracy.
What makes a quantity format “good”?
Hunhold: You may have infinite numbers however solely finite bit representations. So you might want to determine the way you assign numbers. Crucial half is to symbolize numbers that you just’re really going to make use of. As a result of in the event you symbolize a quantity that you just don’t use, you’ve wasted a illustration. The best factor to take a look at is the dynamic vary. The subsequent is distribution: How do you assign your bits to sure values? Do you might have a uniform distribution, or one thing else? There are infinite potentialities.
What motivated you to introduce the takum quantity format?
Hunhold: Takums are based mostly on posits. In posits, the numbers that get used extra continuously could be represented with extra density. However posits don’t work for scientific computing, and this can be a enormous situation. They’ve a excessive density for [numbers close to one], which is nice for AI, however the density falls off sharply when you take a look at bigger or smaller values. Individuals have been proposing dozens of quantity codecs in the previous few years, however takums are the one quantity format that’s really tailor-made for scientific computing. I discovered the dynamic vary of values you utilize in scientific computations, in the event you take a look at all of the fields, and designed takums such that while you take away bits, you don’t cut back that dynamic vary
This text seems within the March 2026 print situation as “Laslo Hunhold.”
From Your Website Articles
Associated Articles Across the Net
