That said we’ve had some success internally having Claude do parameter sweeps
I feel like technology is going to become alien at some point. We're all going to be using magical runes instead of chips.
When can one reasonably expect $10 10GHz oscilloscope on a chip, with some pins for video out and user input in?
At some point the economy will realize theres more LLM inference than access to scientific & technologic measurements, its an economic waste not to connect as much scientific instruments as possible to inference which already exists.
If the "dark arts" (which never really were that dark, analog designers for higher frequencies used the same Maxwell equations as the analog designers for lower frequencies, even if the implications change with frequency) end up automated by AI, the high wages will disappear, and oscilloscope mfrs won't be able to charge as much.
That would be really sad..
Though I also imagine that that is the point.
in the journal articles they did show measurements of real devices which agreed fine with predictions, but i didn't find them addressing it explicitly in the text. also, some systems they presented contained subblocks that were conventionally designed that could be carrying some of the weight.
or maybe i'm just sour that they're coming for my job? or maybe that's what they want us to think?
i think what wins in practice is simple ideas that can work in spite of all manufacturing and environment variations, and model limitations -- think stuff like feedback and symmetry. and what they show here is the opposite of that. i've done blind optimization of circuit parameters some times only to end up realizing some pretty simple such ideas that i'd missed (like "you need symmetry here" or "you just need more bandwidth here") and made complete sense when you thought about them. so i wonder if we can't tweak a few pixels in their structures and reveal something simpler.
also, obligatory mention: "genetic antennas"
Adrian Thompson's research in the 90s evolved FPGAs that did signal analysis with bizarre features:
- A tiny number of cells (far fewer than expected)
- No clock, despite performing signal analysis
- FPGA cells that were logically disconnected, but when removed caused the device to stop working
Even then their approach was taking advantage of the physics in the FPGA. One can only imagine how effective this could be when applied to circuit design with the compute budget of a frontier lab.
https://cacm.acm.org/research/analysis-of-unconventional-evo...
I feel a bit of unease when I read this title, not because of the threat of AI, but because the prevailing aphorism that "RF is black magic" is a slap in the face to the millions of physicists and RF engineers who DO understand every bit of this. It's a fun harmless anti-intellectual saw that I don't believe is harmless at all. We need more RF engineers and telling people it's all "black magic" and "wizardry" (and worst of all, saying "even RF engineers don't understand RF") makes it seem like it's not worth studying.
One of my favorite little morsels of internet goodness.
I clicked on all the links. Pretty much all of those movies could still work with wired technology. Even the one called cellular, in which a woman is trapped in an attic with a broken landline phone and manages to connect wires and dial a random number.
Yes I'm nitpicking. I guess I'm glad we have Wi-Fi and all, but don't try to sell me on it as a crucial plot device
The problem isn’t the design: its manufacturing restraints.
This is nothing new or impressive.
I like this headline. In other words, AI will suck out every last bit that makes engineering fun.
I know, I know. The job is to make money for your employer not have fun. AI makes money faster so shut up and do your job.
But fuck, I took this career because I found joy in understanding things and making things that look and work well.
Up until the present it has been a nearly uniform march of revealed symmetries, collapsed privileged frames of reference, and other such (in the deepest sense) simplifications in our model of reality that has improved its fidelity to the measurable.
I hang qualifier about these developments being simplifying because the result isn't simple in the details: quantum chromodynamics is a daunting subject! But it's not just an enumeration of details and contradictions, the particle zoo that preceded the Eightfold Way looked like line noise, now in indexed notation the Lagrangian of the entire Standard Model fits on a page (or so I've been told I've never actually seen the page).
It's almost tautological that the frontier where it's still messy involves an unrevealed symmetry or a persistent privileged frame of reference, that's what frontier means, we don't see past it to the seam where it folds up.
Personally I suspect AI systems will be a great deal more inclined to discard the parochial axioms that have every point placed human ego above simplicity.
It doesn't resolve all of the open problems in physics if you amputate consciousness, free will, agency persistent identity, and an unambiguous arrow of time.
But it starts looking possible to make progress.
Occam's Razor is a useful heuristic, but it biases us towards simpler explanations.
I think you're going too far with this. Most people understand scientific theories to be an approximation. F=ma is approximately true, in the sense that it's only accurate within the newtonian regime and each of those terms includes so many asterisks that you will only ever measure it approximately.
The latter is the jokes about the physicists "assuming a perfectly spherical cow."
In fact that's kinda the whole point of the "unreasonable effectiveness of mathematics" essay. It is unreasonable that mathematical approximations are so good at describing our world.
I think your point is more that we might be able to initially describe complex phenomena as messy, horrible complex equations, that doesn’t mean we shouldn’t work to simplify them and make them more understandable to us.
That's the layman's idea of physics theories. They are beautiful and elegant only on the surface, that's why they're technically models and approximations of the real world. The standard model renormalization techniques are a mess of patches and ad-hoc heuristics, pretty far from the "this lagrangian literally contains all physics". Generally you just _ignore_ higher order terms and just call it a day. The famous E=mc^2 it's just the first term of a Taylor expansion. The beautiful form of physics it's what you would call "good enough" and often just a pedagogical tool.
When you attempt to hyper-optimize, even with humans in the loop, you end up a mess. You're lucky if you can find clean guiding principles anywhere. If you can hyper-optimize hyper quickly, you end up with an extra layer of mess.
It's really getting annoying having to have these conversations.
> How generalizable are these methods? Can they consistently deliver truly high performance? Can we get to a place where AI produces designs that maximize every conceivable trade-off, holistically optimizing every parameter to its most ideal physical state? .... AI can hallucinate a design that creates bad circuits that don’t work. This means verification methods need to remain under human oversight.
And they are essentially correct. We need better validation and verification methods, both software and hardware to keep in check the mistakes of automated random processes.
Since you beat me to it, I'll add something that relates relates you were saying on "realizing some pretty simple... ideas".
I think a big plus of computer aided design like this is "innovization"[1]. Somewhat awkward term. But, a system like this leading one to deeper understanding of a particular process is the general idea. It's a fun feeling in practice.
Maybe it doesn't matter?
I mean, of course it matters. But most of this sort of design space is effectively NP-complete, where the creation starts with a blank schematic page and has an impossibly large search space, but where the checking of the design is much simpler.
> also, obligatory mention: "genetic antennas"
Exactly. How does this work? When confronted with the question, of course, everybody gets all excited about the constrained randomness of the GA, but if you think about it, what really makes it work is that there is a comparatively cheap test for fitness for purpose.
Yes, this is exactly what bothers me about this article and about a few similar articles published in the past, that they do not contain any evidence that their claims about the usefulness of AI in design are true.
In TFA it says that the role of AI is replacing the electromagnetic simulator in the optimization process, by guessing the behavior of the structure, which is many orders of magnitude faster than a simulation.
This sounds plausible, but in order to believe this I would want to see the differences between AI guesses and real measurements, in the case of structures with geometries that are very different from those used in the training of the AI.
Also I would want to see exactly with which simulators they have compared the speed of the AI model.
There are various simulation approaches for electromagnetic fields and electronic circuits, that can trade-off accuracy for speed, so I am not convinced that AI inference takes necessarily much less time than some faster low-accuracy methods of simulation, which would still be more accurate and more reliable than AI guesses.
AI is not a real thing or a natural kind but a perspective. Whether something qualifies as "AI" or not cannot be decided by the objective features of the thing. Ergo, it can be defined at the author's pleasure.
> conflating established and morally neutral activities in ML
LLMs are no more or less morally neutral than other ML techniques.
I think the opposite is true. It being advertised as difficult to understand is one of the reasons I personally decided to study RF Engineering. The prospect of learning something so challenging pulled me in. The Smith Chart helped.
The section with oscilloscope traces showing the progression of the “designs” over time was extremely interesting - I’d love to see what the 10x10 grid of functions looked like at each snapshot.
Thank you!
People aren't trying to communicate accurately if their first priority is getting you excited about the thing!
I seem to recall legal commentators reacting with an eyeroll—apparently judges split much finer hairs than these for a living—but it was a cute stunt.
[1] https://m.youtube.com/watch?v=sJtm0MoOgiU and https://www.the-independent.com/tech/music-copyright-algorit...
The AI in this case didn't create a novel technology- it merely used the existing technology without basing the new design on a previous one. The whole "human couldn't come up with it" is because the possible design space is so large, there's no reason a human would start where the AI did.
The thing the AI did better than humans was brute forcing a solution faster. Still a very handy thing to have, but it isn't "creating" in the sense that it invented new materials or fabrication processes or anything novel.
No. That can be said about LLMs, but not about all forms of AI. The technique used is not a LLM.
Sadly we've bastardized the term AI that, if it ever meant anything, it's meaningless now. The currently most voted thread in this post discuses the topic.
> In our new approach, the architecture begins essentially from nothing and is progressively assembled through successive iterations. The system explores the design space by generating myriad candidate circuit combinations and mapping the resulting performance trade-offs as it navigates this landscape. Because the process is not biased by prior human design choices, it can produce completely novel circuit topologies that look markedly different from those created by human designers.
I kind of thought the real success is when the designer comes up with key things that are well beyond their training or any training that could have been done up until that time. Based on their years of experience living in an environment where training is table stakes but that's not the thing that's relied upon the most in the end.
With LLMs it seems like odds are that a concept which is statistically insignificant in the training set may surface in place of a truly novel solution, effectively displacing the real breakthroughs that actually go beyond trainable performance.
In a way that decision-makers can not tell the difference, and that could be the worst part.
Is this actually true? My understanding was that E=mc^2 is exact for a particle at rest.
I think of elegance as not having to add epicycles, not that everything in the system has to be simple.
Also, without a working theory the, the space of possible solutions is near infinite. LLMs manage to pluck out the space of comprehensible English strings from n-dimensional hell. Even if this is done with a black box of billions of parameters, it’s still elegance in the sense that such a space even exists and was found
It's interesting since I saw another comment near yours that raised the question of robustness of the lab-grown design, which I thought was kind of the most fascinating part of the damninteresting article was the revelation that the evolved programs were inseparable from the single physical FPGA used in the training. Since this RFIC training model employs a simulator, do you suppose that the quirks of the physical hardware on which the simulator runs are sufficiently isolated from the training such that a pair of designs would behave similarly when the simulator was run on distinct hardware? And I guess the even more obvious question is whether a design evolved on a simulator would have any hope of behaving as expected in physical hardware?
My hunch about the latter is no, although it still seems like an interesting study, and I often find myself thinking that really understanding what was going on with the FPGAs might be a prerequisite for really understanding how to master reinforcement learning.
Anyway I'm glad you posted this and if you have any other favorites related to this domain send them my way!
The key tho is can they solve problems not easily solved before with prior techniques. Further can they identify problems not readily presented. Then identify novel solutions. Etc. The answer is emphatically yes they can. These features don’t have to literally exist in their training data, but the supporting highly convoluted network of associations of all their training data does have to in some complex space allow for it to produce these answers. It’s not the same as they’re stochastic parrots at all.
Are they creative? No, because they don’t have awareness. My personal imprecise definition of creative requires both self and awareness as well as free will. There is no driving awareness in all AI architectures, it all derives from extrinsic impetus. Creativity is derived, IMO, from a layer of our minds that is not readily assessed or measured and is only indirectly expressed through language, art, and music. Hence it is not directly trainable and therefore a learning model can’t learn it by reinforcement. It can learn the proxies, but the proxies are not, as we all deeply know, the same as our experienced awareness. We are not our words, our art, our music. We try hard to bridge it, but it’s impossible and you and I know this to be true from experience. In fact we can not even examine our own awareness because it’s not directly observable or possible for us to directly reason about. This is core to a lot of philosophy, especially mid and far eastern philosophy of the mind, the self, the five aggregates of Buddhism, etc. Psychology points at it, and modern psychology avoids it because it’s practically difficult for outcome oriented treatments.
Gaining expertise is always the hard part and our new LLM overlords are making that much harder. So the simple “pure” functions as a teaching aid have never been more important.
End users have never cared about how the sausage is made though.
Not to detract from your point at all, but I only ever heard this joke about mathematicians!
Biology is incredibly well oiled!
The real question is how much compute do you need. With LLMs getting popular, so is compute. That's the real win for non-LLM technologies. The sheer availability of GPU capacity. Yes, it's expensive, but time in a GB300 supercomputer isn't even possible if they don't exist.
Alexnet succeeded for many reasons but a big reason is that computers got good enough to apply those algorithms and techniques in practice. Outside of LLMs, what new AI/ML systems await us in the future? The LLM bubble popping, if it ever does, is going to leave us with supercomputer capacity going unused and available for cheap, meaning experiments that were once infeasibly expensive become practical. I can't afford $10 million to run a weather simulation, but at $1,000 for the same amount of compute, a lot more experimentation becomes practical.
>I thought was kind of the most fascinating part of the damninteresting article was the revelation that the evolved programs were inseparable from the single physical FPGA used in the training.
100% agree with this!!! It gave me this weird feeling the first time i read it, like the onset of some alien intelligence. xD
I definitely think a simulator is the way to go, but I'm guessing tools like that could find problems and edge cases in the simulator that nobody thought to test for.
I'm just glad they still have the article up. I bet I've shared it 50 times over the past 20 years lol.
While I have no hope for a rigorous definition (I don't think it's possible), there are two very distinct kinds of creativity:
1. Result is sufficiently novel for the system itself, i.e. it never seen it previously. This kind is too trivial to even talk about.
2. Result is novel for the side observer. This kind of creativity is meaningless because it depends on at least one unknown (side observer).
https://en.wikipedia.org/wiki/Solomonoff%27s_theory_of_induc...
The parent is talking more about elegant simplicity vs. sprawling, seemingly haphazard complexity, and you're talking more about durability to failure points and 'completeness'.
Likewise, in code, a lot of the most durable, battle tested software looks extremely inelegant and duct taped, as 90% of the code is dedicated to handling one-off patches and weird edge cases.
The computer can now literally talk to you in natural language and then perfectly produce sophisticated actions in response to completely arbitrary and unstructured input. It trivially passes the Turing test. By any definition prior to the year 2023 we are living with Artificial General Intelligence and it’s here now.
It may seem similarly vague, but it does in fact open interesting, productive, and necessary questions. A "computer" was a professional crunching numbers - "replaced", "easily" because of the deterministic procedural nature of said work, but what about the technical effort to arrive there, and what about the less "mechanical" jobs? When do "processes" become "intelligence"?
Some of us had studied AI originally to study the mind - "how do we formalize thought". It's the interdisciplinary, transversal nature of the area.
Also maybe compare that with that large and important intersection between CS and Economics - the "science of optimization" and its implementation in efficient IT systems. The effort in terms of that different discipline may not be evident, yet lots of engineering is "optimizing" and the generalization of those solutions we call Economics (see the book Algorithms to live by).
So: the term "Artificial Intelligence" may not be important as CS solutions to practical problems are built (you just focus on the better solution), but there is relevance to the "side disciplince" of AI, and from that perspective that is the cone, the scope anyway. "How would an intelligent solver approach the problem".
So, it is very hands-off, but also very expensive, and it is never clear if optimizing the fitness function is worth it, because the fitness function itself may be insufficiently or incorrectly specified.
However, I do think that people should try, even with just a whiteboard or a notebook, to design a fitness-function, for their problem, as if they were going to try to evolve it, because (1) it forces them to explicate their correctness constraints, and (2) they may discover that the program that they are trying to write _is equivalent_ to the fitness function.
I'll give you an example for point 2. Many years ago, I had to parse a gnarly language, and I chose to do it via Chomsky Grammars (that automatically build a tree based on the grammar-spec). Chomsky Grammars are cool, in that they are basically just a state-machine, but they are incredibly difficult to debug: when they work, they might work incorrectly (malformed tree), and when they fail, they give no reason for failure (because even with a trace, you are trying to figure out which backtrack should not have happened). So, out of desperation, I started to consider using genetic programming to just evolve a correct Chomsky Grammar. It became clear that there are only 2 possible fitness functions (1) a function that tests a hand-picked input against a hand-crafted tree-output (which is vulnerable to over-fitting), and (2) a function that is not (well, is much less) vulnerable to over-fitting, but is effectively a pre-existing, correct grammar that can produce those trees.
If you are in situation 2, then the genetic programming is not necessary, unless you are trying to create an optimized (or obfuscated) parser, and even then the optimization may be overfit to the test-inputs (even if they are generated test-inputs from the grammar itself). If you are in situation 1, then you are better off re-evaluating your approach (I abandoned the Chomsky Grammar notation, and invented one that is much easier to understand and debug, without losing any of the expressiveness -- it also happens to be slower, but fast-and-broken is worthless compared to not-so-fast-and-works-fine).
One place where genetic programming has been consistently awesome, is in parameter-search style problems (e.g. your genome is a long list of floats, representing weights and/or anti-weights, and you need to find out which weights give you more fitness (or less error)). I hear good things about variable-neighborhood-search, but have yet to try it.
LLMs can explain complex things to humans with tons of specific context that you don’t find in textbooks or even a google search.
It’s probably never been easier to grasp a large codebase than it is today for example. You can probe and ask specific questions without going through a maze of imports and relationships and config files yourself.
Learning things will always be up to the person, it’s still a choice and dedication to a craft can still be taught.
Remember, the interrogator is allowed to be hostile, so they would obviously employ all known prompt injections and typical LLM 'gotchas' to figure out who the AI is.
Otherwise someone could copyright every combination of words.
My point was that it’s hard to imagine citing something that could not be patented as prior art. It would be like citing a phone book as proof that a software program can’t be copyrighted (“the exact bytes appear in the 1973 Albany NY white pages, therefore it wasn’t original”)
Which is not to say let’s not do it anyway and see!
But as you point out, we used to have human calculators. So is a simple desk calculator a form of "AI"? If so, what type of software isn't AI?
When gaining mastery is not a requirement to doing novice-level work, many fewer people will get there. It takes more dedication than it did before.
I keep meeting people who think this and have enormous understanding gaps in the topics they've had an LLM teach them.
The absolute worst judge of how well someone understands a complex topic is the novice themselves.
Imagine that it's maybe the 1800's and you're asking why somebody who has already survived smallpox is not susceptible to becoming infected again. If you offered an explanation involving tiny detectives wandering around and collecting evidence which they present to each other and decide whether to multiply... one in which the tolerance comes from the detectives from the previous fight still hanging around in your lymph nodes ready to spring into action if they run across the right kind of evidence. Well that would probably be a more complicated explanation that anybody at the time would offer, and it would also be correct.
Maybe I'm just significantly and unrepresentatively unlucky, but Claude is significantly more intelligent than the average human around me on most any metric I can think of.
by any meaningful measure of intelligence. the latest models are much smarter than the bulk of the population.
how would you define intelligence?
There is no need for it to be patentable (or patented). Prior art only requires that it be described and be made publicly available. It doesn't even require the originator of the information to be identified (traditional knowledge is prior art.)
The comment was intented to be pithy, which means OBVIOUSLY, it has to generalize and be more poem than encyclopedia. A few words that express the essense of an idea. That is both useful and true even if such an essesnse OBVIOUSLY leaves contrived edge case exceptions unadressed. Congradulations on spotting that the universe is actually infinite.
If what it does is "taking care of the carry", it represents a pretty minimal requirement for intelligence - it does replace a professional that could do it, but that professional does not have to apply too much proficiency and cleverness to do its job. It is improper AI.
> what type of software isn't AI
That which would not correspond to the job of an intelligent entity. Maybe blitting bitmaps around a screen?
As I tried to convey, it is more of a matter of perspective: the area of "implementing ways to solve problems as an intelligent entity would". It is a discipline that intersects others - engineering, logic, brain science, philosophy, epistemology, maybe again economics (as "the science of optimality and efficiency" - as an intelligent solver would do)... Consider it a special discipline that spans many other realms.
That is a meaningful measure of intelligence that every LLM completely fails at.
Okay, that makes sense. Even so:
> If what it does is "taking care of the carry", it represents a pretty minimal requirement for intelligence - it does replace a professional that could do it, but that professional does not have to apply too much proficiency and cleverness to do its job. It is improper AI.
I think you're underselling how much mental work is required to solve complex arithmetic. Yes, it's simple for a computer, but (1) even basic computers are extremely complex in absolute terms, and (2) even the most complex computing tasks could be considered simple once you break them down far enough—for example, a large language model is "just" fancy matrix multiplication.
So I feel like there's a "sufficiently advanced technology is indistinguishable from magic" element here. Something becomes AI once it seems sufficiently advanced. But then time passes and it doesn't feel that advanced anymore.
I understand that human language doesn't always have a super precise definition, and I'm not trying to be pedantic. I think the term "artificial intelligence" is under-specified to the point of having virtually no meaning. To the extent that it is useful—obviously, a lot of people are using it conversation, so something is getting communicated—it's because it's possible to infer from context what someone is referring to (ie "the student used AI to write her essay" is clearly referring to an LLM, not Eliza).
We'd all be better off if we used words that describe what we're actually talking about.
Defining a procedure for arithmetic is easy. Implementing it in silicon is not. To carry on the procedure for the former has low relevance to intelligence. To carry on the job of the latter does have high relevance to intelligence. If the latter is performed by a professional it is intelligence. If it is performed by an algorithm it is artificial intelligence. "Automating finding out good ways to implement ALUs" is AI; the ALUs running are not.
So, studying AI, asking ourselves which new "devices" (abstract sense) we can find so that our algorithms have aspects of cleverness, is productive as it simply and plainly pushes, invests in the production of that class of algorithms.
Surely there is a continuity between "sort" and "genetic alg." - but the direction counts, it is in that direction that we strived to produce them producers.
So, it's very much not about the complexity of the product («sufficiently advanced technology»): it is in the complexity of the intermediate that built the final product, when that intermediate is not human. The pocket calculator is majestic, yes - but there is the strong point: it was human made. That is human intelligence at work. Study how to have it blueprinted by a machine, and if it works properly, you'll attribute a simulation of intelligence to the automated blueprinter - that is artificial intelligence.
> used words that describe what we're actually talking about
Look, people who follow me here know I place radical importance to language and to the awareness of language. It should be one of the aspects I would be most dreaded for.
Surely, most people are unaware of what they say to a large extent.
But in the case of "Artificial Intelligence", it seems you are underplaying the concept of directions - "simple algorithms" vs "advanced algorithms"; "houses" vs "skyscrapers"; "flying machines" vs "air force fighters". There is continuity and yet different position. And intelligence surely can be implemented at different levels.
Another thing (I am strongly selecting what I could reply, and I am forced to be concise). There is also a concept of "unintelligence" - the dire opposite of intelligence is also a thing (if Eliza is ~0, you can go below that). Understanding what intelligence is helps recognize its opposite, which is an experienced pitfall in the area.
Against the claim that this wouldn't be searchable, we can just observe that this is about the size of the US patent database. Does this mean patents are not searchable? In that case, aren't all patent infringements excused?
Take a moment and try to imagine your life without the wireless advances of the past three decades.
Have you lost your luggage? What a shame AirTags have not been invented. The airline representative has promised to call with updates, so settle in for a long wait by the kitchen telephone, because there are no affordable cellphones. You’ll be stuck listening to whatever is on the radio while you wait, because there are no streaming services. That’s not even to speak of all the movie plots that would have been ruined.
This is just a tiny sliver of how wireless technology makes itself felt in your day-to-day existence. The effects it has had on supply chains, infrastructure, and how the economy runs have been world-altering.
None of it would be possible without the radio-frequency integrated circuits that allow all our devices to unobtrusively send and receive information.
Now imagine what the further evolution of this technology will bring: Wide-spread autonomous vehicles, quantum communications, 6G mobile service and satellite communications. Continued momentum will depend on newer and more advanced versions of today’s RF chips.
But there’s the rub. Whereas the design of most of the world’s computing chips has been standardized into its own science, RF design has remained stubbornly in the realm of art. A dark art, even, that is mastered only through years of experience. As any sorcerer will tell you, the dark arts keep their own schedule. And that schedule is impeding progress not just in RF chip design but in every other technology that depends on it.
About seven years ago, in the wake of AlphaGo’s victory over world Go champion Lee Sedol, my students at Princeton and I began to wonder: Could AI be taught this art as well? Recent successes suggest that, to a large extent, it can. Over the last few years, our group and other leaders in the field have started to develop machine-learning-driven algorithmic methods for designing RFICs. Some of the resulting chips look more like modern art than circuit layouts. Yet in many cases, the physical prototypes bested state-of-the art circuits in terms of performance. The real achievement, however, is that it took the AI orders of magnitude less time to conceive a working design than it would a human designer.
This is not about one or two RF chips. AI-enabled design could be the future of all RF design, and maybe much more.
So why do these chips all have to be crafted by hand? Why aren’t RFICs designed with an algorithmic synthesis process, much as CPUs and GPUs are?
The design of RFICs is an exercise in engineering across multiple physical domains. Maxwell’s equations, operating across different spatial and temporal scales, govern how electromagnetic fields interact with active and passive devices that must be carefully codesigned for the chip to function. Alongside these are the laws of thermodynamics, which determine how heat is generated and removed during operation, as well as the mechanics of thermal expansion and contraction that dictate how reliably the chip and its packaging survive temperature changes.
Simultaneously accounting for all the physical constraints these impose makes the design space almost impossibly large. Every decision involves complex priorities that often compete with one another, preventing the optimization of any of them.
To better understand the issue, let’s walk through the steps involved, after which you’ll better understand why a single new chip design takes years and tens to hundreds of millions of dollars.





Most of the area of radio-frequency integrated circuits is dominated by complex electromagnetic structures. Human-designed RFICs, like this broadband power amplifier [1], start with templates and follow a symmetric, understandable pattern. But freed from the constraints of human-designed templates and the need for humans to even understand the rationale of electromagnetic structures, power amplifier ICs [2–5] and low-noise amplifiers [6] can take on truly wild-looking yet efficient designs. SENGUPTA LAB
Let’s say you’re an engineer assigned to design a new 28-gigahertz power amplifier for a 5G-millimeter-wave handset. (This is the type of RFIC that boosts the 5G signals on your phone and transmits them to the antenna where they can be picked up by a distant base station). Where do you start?
RFIC design has some features in common with house building. Just as the blueprint for a house dictates the number of bedrooms and bathrooms to be built and the hallways connecting them, the blueprint for an RFIC—called the architecture—establishes the kinds of elements the RFIC needs to fulfill its intended function. Instead of rooms, the architecture includes, for example, the number of stages of amplification your power amplifier needs. Instead of hallways, it shows the paths that signals must take to get through those stages.
The blueprint for RFICs is actually mostly hallway**;** passive elements, like inductors and transmission lines, take up far more real estate than active elements like transistors.
Here’s why. As you have probably experienced yourself, a typical CPU’s transistors overheat when faced with operating frequencies of just a few gigahertz. The frequencies RFICs can operate at are higher by an order of magnitude—28 and 39 GHz for 5G signals, 26.5 to 40 GHz and even higher for satellite communications, and 77 GHz for automotive radar. Under this onslaught, a CPU’s transistors would fail.
RFIC transistors avoid this fate because these chips cleverly manage the signal’s energy with careful electromagnetic design. This takes the form of byzantine networks of metal elements that dominate the chip’s real estate. These structures are geometrically regular, often symmetrical, and so intricately constructed they sometimes resemble lacelike filigree. But while they may look decorative, they are essential to the chip’s functioning.
Electrically speaking, these “hallways” work more like the chip’s plumbing**.** Like plumbing, this extensive labyrinth of passives confines electromagnetic energy only to the places it should be traveling around the chip.
The major challenge in RFIC design is putting all these elements together to ensure they work, just as constructing a house from its blueprints demands exact specs for load-bearing beams, pipes, and external walls. On an RFIC, the architecture needs to be realized with physically fabricable transistors and passive components that are connected just so, to permit the signal to travel through the chip and be processed. The way these devices are connected locally is what we call the circuit’s topology.
To make that power amplifier, then, your first step is to identify a candidate circuit template: The combination of structures that will meet the goals of a particular architecture with a specific circuit topology. Over the years, researchers have eased your burden by developing reusable design templates for specific functions. For example, templates suggest how many amplification stages a circuit needs (because sometimes, combining the output of two smaller amplifiers will result in better bandwidth and efficiency than you would get from a single larger one). And they suggest what the general configuration of the passive structures should be. Today there is an extensive library of such templates.
However, these can’t simply be used off-the-shelf, because each comes with trade-offs. Some have better gain at the expense of stability; some better bandwidth at the expense of efficiency; still others are more energy efficient at the expense of output power, and so on. There is rarely a clear best choice.
To arrive at the “sweet spot” where all these different parameters are balanced into optimal harmony, designers will typically lay out several different versions of the circuit, using intuitions and methods they have picked up in their years of training.
The challenge is that the decision around the architecture, circuit topology, or the electromagnetic passives cannot be done separately. One decision influences the others. So, designing an RF circuit can often feel like trying to fit an oversized carpet into too small a room—press down one corner, and another pops up.
At microwave and millimeter-wave frequencies, even the smallest misstep is the difference between a chip that works and one that doesn’t, and any number of things can go wrong. For example, when an electromagnetic wave encounters a transistor—or any other component —the path it travels must be properly “matched” to what comes next. If it isn’t, some of the energy reflects backward instead of flowing forward. Imagine trying to connect a high-pressure fire hose directly to a narrow garden hose. Without the right adapter, water will splash backward at the junction. Very little will make it through. In electronics, this is called the impedance-matching problem.
To prevent those reflections, engineers design special transitions, essentially microscopic adapters, that smooth the handoff between components. On a chip, these adapters can be surprisingly intricate. They don’t just pass the signal along; they can also split it, combine it, or distribute it across multiple paths with carefully controlled timing and strength.
Once you’ve done the architecture, plumbing, and everything in between comes the moment of truth. Have all the choices you have navigated through the enormous design space resulted in an RFIC that meets its specifications? If the specifications are not met, you will have to go back, either redoing the topology or the entire architecture, and repeat the whole process. So get ready for months of time- and resource-heavy simulation and iteration. Perhaps you now see why, for decades, a core belief has persisted in the RFIC community: “RF design is an art.” It was said that only an experienced designer—with an artisanal understanding of how the pieces make up the whole—could master the subtleties of analog and RF design. Unfortunately, this entrenched notion has long held back algorithmic innovations in the field just when we need them most. Traditional, artisanal RFIC design is hitting its limits as the complexity of these systems inexorably grows.
While RFIC designers continued their battle against their “oversized carpet” problem, a series of interesting developments emerged in allied disciplines. Across a range of other previously intractable problems like protein folding and climate modeling, AI has been able to successfully navigate multidimensional complex spaces. This gave us the incentive to look deeper into AI for RF. After all, the combinatorial complexity of protein folding is not that different from the nature of the design space in our domain.
We were not the first to think of using artificial intelligence to speed up parts of RFIC design. Researchers had previously trained machine learning algorithms on circuit templates in the hope of speeding up the normal optimization processes. While this approach was undoubtedly faster than humans at optimizing templates, it still relied fundamentally on libraries of existing designs invented by humans.
We didn’t want that. We wanted to break free from the restrictions of prefabricated topologies. Because while a designer’s experience and hard-won heuristics are crucial to building a working design, they also place fundamental limits on it. Furthermore, such an approach would necessarily require simulation steps as part of the optimization cycle, and even the fastest simulations use a lot of computing resources. Worse still, in many advanced cases, such as for broadband designs, there are no existing templates.
But if we didn’t start with templates, where could we start?
The goal here was to allow algorithms to determine—entirely from scratch—every parameter for architecture, constituent circuits, and electromagnetic passives. This approach differs fundamentally from conventional optimization, which is limited to determining the parameters—like transistor dimensions and passive component geometries—that optimize structures originally devised by humans.
In our new approach, the architecture begins essentially from nothing and is progressively assembled through successive iterations. The system explores the design space by generating myriad candidate circuit combinations and mapping the resulting performance trade-offs as it navigates this landscape. Because the process is not biased by prior human design choices, it can produce completely novel circuit topologies that look markedly different from those created by human designers.
In some ways, the approach echoes AI systems such as AlphaGo Zero, which achieved superhuman performance not because it was trained on games played by humans but because it explored the rules by playing against itself. Similarly, our algorithm develops new circuit architectures by exploring and evaluating its own design strategies. In so doing, it learns to understand circuits, electromagnetics, and the close codesign they need to achieve the end-to-end design of RFIC.
To realize this capability, we proceeded in two stages. First, we developed a reinforcement-learning (RL) framework that determines the optimal system architecture, circuit topology, device parameters, and even the properties of the electromagnetic interfaces that connect different circuit elements. In this stage, the algorithm effectively defines how signals should propagate and interact across the system.
The algorithm trains very similarly to how a computer learns to play a game. If you let it play enough times, it can learn to play better by observing the relationship between the actions it took and the score it achieves. In a similar way, the RL agent here learns to design effective circuits by playing with a set of combinations, and over time, it can map the space between the circuit performance to its architecture, topology, and parameters. This training takes a few days to a week, but once trained, the agent can design circuits very quickly
The next step was to determine the physical structure of the IC’s electromagnetics—the plumbing—that can create the desired properties of the passive elements, which are characterized by a set of metrics called scattering parameters. These measure if a signal entering a component actually moves forward—or is reflecting backward, being wasted, as in our previous example with the fire hose and the garden hose.
Deriving the structure from the desired scattering parameters is an example of an approach called inverse design, which appears across many areas of engineering. In structural engineering, for example, one might collaborate with an architect on a physical goal—such as creating large interior spaces with high ceilings—and then determine the arrangement of arches or buttresses that can support it.
In an effort to make AI-designed circuits more understandable, engineers took a page from image-generation AIs that allow users to create pictures in the style of different artists. Here, instead of an artist\u2019s style, the user can dial in the spatial frequency of an electromagnetic structure. Regardless of how pixelated the structure is, it will still reproduce the needed electromagnetic characteristics, or S-parameters.Chris Philpot
But RF integrated crcuits pose a particular challenge for inverse design: The process must account simultaneously for circuit behavior and the electromagnetic responses of the interconnects and passive elements that link them together. But it has to figure that out without doing a lot of artisanal iterating.
So we replaced our RF circuit simulator with an AI-based emulator. This AI model can predict the behavior of electromagnetic fields going through any structure—even totally arbitrary two-dimensional shapes—without having to compute the underlying physics from scratch, as simulation tools do. It would predict the solution of Maxwell’s equations and tell you the scattering parameters for any structure you showed it, without actually doing the math. With such an AI in hand, what a time-consuming electromagnetic solver normally takes minutes or hours to accomplish is reduced to milliseconds.
We chose to build our emulator around a convolutional neural network—a machine learning model that has been remarkably successful for image processing. Such networks can extract spatial features from any structure, and it turns out that the image of a structure contains a lot of spatial information that can accurately predict its electromagnetic performance. Then we trained it on a vast number of random pixelated structures whose scattering parameters had been labeled.
Once we had our inverse-design RL and suitable AI emulator, we essentially had an end-to-end AI designer. So we asked it to design us a power amplifier.
In 2023, we published this proof of concept—a power amplifier targeting the millimeter-wave band, specifically spanning 30 to 100 GHz, which covers most of the relevant 5G and radar frequencies. The final design achieved the best combination of wide bandwidth, output power, and efficiency then reported for a silicon-based power amplifier—meaning it could amplify a large amount of data across a wide swath of frequencies—while maintaining record efficiency.
The structure of the IC’s electromagnetic pathways was unlike anything any human would ever consider. Since the AI is not trained on human designs, the layout that emerged looked more like an arbitrary pattern or perhaps a QR code than the regular symmetrical structures we are used to seeing.
One unexpected insight revealed by this prototype, and our research generally, is that there’s no evidence that the templates we’ve historically relied on are even close to optimal for modern design goals. It’s not that a human designer can never come up with a better design. But with the removal of the templates and the time to synthesize cycle upon cycle of optimized circuits, it is now clear that AI-driven synthesis could break traditional design barriers and push the limits of RFIC capabilities.
Our 5G amplifier had only one input port and one output port. Adding more inputs and outputs to a design is not straightforward. Every port electromagnetically couples to every other port, so the scattering parameters quickly add up. Two ports give you four scattering parameters. Four ports, 16 scattering parameters. The math gets ugly fast. Could our model keep up?
We next trained our model on larger classes of electromagnetic structures with many input and output ports. In 2024, we published work showing that multiport integrated circuits are no problem for these AI algorithms either. Where previously multiport electromagnetic simulation required days or weeks of toil, this model evolved new structures in minutes. Since then, a plethora of work in the space by research communities across the globe have demonstrated the power of inverse design in RFIC.
Combining the reinforcement learning framework with the inverse design, we now had the ability to create an RFIC from specifications all the way to a fabrication-ready layout. We’ve so far shown this is true for RFICs ranging from low-noise amplifiers to subterahertz and broadband power amplifiers. The hope is that this will work just as well for other circuits.
Our goal was to make RFIC design better and easier, but we didn’t want to make it beyond human understanding. Chip testing and debugging is a long, arduous process, sometimes even more so than design. Engineers often prefer ICs to have interpretable structures, so that if a problem crops up, they can understand how the chip works well enough to debug it.
To create structures that are more interpretable, we turned to diffusion models, which you may know from their remarkable ability to generate realistic images from text prompts.
AI-driven synthesis could break traditional design barriers and push the limits of RFIC capabilities.
Imagine you go to your favorite image-generation engine and ask it to create a painting of the sky in the style of Picasso, Van Gogh, or Michelangelo. You will get images that capture the essence of their brushstrokes, their use of colors, and their framing. All are pictures of the sky nonetheless, but in different styles.
Electromagnetic design is similar in that multiple structures can have very similar electromagnetic responses. Instead of using text input, we used scattering parameters as our input, and the electromagnetic structure of an RFIC chip as our output. As part of the inputs to the diffusion model, we created a dial that sets the spatial frequency of the final structure. By turning the dial, a designer can direct the model to synthesize structures with low (classical-looking and interpretable), medium (mazelike structures), or high (pixelated or arbitrarily-shaped) spatial frequency.
From prompts to output, the entire process took about 6 minutes. With this diffusion model, algorithms can now both discover novel architectures and accelerate the creation of conventional, so-called classical ones.
All an RFIC designer needs to do is specify virtually any valid set of scattering parameters. As long as they are physically realizable under Maxwell’s equations, the model pops out a corresponding structure as if it were a vending machine.
The results of our investigations have drawn the attention of the RF community. The traditional bottom-up design process is clearly beginning to reverse.
But there are still questions: How generalizable are these methods? Can they consistently deliver truly high performance? Can we get to a place where AI produces designs that maximize every conceivable trade-off, holistically optimizing every parameter to its most ideal physical state? We want to take this strategy beyond RFIC design and invent other kinds of circuits that are different from anything humans have ever done.
These are exciting and ambitious prospects, but we are not there yet. AI can hallucinate a design that creates bad circuits that don’t work. This means verification methods need to remain under human oversight. And, while hallucinations are rare, it would still be good to reduce their occurrence.
History suggests that meeting these dreams of the future will take much more data than we’ve been using. Before the creation of the ImageNet repository—a repository of 14 million varied, human-annotated images—image-recognition models didn’t function well in the real world. The datasets they had been trained on were too tiny to be effective. ImageNet’s massive amounts of training data ushered in a revolution that led to AI that can generalize and recognize images in the wild. The rest was history.
If the goal for RFIC and analog design is a universal foundational model—something that learns the governing laws of electromagnetics and circuit behavior—then we also need data.
The good news is that this data is plentiful. Around the world, countless engineers at companies and academic labs simulate nearly identical RF circuits and passive structures every day. The bad news is that it’s all locked away behind nondisclosure agreements.
Open ecosystems have propelled other areas, and we think the RFIC community should do the same. There had been some movement toward this. Natcast, the operator of the U.S. CHIPS and Science Act’s R&D program, would have bolstered shared infrastructure and innovation for the next generation of wireless, sensing, and defense technologies. Unfortunately, both the organization and the program it ran specifically for machine learning and RFICs have been closed.
But the momentum Natcast’s effort sparked hasn’t died out. Building on our early work, groups across the community have already demonstrated remarkable advances. AI-driven IC design is part of a much broader technological shift. From biology and materials science to automotive and aerospace engineering, AI is reshaping how complex systems are conceived and optimized. Deeper collaboration between AI researchers and chip designers will unlock the field’s full potential. It’s by no means a foregone conclusion, but if we get this right, this genie won’t stay in its bottle.