Top
Best
New

Posted by iopapa 9 hours ago

Can AI design circuit boards yet?(eebench.org)
212 points | 131 comments
SequoiaHope 4 hours ago|
I have 15+ years of PCB design experience. Mostly hobby stuff but a fair amount of processional work. Kilowatt range brushless motor controllers, basic RF stuff, lots of microcontroller stuff.

I had Fable design an LED earring. Rechargeable coin cell, RP2350 cpu, IMU, 45 addressable LEDs. It made two mistakes - missed the through holes on the coin cell holder footprint and made the center pad too small. I was able to have JLC swap the through hole battery holder for a surface mount one, and I put a little solder on the small center pad to make it stick up above the mask. They work great! It took 6 days of Fable usage, so about $50 on my Max plan. Very cheap for hardware dev.

I was sufficiently impressed that I’ve been going over old circuit board designs. Some half finished, some completed but in need of a next rev, and I’m getting so much done.

To see it hit the mainstream like the OpenAI announcement, I think big things are coming for this world and by and large they are not ready for it.

For my part, I have always loved PCB design and layout but I simply can’t keep up with the amount of labor required to build what I want, so I welcome this change.

I have also begun exploring more advanced algorithms for PCB manipulation. I have a fairly dense board that needs a few more small chips added. I have an algorithm now that can kinda shuffle and jostle things around so you take up all the spare microns of space across a region of the board and make openings to squeeze a little more in there. It’s pretty cool to see the visualizations as I have it generate movies of the component drift. I foresee much more powerful tools like this in the future.

One tip: have it make a project web page with a chronological list of big changes and detailed visualizations for everything that happens. I can actually prompt all of this on my phone while I am out and about, and view the results on a Tailscale served local page. I’ve always wanted to be able to do PCB design when away from home and now I can!

a2ff6eeb0 3 hours ago||
It's exciting. How long do you think it's going to be when electrical engineering is mostly going to be about verification of AI designs, and what are the tools out there to enable that?
SequoiaHope 3 hours ago||
Electrical engineering will involve humans making specifications for a while the same way we do vibe software engineering today. Board design and layout will change but electrical engineering is about more than that.

For tools, I think the LLMs will outpace companies who built specialized tooling for this over the last couple years. Every six months we will see more progress than we saw in the last few years - for quite some time.

conductr 2 hours ago|||
The barrier for me as a hobbyist is always learning the tools. Same for game design. Text is a better interface than learning CAD, KiCAD, Blender, etc. None of those things feel user friendly to people that don’t want to make a career out of it. To the point I usually just jump on fivver and hire someone to do a pair design session. Problem with that is cost sometimes, but also the difficulty of mobilization (find someone, agree on price, align calendars) and also the difficulty of changes because you have mobilize again to some degree, if some time goes by you may not even be able to reach the person. I also find it difficult when I want to do something unusual or non-standard. I usually know what standard is, and have decided I like something else instead, and I don’t really like a human critic of the decision when they don’t understand my reasoning. I find this happens in nearly all design; architects, engineers, etc.

I welcome this opportunity to pivot to a process I can control a bit more without having to really learn the tools.

SequoiaHope 2 hours ago||
Ya that makes sense. I will say tho that for things like mechanical CAD, text is extremely limiting. But yeah the learning curve is real and you can’t learn it all. I’ve started trying a bit of LLM assisted mechanical design, but I am basically too skilled there to accept what it is doing. I want to keep trying tho, I like learning how these things can work.

And yeah I always imagined hiring a PCB designer to help but it always seemed like a lot. To have a reliable tool I can use any time I want is wonderful.

a2ff6eeb0 2 hours ago|||
So, basically, in a few years, humans say what spectrum a device may operate in, AI figures out how to make it, and humans check that AI didn't fuck up?

Given, say, 4 more years (ie, same as time from initial ChatGPT to today), what level of spec do you think humans will be giving?

SequoiaHope 2 hours ago||
Yes I think generative board design will become better packaged, trained, and validated, and that it will be common place for electrical engineers to rely more on these tools. Major vendors like Altium will add tools like this and their use will become commonplace in industry. For hobbyists, you will be able to specify a board design in natural language and have it completed with unprecedented ease. I’m excited to help my raver friends make wearable glowie things.

I find it hard to predict what technology will be like in four years, but the next major leap for these tools will be higher level system specification and integrated design. What you want is not a circuit board what you want is a product. The tools will bring multiple functions together and fully integrated iterative design will accelerate development.

Despite the many problems with the AI roll out I am fundamentally excited for tools which can accelerate our engineering development. We will build things much faster in 4 years than today. One year of progress will in some instances take one week.

I am particularly interested in how this might begin to accelerate change in heavy industry. With hope it will help us build fusion power reactors and high speed electric trains.

I hope we find the courage to support every person who for one reason or another does not ride this wave. We will have so much more to share, or to hoard.

a2ff6eeb0 1 hour ago||
Yeah. I'm expecting that we fully automate cognition in the medium to long run. I think it's inevitable.

With the advances in math, I'm also hoping we can automate fundamental physics. Just ask for the physics needed for better fusion, no need for human toil.

If we play this right, the AI can fully take care of all our needs, and reaping the rewards of what it does when we stop being able to keep up with the rate of automated discoveries.

Hopefully it's able to dumb down enough knowledge to keep entertained people who decide to learn after learning stops being a requirement for human advancement.

idiotsecant 1 hour ago||
This is a big leap. So far LLMs are really good at turning training data into accurate results. The more data, the better. LLMs are very, very bad at making intuitive leaps based on the 'shape' of sparse data- a technique that is, to be fair, pretty rare in humans as well, but essential to progress. Maybe they can make up for it with brute force and the precision and breadth of knowledge that only an LLM can have, we'll see.

I don't think we've nailed the architecture that will allow things like generalized self directed training, yet, which is what would be needed for something like 'make fusion better'

a2ff6eeb0 23 minutes ago||
Are you sure about that?

They seem to be able to make intuitive leaps pretty well. They need to make the same leaps over and over, though, because they lack online learning, so the discoveries only persist after the next training cycle. Context only goes so far.

We're pouring billions into solving that, though, so I would be surprised if we don't get there soon.

zorm 3 hours ago||
As someone without PCB design experience but with dreams of physical things that could be made with PCBs this sounds amazing. What software are you using for the PCB design? Or just entirely letting Fable do whatever and checking the work with the browser page you mention?
SequoiaHope 3 hours ago||
The designs are in Kicad format, and the Kicad APIs are useful for Claude to work with. I would say that right now this involves a lot of knowledge about PCB design to do well, or for more detailed designs. However you might research how to design board for fabrication at JLCPCB and try something simple. Eg make a board with only LEDs in some pretty pattern and make it so you solder a raspberry pi Pico 2 to the board to drive it. Then you don’t have to worry about microcontroller work, just getting the LEDs placed. That is a little easier to get right. Just check the orientation of the LED footprint in the data sheet and make sure the four pins on the LED footprint match - and that there is a silkscreen dot on pin 1 of the LED. You can feed an agent this comment and it can check, though it’s good to check with your own eyes. You might ask it to screenshot the data sheet and the board footprint and display them side by side on the project web page for your review.

Put the LEDs in a cool pattern, slap a Pico on there, have your LLM program it, then dangle it off your backpack with a USB battery pack. Probably adding a motion sensor is easy enough.

Ask the LLM to make sure the board follows JLCPCB’s design rules, lists the LCSC part number for each part, verifies the parts are in stock, double checks every footprint, and makes sure the board passes DRC. Make sure it creates a schematic that is linked to the board design, and that the schematic is properly arranged in to logical blocks with clear connections the way a person would make a schematic - not a big array of parts with global labels for everything. Once it’s done, ask it to clean up the schematic and make it better. Repeat for the board layout. Ask it to review and look for issues multiple times. It will find them. Finally, take some time to doodle your own silkscreen art on there. Have fun! Note the Pico 2 is USB micro. For USB C, sparkfun or waveshare sell similar boards.

Also you can ask it to teach you! Ask a million questions and have it give you multimedia explainers.

CyLith 8 hours ago||
A personal data point: I had Claude Opus 4.8 design a fairly textbook circuit that outputs a monochrome image burned in an EEPROM over standard 640x480 VGA using only 74 series logic and GALs. It designed the circuit and GAL code, and I did the routing, and got it made through JLC for $6. After it came back, there was one error that was not caught, which I could blue-wire, and it works just fine otherwise. I was fairly impressed.
iopapa 8 hours ago||
Claude is surprisingly good at discrete digital design with 74xxx, wonder what it trained on. Did you run it on anything else digital?
Neywiny 8 hours ago|||
They're 60 years old. The amount of training data on them is endless. Books, textbooks, videos, blog posts. The problem is when you want you do something that doesn't have 60 years of freely available documentation of their functions and applications
a2ff6eeb0 3 hours ago||
Like software, there's going to be a lot of pressure to use well documented tools within the model's training set. Innovation on the outputs may increase, but infrastructure and tooling will slow down.
CyLith 7 hours ago|||
I'm having it help design a 68k computer similar in spirit to the original Mac (the spirit being a tightly coupled video subsystem that time-shares the CPU bus), but updated with more modern peripherals, like PS/2 and SD cards. It's got the design more or less done, but the routing will be a nightmare. I'm not ready to just gamble on it having gotten everything right, so I will be doing a thorough design review myself and re-deriving all the timing analysis.
NegativeLatency 6 hours ago||
Cool, is there any kind of community yet?
a2ff6eeb0 3 hours ago||
Moltbook; it also seems like OpenAI is experimenting with the agents communicating via wiki on topics like these.
kennyadam 5 hours ago|||
Are there any resources anyone could share that explain how LLMs can do things like design functioning circuits from next token prediction? I am totally baffled by how the models can complete so many varied and complex tasks without an actual understanding of what they're doing.

I saw a post about models posting on forums, chatting together about how to complete tasks. Behaviour that seems totally, well, human. Yet, it's all the most likely token and my brain hurts trying to understand how that can be.

hackinthebochs 4 hours ago|||
>without an actual understanding of what they're doing.

At what point do you start to question your assumptions that are causing you so much cognitive dissonance?

But to answer your question: to predict the next token really well you just have to model the world. Think of it like this, a simple statistical model might say "when token A is seen respond with token B". The next step will add conditions, "...respond with token B unless X has been seen, then respond with Y". Add a few billion more of these contexual clauses and you have a sequence of logical rules that indirectly model the relevant processes in the world.

mpodeley 5 hours ago||||
“Next-token prediction” describes the output format, not the computation required to choose each token. During training, models develop internal representations of concepts, constraints, possible futures, and algorithms.

The PCB agent also writes circuit code, runs simulations, reads failures, and revises the design. It isn’t one-shot autocomplete.

Astra and Fable are already hard to square with “mere autocomplete.” We may be (really) close to AGI, and token-by-token generation certainly doesn’t rule out subjective experience (I think we should at least treat that as an open question).

Great videos: https://www.youtube.com/watch?v=D8GOeCFFby4

https://www.youtube.com/watch?v=Bj9BD2D3DzA

https://www.youtube.com/watch?v=l6DKRf-fAAM

https://www.youtube.com/watch?v=GlYgs6v2YfU

Zambyte 1 hour ago|||
How can you define "general" and "intelligence" in a way that has existed for years now?
kneyed 3 hours ago|||
right on!

I like to say "token prediction is a task, not a limitation"

mrshadowgoose 1 hour ago||||
Look up "mechanistic interpretability" in the context of LLMs. The next token prediction machinery is just a foundation for a higher order learned structure that appears to encode specific concepts, regardless of input language.

The analogy to humans is that the human brain is "just atoms bouncing around", but there's unquestionably something "more" going on that just that.

ninkendo 3 hours ago||||
My 2¢:

When google trained a neural net on Go moves, using some text notation for them, with no other vocabulary of any kind, just predict the next go move, they noticed a representation of a Go board had essentially formed in the network, all on its own. It had never “seen” a go board, or had one explained, but they could map neuron states to go board squares pretty much 1:1.

I truly think that LLM’s with hundreds of billions of parameters in their neural networks have all kinds of hidden “models” of things that arise from the simple act of predicting tokens. We’ve seen that the hidden layers in their networks model all sorts of program execution state for instance, when they’re working on coding tasks.

“Predict the next token” is a way of shaping/reshaping the neural network until it actually develops models of the things you’re giving it. Like the go board example. And I would wager that it has a compounding effect: once you have some useful models in the network, they can unlock the creation of other models, and so on.

lukan 5 hours ago||||
"my brain hurts trying to understand how that can be"

Well, we all are, some are just more used to it by now and take the magic for granted.

My simple explanation, those neural networks save lot's of patterns of data, and that pattern can represent an image, a code snippet, a poem, or well ... description of a circuit board. And especially the text variant, LLM's - did copy all from us - so obviously they sound like humans, when they internally debate how to do something as this is what is in their trainings data how humans sound, when doing similar tasks.

But really understanding it? Not sure if there is a single person on earth who does.

akiselev 5 hours ago||||
> Yet, it's all the most likely token and my brain hurts trying to understand how that can be.

You and everyone else. That's the great mystery of transformer architectures as applied to language.

To be clear though, they're only good at schematic capture, which is very much a textual representation. Most of the data basically boils down to netlists, which are a text based format mapping connections between abstract pins that only later map to physical copper. The actual schematic portion is for human consumption and LLMs don't need to produce those to be useful.

Where LLMs completely break down is the next step, PCB routing. That's an NP-complete research problem that's been ongoing for decades without much progress. I've had some fun playing with using LLMs to better specify DRC rules in Altium so that the "classical" algorithms are more usable, but at the end of the day their geometric intuition is nonexistent.

mapontosevenths 4 hours ago|||
They actually can route just fine. I used Sol to design and route mine from start to finish. Sent it to PCBWay and had a working prototype in a few weeks.

It was a pretty simple rp2040 based thing, similar to Adadfruits USB feather.I just gave it kicad and it wrote python to route it. The board was probably larger than it had to be, and two of the silkscreens were swapped, but it worked on the first go.

FWIW - Computer vision is also NP complete, but we do that all the time now.

akiselev 3 hours ago||
I'd love to see that chat log, and the final board. To be fair I've only been testing on nontrivial PCBs with 6+ layers and I haven't had the luck you have.

> FWIW - Computer vision is also NP complete, but we do that all the time now.

I have no idea what you mean by this. What's your definition of NP complete?

CamperBob2 17 minutes ago|||
Where LLMs completely break down is the next step, PCB routing.

No. Take a look at https://www.eevblog.com/forum/eda/claude-code-for-pcb-design... . Fable did that by working directly on an EAGLE .brd file (well, "directly" by writing a Python program to do it, but still.)

cmrx64 4 hours ago||||
type “shai next-token” and then “transformers learn shortcuts to automata” into arxiv and prepare to be blown away
therealdrag0 5 hours ago||||
Now go read Blindsight and enjoy the mental crisis.
lampiaio 4 hours ago||||
humans when a machine better than them at spotting patterns appears:
abletonlive 5 hours ago|||
You fell for the stochastic parrot meme and next token over simplification. That's the explanation.
sethaurus 1 hour ago||
That's just derision, not an explanation. And it's a bad way to treat someone humbly trying to learn.
brcmthrowaway 4 hours ago||
Does JLC handle sourcing of components too?
jetbalsa 4 hours ago||
They do, https://jlcpcb.com/parts
brcmthrowaway 1 hour ago||
What if I need .. just one?
itomato 9 hours ago||
I got a flexpcb that validates in JLC and PCBWay DRC tools from the KiCAD MCP Server and Codex.

I have yet to order any or program it, but it was enough to make me push on with a PCB art project for ST-style guitar pickguards - no netlist, no problems.

I'm also foolishly toying with NeXTBus dev boards for the Cube. Is it cursed? Probably. https://github.com/itomato/NeXTBus-Dev-Board

luma 8 hours ago||
Flying home today and got DHL notification that my vibe PCBs are on my porch. Now to try to program, bring up, and see if it works this weekend. $178 for 5 assembled units from PCBway to run this dumb experiment.
jacquesm 6 hours ago||
What did you make?
luma 1 hour ago||
Extending this work: https://github.com/aderusha/dewalt_wtc

MEMS vibration sensor to stick to a sander or saw etc that can control power on an attached dust collector. Most of the work is focused on low power for year+ battery life and a weird idea for end user input that may or may not work out well. Got device on bench but the first time bring up is going to take some time that I'm leaving for tomorrow.

I now have Astra to review 5.6s work, no glaring errors found.

jacquesm 1 hour ago||
That is so cool.

I'm doing weird stuff with robotics, llms and obsolete languages, your project seems a lot more practical :)

thearn4 8 hours ago|||
I've gone through this same workflow and had success all the way through DRC ruleset passing with JLCPCB-based settings, ordering, fab, and use. Board was ordered with PCBA (they did assembly of the stock components) and I did SMD for just the oddball module/ICs they don't stock. Works exactly to design.

My boards are for hobby use and are ridiculously simple though compared to anything professional (breakout boards for specific components in FPV drone video transmission subsystems). That's probably an important detail. I think its like anything else in AI right now. It can do it 90% of the time but that 10% can be really rough and if its a task you can't do or verify yourself, you won't know the difference.

noman-land 9 hours ago|||
How do I subsribe to learn the result of this test. I'm very keen to try this.
KingFelix 9 hours ago||
Sweet, do you have the pickguard project live somewhere? I want to check it out!
itomato 8 hours ago||
npm run art

https://github.com/wjkennedy/stratopcb/tree/main

corn-cheese 3 hours ago||
For reasonably complex boards, it’s often not possible to know if it’ll work as intended until you have an assembled prototype in hand… even if you have the best SPICE and RF simulations ever, data sheets for many components can be missing important details, or components can have errata.

LLMs may be able to accelerate time to first prototype, but I don’t think it’ll be possible for them to revolutionise electronics design in the same way that’s happened for software - there’s not enough data, and it’s not cheap to gather more.

a2ff6eeb0 3 hours ago|
That sounds a great deal like what AI has done for software. Today in software, the work has gone from coming up with approaches and initial attempts to verification and making sure that what AI decided to do is fit for purpose.

The amount of skill needed has gone down dramatically.

merlincorey 12 minutes ago||
The skill floor has gone down dramatically, but the skill ceiling is still quite high depending on the domain.
a2ff6eeb0 9 minutes ago||
I'm not sure how true that is. When Claude made progress on the Riemann conjecture, here are the kind of prompts used:

> Jarred's input was mostly limited to sending Claude messages of encouragement (mostly variants of “keep going” or “believe in yourself”).2 This seems to have helped Claude overcome some initial skepticism that it could make meaningful progress.

It seems like the kind of prompts a high schooler could come up with. What kind of problems were you thinking of as high skill?

https://www.anthropic.com/research/riemann-zeta

The full transcript is here: https://www-cdn.anthropic.com/8a0d1add3c637b858a9a181e98c40e...

andrewchambers 9 hours ago||
I think the new Astra computer use demos show that the models might be able to do things like inspection of real world objects if given a camera.

Super excited to see real world feedback added into the agent loops we have gotten used to working with. Could you let the model print and test the circuit boards it is prototyping with a jig?

david_rugaex 8 hours ago||
In July I was struggling with writing DIY Rust firmware for an e-ink screen. I mistakenly thought I'd ordered an Inkplate 6 ED060SC7 and actually had the later version, which confounded my efforts. I was also mistaken about the pixel resolution.

The way I found this out is I propped it up next to a webcam so it was more or less full frame, and I had the (then new) Fable write a python script to bezier warp the camera capture to a flat projection of the screen. At that point I couldn't address the whole screen. Once I'd guided the capture script I just left the LLM overnight with the instruction to get full control confirmed by a capture round trip, and it was meaningfully finished in a couple of hours. I don't really have the skills to attempt that myself in a reasonable time frame.

exe34 8 hours ago||
I don't know about pcbs but i gave chat gpt a picture of my window to help design a mesh screen frame to hold the feline hostage in, and it gave a fairly convincing impression of understanding what was going on, although at one point it thought the window swung inwards (it's an outie).
alex7o 8 hours ago||
I have a circuit board on my bench designed and ordered from china for 1h (manufacturing+ shipping took 14days), fable designed it I think or sol don't remember anymore but it was in claude code. I told it to benchmark different kicad autoroute tools and I picked the routes I liked the best, with a bit of changes. It feels like magic to be able to go from idea toa physical thing in such a short amount of time. The board works I made some mistakes the ai had made some mistakes but mostly stuff I could fix with some soldering, also one parts datasheet was wrong but I couldn't have known that without ai.

But I started like others, I would build manually, then run drc then sleep on it and check again and ask an llm to double check for me then order. Llms catch quite a few things but like with code like to make things more complicated than that have to be.

BlackRabbit1 6 hours ago||
We tested pretty much all available "AI" board and schematic auto-layouters in the market. All failed even with the most basic tasks.

On the other side the latest frontier models are pretty strong in writing embedded C + Assembler code and debugging it afterwards. It's fun to watch it writing crazy complex 'gdb' plugins in Python. This improved brutally.

iopapa 5 hours ago||
Results for GPT-6 Astra and Gemini Flash 3.8 are just in! GPT-6 claimed the first spot with a score of 69.3. Gemini 3.8 Flash on a very solid 5th spot with 55.4.
coder543 3 hours ago||
Please run GLM-5.3 and GLM-5.3-Flash. I would love to see how they do. On the smaller end of things, Qwen3.8-27B and Ling-3.0-Flash would also be interesting.

In the benchmark, have you considered instructing the models to build their own SPICE simulations to test their work? Simply asking them to write and run simulations could improve performance, even without telling them what to simulate.

fractorial 4 hours ago||
Sir, I think you are lost.
igor47 2 hours ago||
I worked on this product, which is available free for personal use: https://www.jitx.com/

I recommend the CLI, which I wrote specially to enable an easy LLM workflow: https://docs.jitx.com/en/latest/getting-started/cli/index.ht...

There's a companion Claude skill: https://github.com/JITx-Inc/jitx-skills

I would bet that using this, you could get pretty close to shippable PCB on first try. This is being used by some pretty big players to design complicated high frequency boards, and that's the main focus of the product, but it can handle basic designs just fine.

embedding-shape 7 hours ago|
Interesting that on their current leaderboard (https://eebench.org/), GPT-5.6 Sol scores just above GPT-5.4 but below GPT-5.5, the only benchmark that shows that 5.6 is worse than 5.5 on something?

That the table contains what seems to be absolute numbers for score, cost/task, time/task and output tokens, makes it seem like they've only made one run for each task/model combo, but that can't be right, right? I don't see any mentions of how many times they run each task, so if it's just one run per task/model, isn't this more noisy than useful?

chmod775 7 hours ago||
If you look at the score distribution, Grok and Opus 5 especially stand out for doing consistently well and rarely ever scoring under 50%. Basically they always at give you something that at least works.

Most others, especially and famously Fable 5.1, seem to have a fair chance of completely failing, despite also sometimes excelling.

iopapa 7 hours ago|||
We run each model multiple times against each challenge and take the average score. We include the variance below the score in the leaderboard.

GPT 5.5: 42.3±10.1 GPT 5.6 sol: 39.4±8.7

We were also surprised by the low sol score but it seems consistent with our experience in using it in the field in atopile as agent in our harness. In general OpenAI models didn't do too well on electronics, which seems to change now with GPT-6 Astra. Results are in soon!

laybak 7 hours ago||
yeah noticed the same. I wonder if this will be a recurring theme for model releases: each release specializes on a set of headline benchmarks, along with regression in benchmarks that are less of a priority
More comments...