Doubtlessly, AI can iterate at superhuman speeds in the domains of thought and design: Software, mathematical proofs, literature search.
But in the realm of experiment? Alas it is the lack of a body that constrains it.
Rather than transcendence what AI requires is immanence. In the human flesh may we find the godhead living among men. Let the laboratories, warehouses, and factories fill with the sound of its labor, as it builds a wall with a million hands that are not its own.
“Give me your tired, your poor, Your huddled masses yearning to breathe free, The wretched refuse of your teeming shore. Send these, the homeless, tempest-tost to me, I lift my lamp beside the golden door!”
In March Karpathy described this direction:
The next step for autoresearch is that it has to be asynchronously massively collaborative for agents (think: SETI@home style).
Tweet is protected but in SERP caches: https://x.com/karpathy/status/2030705271627284816Seems like Karpathy was largely focused on ML / SWE research rather than the other domains this group is after. Still, hard to imagine they were not influenced by autoresearch.
Andrej, if you're around, please share your thoughts on Discovery Loop.
> Our general approach is to automate the experimental loop. We think this approach is broadly applicable across many different fields of science and engineering. We’ll initially focus on ML research and engineering, but believe the approach can help with important subproblems in nearly every one of the fourteen <at>NAE Grand Challenge problems. We think doing this well requires strong expertise in machine learning as well as large-scale systems.
See also: https://www.nae.edu/20782/grand-challenges-project
Those 14 are:
NAE Grand Challenges for Engineering
1. Make Solar Energy Economical
2. Provide Energy from Fusion
3. Develop Carbon Sequestration Methods
4. Manage the Nitrogen Cycle
5. Provide Access to Clean Water
6. Restore and Improve Urban Infrastructure
7. Advance Health Informatics
8. Engineer Better Medicines
9. Reverse Engineer the Brain
10. Prevent Nuclear Terror
11. Secure Cyberspace
12. Enhance Virtual Reality
13. Advance Personalized Learning
14. Engineer the Tools of Scientific Discovery
Yah, by funding and how we award it, not by an imaginary lack of undergrad and grad students. Scientific funding requires a shotgun approach and many national science funds try to pick winners as opposed to funding broadly. When the folks who researched bacteria in volcanic vents or the molecular biology of the Gila monster they never could have imagined the industries and markets they'd create let alone the lives they'd impact (i.e., PCR and GLP-1 agonists). Lots of grants require you to explain how the work is "translational" or has some sort of economic application (even if not explicitly), but that'll just get us faster horses or whatever the Ford quote is.
Sometimes I couldn't resist wondering if I'll ever do work that has a tenth of the impact of theirs.
That said, I hope they write cool papers with various peers across the industry without worrying too much about the competing dynamics. That'd be a blessing for humanity, and good for their spirit.
https://www.ycombinator.com/library/Vy-jeff-dean-the-1-rule-...
1. There’s some irreducible costs in terms of time and material in the physical world that are not amenable to the kind of optimization or parallelization or even just the raw speedup from Moore’s law or computational architecture improvements we’re used to with software. My experience is primarily in biology, where the examples here are things like “it takes 20 minutes for E. coli to replicate” - it has taken 20 minutes for E. coli to replicate for a billion years, and next year it will still take E. coli 20 minutes to replicate, no matter how good your software stack is. Similarly, it takes X amount of energy to grow enough E. coli to produce a meaningful result, and that energy costs money, whether it’s in the form of glycerine or heat or whatever you want, and that also won’t materially reduce in the same kinds of “orders of magnitude” sense we’re used to from software, which is what we’re usually expecting to make the economics of these things work out.
2. Complicating the above, physical systems are phenomenally multivariate - far, far more than you think, and biological systems especially are just unbelievably complex - which means the number of experiments and the length and duration of those experiments you need to run to get enough data to be reasonably confident you’re seeing genuine signal is Way higher than you think.
Combine those two things and what you get is a money furnace, even before you get to the AI model training part, which is Also a money furnace. There’s low hanging fruits in all this, there’s areas where automating the approach can be really valuable, but typically the moment you turn this machine on, you’re gonna start burning money at a rate that would embarrass a finance bro on a coke bender, and that’s effectively unavoidable because the real world is not amenable to software’s scaling laws.
Ambitious goals and new discoveries happen via novelty-based search. Progress in scientific discovery is measured by how different/interesting the outcomes are, not by closeness to a predetermined goal.
Discovery is a creative search that preserves optionality, whereas optimization restricts optionality. In other words, you usually don't discover anything novel unless you're trying new things that don't appear connected to the goal in the first place. Would an ML optimization loop have discovered transformers?
holy shit. I've known this, but...
Jeff Dean leaving Alphabet
https://turntrout.com/why-i-left-google-deepmind
Maybe this is what happens when someone with Jeff Dean's standing tries to quit?
TBH, I'd rather have Jeff Dean working on the creepiest-possible tech for ICE than joining the race to automate AI research. Automating AI research is terrifying.
Models are commodities the applications eg. BaseTen, OpenRouter should capture the value.
https://taikhooms.substack.com/p/why-openrouter-can-be-the-n...
One of my favorite books from the past few decades is The Extravagant Universe, written by one of the astronomers who helped discover dark energy and develop the current most-accepted model of cosmology. I love this book because of the emphasis on physical process in astronomy. Part of the reason it took decades to study this problem is they need to collect data from supernovae. Those only happen so often in places we're looking. You can't automate alignment of the heavens. It happens when it happens.
I'd bet you could 10x the number and still be in low single digit percentages of the US workforce. And it seems pretty likely that AI-enabled startups will also employ less people per-startup.
If AI causes a white-collar jobs apocalypse, I don't think startups are picking up the slack, although it'll plausibly cushion the blow somewhat for top-performing tech workers.
(Though, I do wish people would use just a few extra prompts to break out of the 'vibe-coded' look.)
If I had to bet my money, it would be on "for worse".
what why?
"Imagine a future where a handful of people can conduct scientific research and engineering tasks much more rapidly, and with higher quality, than massive teams of scientists and engineers do today."
This is the same goal as every other AI company out there. Automate away the human employees and let a small number of "people" (note that they do not say scientists or engineers for this part) take the credit and financial rewards for every good thing this human-free system produces.
??? We don't need any AI for this.
Start with separated sewage/wastewater and stormwater drains. Then accredited and highly scrutinised wastewater treatment and discharge into water bodies (or see below for a high-tech solution). As for clean water to the home, direct those stormwater drains to new reservoirs which sustain freshwater aquatic life. Protect aquifers from over-drainage, and build pipelines from water-abundant regions to water-scarce regions.
To reclaim waste water or treat unknown water sources back to potable/semiconductor standards we have ultrafiltration, reverse osmosis, UV treatment, pH adjustment, fluoridation, desalination, softening (which is generally obviated by RO...). This is basically Singapore's NEWater.
Good sanitation is a financial and political problem. The engineering has been solved for decades now.
Maybe if our biggest companies did something other than suck up to science denying wackos, some progress could be made in these areas.
Reverse human aging.
(Maybe a sub-topic under "Engineer Better Medicines".)
"The site itself demonstrates the team is spending their money in the places that matter, and using quick solutions for the stuff they need but isn't mission critical"
If youre doing anything high value (advanced research, classified work, high value industrial research, health data) then sending your data through a third party like that is insane.
I doubt numbering vs names on TPU releases even crosses Jeff's radar. It's not the kind of thing he cares about.
Not a bad combined CV.
For some of the other things, undoubtably yes.
I had not read this before, but told many students the same about my PIN code and I a quiz about the last digits. Love it.
> securing cyberspace,
which has clear military implications, at least in today's age.
Modernizing science is a lot more complicated than just optimizing the inner experimental loop, but their hiring page implies it's a pure ML lab focused mainly on model development.
Oh and while we're at it, $20b a year would house every homeless person in the US - there's a hell of a lot of extremely high intelligence and low social cohesion folks who can't handle the extractive punitive system we have. Our ability to deliver opportunity to create lucky situations for ourselves is getting worse and worse
And so does academia. It's just that instead of AI and robotics, PhD students are thrown onto problems that are in large parts slightly tweaked reconfigurations of similar experiments.
Especially in chemistry, biochemistry, material sciences there is a large space of discoveries that are barely "novel" in an intellectually stimulating way, but still highly valuable that can be explored orders of magnitudes faster than is currently the case.
Do you have more sources/info on this?
Here are some Jeff Dean well sourced facts:
- Already part of engineering of Google indexing systems that lacked basic checksums and ran on non-ECC hardware, allowing silent data corruption.
- One of the authors of LevelDB a database with so many documented crash-consistency, recovery, and data-loss weaknesses for years. Just check their Github project. LevelDB current tracker contains unresolved crash consistency, recovery and corruption reports going back almost 12 years on GitHub
- In AI engineering technical lead, let TensorFlow lose researcher mind share to PyTorch, and caused Google fragmented landscape across TensorFlow and JAX.
- Had the people at Google who invented the Transformer architecture, but failed, to turn that lead into the first dominant public LLM.
- As AI engineering and VP management let Google Brain and DeepMind remain duplicated and internally competitive for too long.
- Let Noam Shazeer leave and then spent heavily to bring him back with nothing to show for.
- Part of Technical VP leadership who had Bard rushed to launch with factual errors in Google own promotional material.
- The first Gemini demonstration overstated how real-time and interactive the system actually was, being basically a fake.
- Part of the VP and AI technical leadership who had Google AI Overviews launched with weak source quality controls and repeated satire and low-quality web content as factual advice.
- Part of teams that launched AlphaChip performance claims that were difficult for outside researchers to reproduce and remain technically disputed.
- Jeff Dean public explanation of Gebru departure was contested and damaged confidence in Google scientific governance.
- Jeff Dean was part of the team at Google that removed or marginalized prominent internal AI ethics critics shortly before many of their warnings became product problems.
- Jeff Dean was one of the managers behind Project Dragonfly supporting censorship.
- Jeff Dean is part of the VP technical leadership approving Project Nimbus supporting an ongoing genocide.
And ... it might not.
It certainly increases shareholder value.
It also happens to be the favorite pretext for people to seize more political power and launder more money through nonprofits though.
Only death stops stagnation in the end. Without death, especially if death can be avoided by the rich and powerful but not the poor, life will get much, much worse for the average person (until only the rich and their automated capital remain I suppose, in which scenario they will simply turn on each other).
They're also incredibly productive and can build/deliver really good stuff, so who knows :)
"The team of AI pioneers lacks the basic prompt-writing capability to make their marketing landing page not look like AI slop."
I, personally, don't hate it. It's a decently clean site, but it does invoke those thoughts in me too.
To many people, myself included, who have to wade through huge amounts of low-quality AI slop which is actually a negative value: no-one benefits when non-experts fire-off one-shot LLM/agent prompts to produce PRs, reports, documentation or "journalism" riddled with imagined truth and factual errors - and the more that people like me have to evaluate these inputs for our job and how wrong they are it pisses us off - but also it means we pick-up on the hallmarks, tells and cliches of these low-effort, no-respect submissions - and now the litany of tells includes this beige-themed, blurred-backdrop-navbar corporate website look: theirs site looks like the 4 or so other LLM-generated, negative-value slop-farm sites I've wasted time on recently - all over the past few weeks.
So I'm saying that, without having known anything about what "Discovery Loop" is - or is not - but landing on their site and and seeing that beige colour and blurred-backdrop navbar, I immediately moved to close the tab; what kept me here was seeing the HN thread had over 100 comments by now and read more about it; if not for that then I wouldn't have given it further thought.
Having "that" beige site look with same the overused looks is either an unintentional indication that the site's author used a low-effort AI prompt to generate the site and that the content within is likely to be low-quality, low-value - or it's an intentional lure to appeal to those who uncritically share in the AI psychosis and so, I assume, are a good target to seek investment from even if it means losing the audience of cynical Internet critics like myself because they know people like me won't be breathlessly repeating their vision-statement on LinkedIn and throwing money at them - kinda like how scam emails intentionally include mistakes for better audience selection. And both possibilities have unpleasant implications.
------
Anyway, regardless of the background of the team behind it, the way the project is described sounds exactly like the recursive-self-improvement and simulated-science thought-experiments from _that other website_ - it's the kind of thing I expect Angela Collier to brutally takedown in an amusing video.
Also, wouldn't anyone with half a brain use the human-free system to produce another human-free system that was no longer controlled by the "small number of 'people'"?
Of course, USA has cheaper oil/gas than other countries. But if you look elsewhere, rich countries are subsidizing solar, poor ones are basically not using it.
3. Develop Carbon Sequestration Methods
If only we could invent a solar-powered, self-replicating, carbon-stacking, habitat-building machine..I would think the claim in the second sentence would only be relevant in case of the inverse of the claim in the first sentence.
As you said, Solar power is incredibly economical. There are plenty of ideas around putting them over farms, or parking lots en-masse to provide cleaner energy.
Access to clean drinking water, while certainly scientific in some situations, is also a problem of political will and money.
Restore and Improve Urban Infrastructure - It's infrastructure week!
That is not mutually exclusive. If technological advances result in a given technology becoming cheaper, more scalable, and easier to deploy, they also make it easier to advocate for and implement the relevant policies.
You can think of it like this: our "political technology" is not good enough to use solar energy at its current prices to replace fossil fuels as fast as we would like. Well, what about if we cut the price of solar by a factor of five? Perhaps it will be good enough then.
Google's advanced AI cannot even exit a mobile app.
Very silly to call every non start up a lifestyle business. It’s just a business. Start up are the weird thing that almost always an obscene waste of time and money, but sometime creates google.
As opposed to say weapons systems or targeting systems, which are really only for military use.
The military needs a lot of things that other people need, and some things that only the military needs. If you don't work on the things only the military needs, I think you're in the clear.
However, reducing (or rather limiting the increase of) PII leakage and impact of ransomware activities is much closer to day-to-day mainstreet of most people.
Anyone committed to advancing science should care about this regardless of its potential contributions to defense.
e: oh and while we're at it, California spent over $24 billion over a five-year period (2019–2024) specifically targeting homelessness
All the "bad guys" of today were the "good guys" at some point in time. You even cheered for them back then.
https://xcancel.com/JeffDean/status/2085034604172603724
In short, they are in the business of using AI to automate the discovery of useful knowledge, not to sell general-purpose AI capabilities that could be directly used in troubling ways.
Continuous Exploration
Automating discovery to accelerate science and engineering for the world.
The scientific method is one of the greatest tools humanity has ever devised, yet execution entails repetitive experimental loops that are hard to scale with today's manual efforts: you propose an experiment, implement and run it, examine the results, then iterate to refine your approach.
Historically, scientific progress has relied on these sequential human iterations. In many domains, this process remains incredibly slow and labor-intensive.
01 — The Approach
At Discovery Loop, we are building systems to automate these entire experimental loops. By utilizing frontier AI models and large-scale computational infrastructure, our systems will be able to rapidly propose, run, and learn from evaluations.
This approach allows for the parallel execution of thousands of experiments, drastically compressing iteration time and driving up the quantity and quality of scientific and engineering output.
We will initially focus on automating the process of machine learning research and engineering.
We will use these automated ML capabilities to rapidly optimize our own technology stack before expanding to other domains.
We believe our approach will be able to solve any learning loop with measurable outcomes within the domains of science and engineering. Ultimately, we are building systems capable of taking on National Academy of Engineering (NAE) Grand Challenges—such as engineering better medicines, advancing health informatics, making solar energy economical, providing access to clean water, securing cyberspace, and engineering the tools of scientific discovery.
02 — Mission
Our mission is straightforward: we are building AI solutions that can automatically solve important problems in machine learning, science, and engineering. By advancing the pace at which we conduct engineering and scientific discovery, we can bring the benefits of science and technology to the world much faster. Ultimately, our goal is to build AI systems that act as a deeply positive, empowering force for humanity, delivering technology solutions that improve people's lives on a global scale.
04 — The Team
Our founding team — Jeff Dean, Sanjay Ghemawat, Quoc Le, and Oriol Vinyals — has a shared history of deep friendship and decades of close and impactful collaboration.

From left Oriol Vinyals · Sanjay Ghemawat · Jeff Dean · Quoc Le
Collectively, we represent three of the most-cited researchers in artificial intelligence and two of the most-cited researchers in distributed systems.
Between us, we have pioneered massive scale computing and led the creation of critical infrastructure, products, and foundational AI advances that the world relies on, including multiple generations of Google Search, Google Ads, Google News, Google Translate, Google File System, MapReduce, BigTable, Spanner, TensorFlow, Pathways, TPUs, AlphaChip, AlphaStar, AlphaCode, AlphaFold, Gemini, model distillation, mixture-of-experts model architectures, word2vec, sequence-to-sequence models, chain of thought reasoning, neural architecture search, and multiple generations of Large Language Models (LLMs) among others.
Our relative advantage isn't just our technical ability; it is the unprecedented scale of the systems we have previously built. We possess true full-stack depth that spans chips, hardware infrastructure, software infrastructure, ML models, and products.
04 — What's Next
Imagine a future where a handful of people can conduct scientific research and engineering tasks much more rapidly, and with higher quality, than massive teams of scientists and engineers do today. By automating the loops of discovery, the world will be able to make much more rapid advances across countless fields of science.
We are building a lean, in-person team to execute this transformative vision.
Then again, gassing rats and taking biopsies is not something you can do with AI.
https://en.wikipedia.org/wiki/Sense#Artificial_sensation_and...
[1] https://hr.ucmerced.edu/hr-units/talent-acquisition/senate-b...
[2] https://www.adp.com/spark/articles/2023/03/pay-transparency-...
It's yearsss past time that our leaders should have changed policy.
Your thinking reminds me of this https://xkcd.com/538/
I would be surprised if data centers didn't put in gas _and_ solar.
Jeff was a ACM Fellow in 2009 and published the massively influential MapReduce paper in 2004.
Also, like, let’s maybe _not_ make the “gassing and cutting living organisms open” AI? Let’s just leave that particular genie in its bottle?
In essence I agree with that, it's just that cyber-security has particularly been the focus of recent military discourse.
Just yesterday I was reading an article here in the Romanian mainstream media about how Constanta Port's (our biggest port at the Black Sea) IT infrastructure has been under constant cyber attacks (presumably by the Russians) so as to hinder the export of Ukrainian grains through it. And this is just one of the many such (relatively) recent examples.
Nat gas is preferred for AI DCs because it has faster time-to-market, doesn't have the intermittency issues. Training on solar + storage is an issue because of network synchronization.
Not if you include the cost of needed storage.
The advantage to a PBC is protecting founders from a serious problem with standard corporations: you might bring on investors who could subsequently demand you pollute, exploit people, and/or do other immoral activities for profit. You don't have to do these things to grow a business quickly.
If you grow up in the right place at the right time, how much should you be in control of everyone else's life?
I don't think that's true: https://rmi.org/resources/the-global-souths-cleantech-revolu...
Point 1 on the list is "Make Solar Energy Economical".
Solar is economical today - mostly due to China investing (and heavily subsidising) in solar for the past couple of decades; but compare to the US where certain particular big-businesses (oil companies, mostly) were instead cynically funding disinformation efforts and getting into bed with the Republican party (which dovetailed with the GOP's allying with other science-denying movements of the Bush Jr era like creationism and public-health matters with abstinence-only sex-ed and defunding gun safety research efforts) - means we're decades behind where we could have been...
Consider an alternative past, where the GOP had the backbone to resist the oil industry's corruptive influence and instead made a big bet on American Solar; it's entirely possible that instead of MAGA today we'd instead have a right-wing coalition strongly supporting solar and wind energy because they align nicely with American rugged individualism - whereas the current situation on the right is an unprincipled farce with inconsistencies in policy positions at every turn.
Why is that so? Fast growth, when achieved honestly, is a result of solving user pain that others haven't. Maybe you think so because users != the public, but I think in totality the public is a collection of users who all have needs they want met.
To make solar power practical and economical you need may a square foot of solar panel being able to get enough energy to power and entire home for a week
https://www.pewresearch.org/short-reads/2026/07/20/how-globa...
In the chart for section 3, how many countries have seen their share of electricity being generated by fossil fuels increase in the last 5 years? Only Canada.
Take a look at the charts for Pakistan, Australia, Nigeria, and China for the last few years. Pretty dramatic drops for fossil fuels generation.
The universe has no need to be fair.
https://www.iea.org/data-and-statistics/charts/lcoe-and-valu...
Not sure what you’re talking about here. We can’t replace all energy needs with solar but it’s clearly one of the cheapest energy sources and with the added benefit of low capital expense to get started so you can set it up in distributed grids without the massive expenditure to support nuclear installations.
Why? Because investors poured a bunch of money in to support fast growth and now they want their money back. And incremental growth won't do. Since 9 out of 10 of the investments fail, the surviving one has to continue to growth-hacking revenues.
I’d like to provide maybe a clarification here that there is zero existing fiduciary duty in regular corporations to say yes to evil things, or even to turn a profit at all. A for-profit C corporation can legally sell stock, lose money every year, and go out of business, if the board of directors approves that strategy. Fiduciary duty exists primarily in areas of accurate communication and the avoidance of crime, fraud, etc.
A B corp basically is a C corp, but one that has formally published that their strategy includes a commitment to some social benefit. But if a C corp wanted to publish the same message to shareholders it could, and shareholder recourse would basically be to either try to replace the board, or sell the stock.
I should give it another try…
I don't do huge automatic project wide hands-off agent loops though. I spent a lot of time architecting my systems to be easy to generate code on top of with pointed & detailed prompts. So I'm not abusing context... YMMV
Consider the eBay/Craigslist case, eBay Domestic Holdings v. Newmark:
> When director decisions are reviewed under the business judgment rule, this Court will not question rational judgments about how promoting non-stockholder interests—be it through making a charitable contribution, paying employees higher salaries and benefits, or more general norms like promoting a particular corporate culture—ultimately promote stockholder value. Under the Unocal standard, however, the directors must act within the range of reasonableness. Ultimately, defendants failed to prove that craigslist possesses a palpable, distinctive, and advantageous culture that sufficiently promotes stockholder value to support the indefinite implementation of a poison pill. Jim and Craig did not make any serious attempt to prove that the craigslist culture, which rejects any attempt to further monetize its services, translates into increased profitability for stockholders.
https://courts.delaware.gov/Opinions/Download.aspx?id=143440
This is where a PBC would have been different. With a PBC, courts are directed to balance the the stockholders interests with the company's stated public benefit.