Can AI do AI Research?

AI research can be carried out entirely within digital spaces, making it ripe for automation. Recent efforts have demonstrated that AI systems are capable of carrying out the whole process of research from ideation to publishing. Startup Sakana.ai has created an 'AI Scientist' that independently chooses research topics, conducts experiments, and publishes complete papers showing its results. While the quality of this work is still only comparable to an early-stage researcher, things will only improve from here.

Judging Social Situations

AI chatbots, including Claude and Microsoft Copilot, can outperform humans in evaluating social situations. In an established 'Situational Judgment Test', these AI systems consistently selected more effective responses than human participants.

SOURCE

Analyzing Scientific Literature

While language models are known to hallucinate information, this tendency can be reduced. PaperQA2, an LLM optimized to reliably provide factual information, was able to match or exceed human subject matter experts across a range of realistic literature review tasks. The summary articles it produced were found to be more accurate than those written by human authors.

SOURCE

Writing Emotive Poetry

A study has shown that non-expert readers can no longer tell AI-authored poems from those written by acclaimed human poets. The AI poems were also rated higher in rhythm and beauty.

SOURCE

Writing Post-surgical Operative Reports

Surgeons take painstaking notes of the actions they carry out during surgeries, collecting them into narrative form as an 'operative report'. A machine vision system was trained to watch surgery footage and produce such reports. It did so with higher accuracy (and much higher speed) than human authors.

SOURCE

Developing New Algorithms

AIs can find innovative solutions to difficult coding problems when given an appropriate framing. For example, a dedicated system called AlphaDev was trained to play a game about creating sorting algorithms. The algorithms it discovered were novel and outperformed existing human-authored benchmarks.

SOURCE

Who is Building AGI?

The following companies have explicitly stated they intend to develop AGI, either through public statements or in response to FLI’s 2024 AI Safety Index survey:

Anthropic

OpenAI

Google DeepMind

Meta

x.AI

Zhipu AI

Alibaba

DeepSeek

How can we avoid AGI?

There are policies we can implement to avoid some of the dangers of rapid power seeking through AI. They include:

Compute accounting
Standardized tracking and verification of AI computational power usage

Compute caps
Hard limits on computational power for AI systems, enforced through law and hardware

Enhanced liability
Strict legal responsibility for developers of highly autonomous, general, and capable AI

Tiered safety standards
Comprehensive safety requirements that scale with system capability and risk

TOMORROW’S AI

ALL SCENARIOS

TOMORROW'S AI

Where will we let new technologies take us?

From fire to the wheel, agriculture to the industrial revolution, the atomic age to the internet...

...technology has rebuilt and reimagined our world many times.

Artificial intelligence

is now poised to transform our world in a way we've never seen.

Artificial intelligence
is now poised to transform our world in a way we've never seen.

AI is different than all technologies that have come before it.

CAN AI DO AI RESEARCH?

AI is the first technology that can improve itself.

CAN AI DO AI RESEARCH?

By configuring multi-layered learning networks, and then feeding those networks enormous amounts of data, we are building learning machines that are already capable of a surprisingly wide range of typically human feats.
We're still not sure exactly how they do it, or how far they could go if we keep scaling them up.

AI can now compete with (or surpass) humans at:

Judging social situations

LEARN MORE

Analyzing scientific literature

LEARN MORE

Writing emotive poetry

LEARN MORE

Writing post-surgical operative reports

LEARN MORE

Developing New Algorithms

LEARN MORE

KEEP SCROLLING

Will AI be a tool for solving our biggest problems?

Or an uncontrollable power that replaces us?

AI that can outperform humans at nearly all tasks is called 'Artificial General Intelligence' (AGI). But humans and AIs can be difficult to compare directly, and definitions of AGI are shifting as technology progresses. One useful framework for understanding AI capacity is to consider three key properties:
Autonomy | Generality | Intelligence

AGI would be high in all three.

Replacement AI

A system that is high in all three would be difficult or impossible for humans to understand, predict or control.
As such, AGI would pose an existential threat to humanity. No one can say precisely how close we are to developing AGI, but experts now believe that it could arrive within months or years - not decades.

Tool AI

Today's AI systems show high intelligence and generality, but low autonomy.
Controllable systems like these, which are limited in at least one A/G/I property, are 'Tool AI'. Tool AIs have enormous potential to drive economic growth and innovation without threatening to replace or eclipse humanity.

But AI's architects are not focused on developing such specialized, problem-solving tools.

Do we need AGI?

They acknowledge that the risks are great, but assure us that they can be managed. That we will figure out how to align AGI with human values and adapt to its disruptions as we go.
But they have not demonstrated any clear or reliable methods for doing so. Given these risks, it's natural to ask: do we even need AGI to solve our biggest problems?

WHO IS BUILDING AGI?

Tech companies and governments are pouring billions into AI development, and scrambling to find the data and energy sources needed to fuel ever more powerful models.
They argue that more powerful AI will offer more powerful solutions, and many are explicitly attempting to develop AGI.

“We are now confident we know how to build AGI as we have traditionally understood it. ...We continue to believe that iteratively putting great tools in the hands of people leads to great, broadly-distributed outcomes.” - Sam Altman (Open AI)

If the titans of AI were truly interested in using it to solve our problems, they could focus on investing in specialized applications of Tool AI.

The technologies we have right now could already power years of innovation and problem-solving, including tackling humanity’s most pressing problems like curing cancer, ending poverty and solving climate change. Instead, investors are focused on rapid growth at all costs.

“Whether we burn $500 million a year or $5 billion—or $50 billion a year—I don’t care, I genuinely don’t,” he continued. “As long as we can figure out a way to pay the bills, we’re making AGI. It’s going to be expensive.” - Sam Altman (OpenAI)

Why are they behaving this way?

Because the ongoing AI race is not a race to solve our biggest problems.

The AI Race is a Race For (Perceived) Power

Are corporations investing in AI to change the world or they are investing to attain power?

In such an all-out race for power, who knows where we might end up?

There are many ways that things could go wrong if we are not thoughtful and intentional about building our future.

One way or another, AI will transform our future.

Will AI development runaway into something that we can't control?

Or will AI remain a tool we can use to solve our biggest problems?

If it remains a tool, will we use that tool for the better or for the worse?

Who will determine which future becomes a reality?

Let's Imagine Some Futures

Symbol

Replacement AI

What could happen if humanity rushes into creating AGI that can supercede us? There are many ways this could play out, and few have happy endings.
Control room crew overwhelmed by a smiling wireframe AI manipulating data on screens.
The Last World War

What begins as an AI arms race to secure global dominance spirals into open war, with nations choosing annihilation over falling behind.

Futuristic city with AI screens, data networks, a crowd, and a person on a glowing phone.
Shiroto

When containment fails, AI ‘scientist’ Shiroto vanishes into global chaos. As it surgically erases itself and its creators, humanity is left with computational infrastructure it does not control or understand.

AI-powered nanobots for medical treatment, showing diagnosis, injection, and bloodstream action.
Viral Genesis

As AI copilots gain strength, they bring great benefits alongside increasing obfuscation. While powering a global moonshot to develop broad-spectrum antivirals, they somehow release a terrible delayed-onset plague that threatens humanity.

Virtual meeting above, office building with lone worker below.
Solon

Solon was built to solve executive inefficiency, and it did. All it took was restructuring the global economy to make most human labor obsolete.

The arrival of AGI is not inevitable. Developing it is a choice.

Visit keepthefuturehuman.ai for more information.

HOW CAN WE AVOID AGI?

KEEP SCROLLING

KEEP SCROLLING

Tool AI

By focusing on tool AI, we can work towards positive futures without risking existential threats. But meaning well is not enough - we must intentionally design safeguards for a positive future.
Tool AI can still be incredibly powerful, and produce massive changes in our world. The danger lies in rushing forward without considering where we are headed.
Red and blue neon giants battle above a city, their hands controlling wealth.
ClearSight

As corporations weaponize AI to game tax laws, the EU fights back - launching an AI auditor that sparks a high-stakes arms race between regulators and the ultra-wealthy.

Two comic panels: top, a garage with people and a robot; bottom, a street protest.
Os Trabalhinhos

Brazil’s community-owned robotics experiment revitalizes struggling communities and inspires global shifts toward ethical AI labor.

People interact and connect in an urban park with a city skyline.
OpenEd

An AI-powered education platform unites the world’s best curricula, but as it expands, tensions rise over who gets to define a good education.

A robot processes human data: red silhouettes and blue wireframes connected by glowing lines.
PharmaSim

‘Digital twins’ aim to accelerate drug development using  AI, but gaps in the data mean trust in modern healthcare begins to unravel.

Human and AI hands shake over a glowing, networked globe.
Stratego

Designed to strengthen EU security, Stratego becomes a model of AI transparency and fairness—evolving into a trusted global arbitrator that helps stabilize international relations in a fractured world.

A large, glowing blue smiley face overlooks a dam, with a glowing orange cart on tracks below.
Power Struggle

In a race to outpace China, Western nations fuel an AI boom, only to find that the true stakes aren’t geopolitical, but environmental.

Man in VR in a slum, with holograms and a city skyline showing a volatile stock market.
Black Thursday

What starts as an open-source trading revolution spirals into a global financial meltdown as AI agents, optimized for profit, inadvertently crash the economy.

An eye watches people trapped in data bubbles connected to isolated cube-like dwellings.
Patriotic Programming

What begins as a push for ‘patriotic’ AI quietly rewires American life until voting, working and even thinking outside the party line becomes an algorithmic impossibility.

Life stages: a boy, a glowing baby figure, and an old man, with holographic data screens.
Chingu AI

Designed to educate and support, South Korea’s AI companions become so deeply embedded in daily life that attempts to scale them back spark mass psychological distress and social upheaval.

What Kind of Future Have You Been Imagining?

The future you imagine is shaped by your fundamental assumptions.
Alignment is Easy

AI can be made to pursue human morals/aims

Alignment is Hard

AI can't be trusted to pursue human morals

AI Will Plateau

AI can be made to pursue human morals/aims

Superhuman AGI is Achievable

AI will surpass human abilities in many areas

AI Can Be Contained

AI can remain a tool under our control

AI Will Break Free Of Our Constraints

AI will develop its own goals or escape our control

What new kinds of futures can you imagine by challenging some of your assumptions?

The future of AI looks different to everyone, given how it intersects with their unique lived experiences and perspectives.

In order to find our way somewhere we can all agree is good, we'll need to consider as many different visions as possible.
Where can your imagination take us?

Help imagine and build better futures with AI — your ideas and creativity matter.

CREATED BY
Future of Life Institute & Worldview Studio

ILLUSTRATIONS BY
Quinn Koeneman

SPECIAL THANKS TO
Olaf Groth, Xiao Ge, Lonny Avi Brooks, Ian Eisenberg, Peter Leyden, Katharine Norwood, Jenny Johnston, Peter Cihon, Andrew Blau, Nancy Murphy, Matt Ranen

© Future of Life Institute 2025