Skip to content
All tool news

Tool desk · Updated daily

Tool news·ChatGPT·

ChatGPT Releases FrontierScience Benchmark to Test AI on PhD-Level Scientific Reasoning.

OpenAI launches FrontierScience, a new benchmark to evaluate AI models on expert-level scientific reasoning across physics, chemistry, and biology.

CW

Create With tool desk

1 source checked · 2 min read · 2 sections

ShareLinkedIn

OpenAI has released FrontierScience, a new benchmark designed to test AI models on expert-level scientific reasoning across physics, chemistry, and biology. The evaluation suite features PhD-level questions crafted by domain experts, including both olympiad-style problems and extended research tasks that aim to reveal the true capabilities and limitations of AI systems in scientific contexts.

The benchmark arrives as OpenAI continues positioning its models for scientific research applications, following their recent work on extending reasoning models beyond chat interfaces. The company announced the release on LinkedIn, emphasizing that accelerating scientific progress represents one of AI's most impactful potential contributions to society.

Testing Real Scientific Workflows

Unlike conventional AI evaluations that focus on general knowledge or basic problem-solving, FrontierScience is grounded in the kind of reasoning required in actual research environments. The benchmark includes questions that demand deep domain expertise, multi-step reasoning, and the ability to navigate complex scientific concepts.

OpenAI's approach recognizes a critical gap in AI evaluation: existing benchmarks often fail to capture how models perform on the challenging, nuanced problems that working scientists face daily. By including both tightly defined olympiad-style questions and open-ended research tasks, FrontierScience aims to stress-test models in ways that mirror real scientific inquiry.

The benchmark's structure allows researchers to identify specific failure modes. A model might excel at structured problem-solving but struggle with the ambiguity inherent in research questions, or vice versa. This granular feedback loop is essential for improving AI systems that aim to support scientific discovery.

Why Scientific Reasoning Matters for AI Development

The release reflects OpenAI's broader strategy of developing AI systems capable of expert-level reasoning in specialized domains. Scientific research presents unique challenges: hypotheses must be tested against experimental data, edge cases matter enormously, and conclusions require rigorous logical chains that can't skip steps.

For small business owners and builders exploring AI tools, the implications extend beyond academic research. The same reasoning capabilities needed to solve complex chemistry problems could eventually power better decision-making tools, more sophisticated data analysis, and AI systems that can tackle domain-specific challenges in fields like materials science, drug discovery, or engineering.

OpenAI has made the FrontierScience benchmark publicly available to encourage broader research into scientific AI capabilities. The move aligns with the company's pattern of releasing evaluation tools alongside model improvements, giving the research community shared metrics to measure progress.

The benchmark's focus on revealing where models fall short is particularly noteworthy. Rather than simply showcasing capabilities, OpenAI is explicitly designing evaluations to expose weaknesses, a necessary step for building more reliable AI systems for high-stakes applications like scientific research.

As AI models continue advancing, benchmarks like FrontierScience will play a crucial role in ensuring that progress translates to real-world utility in specialized domains. For researchers and developers working with tools like Claude or Gemini, the availability of rigorous scientific reasoning benchmarks provides a clearer picture of which models are genuinely capable of handling expert-level work versus those that simply perform well on general tasks.

Sources

1 checked

How we cover tool news: Create With's tool desk drafts these reports with AI from the sources listed above and checks them against those sources before publishing.

Worth passing on?

ShareLinkedIn

Go deeper on ChatGPT

Related reading, watching and going.

Everything on ChatGPT →

The briefing

21 Oct 2026

Stop Asking AI — Build Reusable Scripts to Save Tokens

Discover why asking AI to write small reusable scripts — not one-off replies — saves tokens, improves accuracy and privacy, and makes tools easy to reuse.

Read →

The briefing

13 Oct 2026

Jev - The System One AI That Never Writes a Word, Explained

Deep dive into Jev - TypeSafe's 'System One' model that outputs decisions, not text. Read how it works, real demos (driving), what it's good for and its limits.

Read →

The briefing

30 Sept 2026

Solo Consultant's AI Operating System Built on Markdown

London solo consultant uses an AI personal OS of markdown files—saving ~45% delivery time, boosting revenue 2.4×, and powering 33 community events for ~£250/mo.

Read →
36 min

Podcast

55. We're Back! Conference Recap, Running Events with AI & Self-Healing Apps

James and Kieran return to the Create With Podcast after their summer break to recap the 2026 Create With Conference in Brighton. They discuss how 550 attendees experienced workshops, a charity hackathon where functional apps were built in 30 minutes, and an innovative conference operating system built entirely with AI. The episode covers the latest developments in AI development tools including Anthropic's Fable model, scheduled tasks in Codex, and self-healing applications using PostHog.

Watch now ↗
31 min

Conference

How to Get Your Product Recommended by Google and ChatGPT

Tanya Van Gastel presents the APEX framework for making products discoverable in AI-powered search engines like ChatGPT and Google's AI Overviews. She explains how AI is fundamentally changing product discovery and buyer behavior, then breaks down five critical components: Authority (being cited as a solution), Presence (visibility across search platforms), Expertise (creating high-quality money pages), Endorsements (off-site validation), and Extractability (making content easy for AI to process). The talk emphasizes quality over quantity, with data showing 50% of SaaS SEO revenue comes from fewer than 10 high-performing pages.

Watch now ↗
35 min

Conference

The AI-Native Solopreneur: Build Without a Technical Co-Founder

Effie Bersoux presents a paradigm shift in entrepreneurship where AI enables solo founders to build, validate, and scale businesses without technical co-founders or significant capital. Drawing from Growth Girls' experience building 40+ companies in one year and going from a £4m exit (7 years) to a £40m acquisition target (1 year), she demonstrates how AI breaks the traditional capital-talent-traction loop that disadvantages undercapitalized founders. The talk provides concrete frameworks for AI-native operating models, automation decision-making, and rapid idea-to-market validation.

Watch now ↗

Latest tool news

What else changed this week.

All tool news
VercelDigest

What Vercel Shipped in Late October

Vercel shipped quicker static deployments, four AI Gateway models, more free domain choices and new CLI controls in late October. The changes cover developers testing sites…

Vercel

Vercel Adds Submit_feedback to Its MCP

submitfeedback is a new Vercel MCP tool that lets agents and harnesses send bug reports, friction reports and feature requests directly to the Vercel team. Feedback can include…

The Create With Briefing

Don't watch forty changelogs. Read one email.

Every Tuesday: the tool changes worth knowing, real business use cases, and what's on near you. Free, unsubscribe any time.