Large Language Models

We’ve fine-tuned GPT-3 to more accurately answer open-ended questions using a text-based web browser.

Fine-tune with a single command.

As part of our effort to support and develop AI talent, we’re excited to announce the OpenAI Residency.

Wider availability made possible by safety progress.

We’ve trained a system that solves grade school math problems with nearly twice the accuracy of a fine-tuned GPT-3 model. It solves about 90% as many problems a

[Updated on 2022-03-13: add expert choice routing .] [U

Scaling human oversight of AI systems for tasks that are difficult to evaluate.

Today, we’re excited to announce the appointment of Helen Toner to our board of directors.

We’ve created an improved version of OpenAI Codex, our AI system that translates natural language to code, and we are releasing it through our API in private be

We’re releasing Triton 1.0, an open-source Python-like programming language which enables researchers with no CUDA experience to write highly efficient GPU code

After five years, Distill will be taking a break.

Our latest research finds we can improve language model behavior with respect to specific behavioral values by fine-tuning on a small, curated dataset.

The goal of contrastive representation learning is to learn such an embedding space in which similar sample pairs stay close to each other while dissimilar ones

We’re proud to announce that the 2021 class of OpenAI Scholars has completed our six-month mentorship program and have produced an open-source research project

Reprogramming Neural CA to exhibit novel behaviour, using adversarial attacks.

OpenAI is committed to developing general-purpose artificial intelligence that benefits all humanity, and we believe that achieving our goal requires expertise

When a neural network layer is divided into multiple branches, neurons self-organize into coherent groupings.

Weaviate v1.2 introduced support for transformers (DistilBERT, BERT, RoBERTa, Sentence-BERT, etc) to vectorize and semantically search through your data.

Over 300 applications are delivering GPT-3–powered search, conversation, text completion, and other advanced AI features through our API.

Large pretrained language models are trained over a sizable collection of online data. They unavoidably acquire certain toxic behavior

We’ve discovered neurons in CLIP that respond to the same concept whether presented literally, symbolically, or conceptually. This may explain CLIP’s accuracy i

It’s been a year of dramatic change and growth at OpenAI.

With diverse environments, we can analyze, diagnose and edit deep reinforcement learning models using attribution.

OpenAI has agreed to license GPT-3 to Microsoft for their own products and services.

A collection of articles and comments with the goal of understanding how to design robust and general purpose self-organizing systems.

Our third class of OpenAI Scholars presented their final projects at virtual Demo Day, showcasing their research results from over the past five months.

We’re excited to announce that OpenAI is co-organizing two NeurIPS 2020 competitions with AIcrowd, Carnegie Mellon University, and DeepMind, using Procgen Bench

We’re releasing an API for accessing new AI models developed by OpenAI.

[Updated on 2020-06-17: Add “exploration via disagreement” in the “Forward Dynamics” section . Exploitation versus ex

We’re releasing an analysis showing that since 2012 the amount of compute needed to train a neural net to the same performance on ImageNet classification has be