Finetune multiple cognitive tasks with GPT-3 on medical texts (and reduce hallucination)

David Shapiro · Beginner ·🧠 Large Language Models ·3y ago
The Kickstarter for my Post-Labor Economics book is live! https://www.kickstarter.com/projects/daveshap/labor-zero
Watch on YouTube ↗ (saves to browser)

Playlist

Uploads from David Shapiro · David Shapiro · 38 of 60

1 Raven MVP Demo 2021-04-02
Raven MVP Demo 2021-04-02
David Shapiro
2 Get Started with Raven AGI
Get Started with Raven AGI
David Shapiro
3 Coding Raven's Encyclopedia Service (v.1)
Coding Raven's Encyclopedia Service (v.1)
David Shapiro
4 Core Objective Functions vs Thanos Logic
Core Objective Functions vs Thanos Logic
David Shapiro
5 Raven's Core Objective Functions - Overview
Raven's Core Objective Functions - Overview
David Shapiro
6 Encyclopedia Service Demo (v.1)
Encyclopedia Service Demo (v.1)
David Shapiro
7 Indexing Wikipedia with SOLR
Indexing Wikipedia with SOLR
David Shapiro
8 Generating Training Data for Core Objective Functions
Generating Training Data for Core Objective Functions
David Shapiro
9 Raven Context Augmentation Demo
Raven Context Augmentation Demo
David Shapiro
10 Parsing Wikipedia to Plaintext Faster!
Parsing Wikipedia to Plaintext Faster!
David Shapiro
11 Prototype AGI demo - Natural Language Cognitive Architecture "NLCA" running on GPT-3
Prototype AGI demo - Natural Language Cognitive Architecture "NLCA" running on GPT-3
David Shapiro
12 Raven Release 1 Deep Dive
Raven Release 1 Deep Dive
David Shapiro
13 NLCA Question Generator demo
NLCA Question Generator demo
David Shapiro
14 Fine-tuning GPT-3 to generate questions about anything
Fine-tuning GPT-3 to generate questions about anything
David Shapiro
15 Fine-tuning GPT-3 for benevolent and trustworthy AGI
Fine-tuning GPT-3 for benevolent and trustworthy AGI
David Shapiro
16 GPT3 & Finetuning the Core Objective Functions - a deep dive
GPT3 & Finetuning the Core Objective Functions - a deep dive
David Shapiro
17 I'm moving away from Artificial General Intelligence and towards Artificial Cognition. Here's why.
I'm moving away from Artificial General Intelligence and towards Artificial Cognition. Here's why.
David Shapiro
18 Implementing Natural Language Cognitive Architecture with GPT-3 and the "nexus" concept
Implementing Natural Language Cognitive Architecture with GPT-3 and the "nexus" concept
David Shapiro
19 Reading "Benevolent by Design" - Introduction
Reading "Benevolent by Design" - Introduction
David Shapiro
20 5 Tips and Misconceptions about Finetuning GPT-3
5 Tips and Misconceptions about Finetuning GPT-3
David Shapiro
21 How to create synthetic datasets with GPT-3
How to create synthetic datasets with GPT-3
David Shapiro
22 What is a heuristic imperative? What imperatives should we give AGI?
What is a heuristic imperative? What imperatives should we give AGI?
David Shapiro
23 Talking Philosophy with GPT-3
Talking Philosophy with GPT-3
David Shapiro
24 Talking Boundaries and Consent with GPT-3
Talking Boundaries and Consent with GPT-3
David Shapiro
25 Convergence and acceleration towards AGI (or Artificial Cognitive Entities)
Convergence and acceleration towards AGI (or Artificial Cognitive Entities)
David Shapiro
26 GPT-3 for Writing Dialog
GPT-3 for Writing Dialog
David Shapiro
27 Co-writing flash fiction with GPT-3
Co-writing flash fiction with GPT-3
David Shapiro
28 From zero to finetuned model in 1 hour with GPT-3. Generate a movie script from any premise!
From zero to finetuned model in 1 hour with GPT-3. Generate a movie script from any premise!
David Shapiro
29 GPT-3 Working Session: Finetune an information companion chatbot in 30 minutes (RESEARCH ONLY)
GPT-3 Working Session: Finetune an information companion chatbot in 30 minutes (RESEARCH ONLY)
David Shapiro
30 What is "toxic stoicism"? Talking philosophy with GPT-3
What is "toxic stoicism"? Talking philosophy with GPT-3
David Shapiro
31 3 Predictions for the future of AI jobs
3 Predictions for the future of AI jobs
David Shapiro
32 Billion-dollar GPT-3 startup! Fix education with an expert tutor chatbot!
Billion-dollar GPT-3 startup! Fix education with an expert tutor chatbot!
David Shapiro
33 Finetune GPT-3 to write an entire coherent novel (part 1)
Finetune GPT-3 to write an entire coherent novel (part 1)
David Shapiro
34 Concepts in Neuroscience and Cognition - Deficits of GPT-3 and the path to AGI and ACE
Concepts in Neuroscience and Cognition - Deficits of GPT-3 and the path to AGI and ACE
David Shapiro
35 Finetuning GPT-3 to be a master tutor that can handle any topic and hostile students
Finetuning GPT-3 to be a master tutor that can handle any topic and hostile students
David Shapiro
36 Testing "Theory of Mind" in GPT-3 - making fully aligned ACOG (Artificial Cognitive Entities)
Testing "Theory of Mind" in GPT-3 - making fully aligned ACOG (Artificial Cognitive Entities)
David Shapiro
37 Finetune GPT-3 to write an entire coherent novel (part 2)
Finetune GPT-3 to write an entire coherent novel (part 2)
David Shapiro
Finetune multiple cognitive tasks with GPT-3 on medical texts (and reduce hallucination)
Finetune multiple cognitive tasks with GPT-3 on medical texts (and reduce hallucination)
David Shapiro
39 Let's build an ACOG (artificial cognitive entity) - Part 1
Let's build an ACOG (artificial cognitive entity) - Part 1
David Shapiro
40 Finetune GPT-3 to write a novel - Part 3 (IT WORKS!!!) ...at least a little bit
Finetune GPT-3 to write a novel - Part 3 (IT WORKS!!!) ...at least a little bit
David Shapiro
41 How will we know when we've invented AGI? How will we know it is complete?
How will we know when we've invented AGI? How will we know it is complete?
David Shapiro
42 Let's build an ACOG (artificial cognitive entity) - Part 2
Let's build an ACOG (artificial cognitive entity) - Part 2
David Shapiro
43 Finetuning a Creative Writing Coach in GPT-3 - Part 1
Finetuning a Creative Writing Coach in GPT-3 - Part 1
David Shapiro
44 Finetune GPT-3 to write a coherent novel - Part 4 (success! with minor bugs...)
Finetune GPT-3 to write a coherent novel - Part 4 (success! with minor bugs...)
David Shapiro
45 Recursively summarize text of any length with GPT-3
Recursively summarize text of any length with GPT-3
David Shapiro
46 Let's build an ACOG (artificial cognitive entity) - Part 3
Let's build an ACOG (artificial cognitive entity) - Part 3
David Shapiro
47 Decreasingly Verbose "Alice in Wonderland" - down to 55 characters!
Decreasingly Verbose "Alice in Wonderland" - down to 55 characters!
David Shapiro
48 Finetuning a Creative Writing Coach in GPT-3 - Part 2
Finetuning a Creative Writing Coach in GPT-3 - Part 2
David Shapiro
49 Increasingly Verbose Bot with GPT-3 - Expand any word or phrase into a whole paragraph
Increasingly Verbose Bot with GPT-3 - Expand any word or phrase into a whole paragraph
David Shapiro
50 Metaprompting with GPT-3 to dynamically generate arguments
Metaprompting with GPT-3 to dynamically generate arguments
David Shapiro
51 I'm taking a short break from research and YouTube
I'm taking a short break from research and YouTube
David Shapiro
52 Are LaMDA or GPT-3 sentient? No, but...
Are LaMDA or GPT-3 sentient? No, but...
David Shapiro
53 Can GPT-3 generate training data? Short answer? Yes! Here's why that's a legit methodology...
Can GPT-3 generate training data? Short answer? Yes! Here's why that's a legit methodology...
David Shapiro
54 DALLE2 Style Tags Tutorial - "Elven archer in a sunny forest" with different tags
DALLE2 Style Tags Tutorial - "Elven archer in a sunny forest" with different tags
David Shapiro
55 Could a machine ever be fully sentient or conscious? A deep dive on philosophy, quantum mechanics...
Could a machine ever be fully sentient or conscious? A deep dive on philosophy, quantum mechanics...
David Shapiro
56 Many of you have asked for it: Join my new research Discord! Link in description
Many of you have asked for it: Join my new research Discord! Link in description
David Shapiro
57 Answer complex questions from an arbitrarily large set of documents with vector search and GPT-3
Answer complex questions from an arbitrarily large set of documents with vector search and GPT-3
David Shapiro
58 Organizing Discord with threads, plus community rules and the upcoming Cognitive AI Lab podcast!
Organizing Discord with threads, plus community rules and the upcoming Cognitive AI Lab podcast!
David Shapiro
59 Let's build an ACOG (artificial cognitive entity) - Part 4
Let's build an ACOG (artificial cognitive entity) - Part 4
David Shapiro
60 Fixing "goldfish memory" with GPT-3 and external sources of information in a chatbot - part 1
Fixing "goldfish memory" with GPT-3 and external sources of information in a chatbot - part 1
David Shapiro
5 Levels of AI Agents - From Simple LLM Calls to Multi-Agent Systems
Next Up
5 Levels of AI Agents - From Simple LLM Calls to Multi-Agent Systems
Dave Ebbelaar (LLM Eng)