Skip to content

What generative AI actually is: cheatsheet

A generative language model predicts what word most likely comes next, then does it again, one word at a time, until a whole answer has poured out.

If you remember one thing: generative AI writes one word at a time, by prediction. Genuinely powerful, not a mind. Both halves are true.

FactDetail
DateNovember 30, 2022
What happenedOpenAI released ChatGPT to the public as a free website
ScaleA reported one million users within five days
What actually changedWho could touch the technology, not the technology itself
How to treat itA historical marker, like the launch of the web browser; the tools keep changing
Older AIGenerative AI
JobSorts into categories (spam or not, fraud or fine)Makes new things: memos, poems, plans, images, code
ScopeOne job eachAttempts almost any writing or thinking task
InterfaceBuilt and tuned by specialistsPlain English

Framing from the Harvard course, borrowed from a 2023 Goldman Sachs analysis: general, generative, approachable.

Behavior you will seeWhy it happens
Confident answers that are wrongIt predicts likely words; it does not look up verified facts
Different answers to the same questionIt predicts rather than retrieves; the prediction insight explains the wobble
Replies that sound like a personTrained on trillions of words of human writing
Answers pouring out word by wordThat is the machine actually working, not a typing effect
PitfallCorrection
Treating it like a search engineSearch retrieves pages that exist; a model composes new text that sounds right
Assuming it thinks like a personOne word at a time, by prediction; do not imagine feelings or intent
Deciding it is all hype after one wrong answerA tool can be flawed and still be a generational change; both at once
Waiting until you feel readyThe interface is plain language; you are already qualified
ArcLessonsQuestion
Use it well2 through 5How do I use this well?
Judge what it means6 through 9What does it mean for my world?
LineMeaning
”It’s a complicated prediction problem but it’s still really just prediction.”Sharad Goel’s one-sentence core of this lesson
”humans mimicking machines mimicking humans”Goel on the classroom exercise where students voted the next word
The admissions office is every officeEvery use question eventually becomes a fairness, privacy, and work question