Σ 0:00▸ 0:00

Appendix: Concepts and Objectives · scripted

Catalog of Concepts and Learning Objectives

How to use this catalog

This catalog lists, for each module, the concepts it teaches, the learning objectives a student should meet, and what fluency looks like: concrete things a student who has completed the module should be able to do without help. Use it to plan, to check understanding before moving on, and to decide whether a student has completed the curriculum at a satisfactory level.

The concepts appear as definitions so that teachers and students share the same vocabulary. The objectives appear as things a student does. The fluency examples are the kind of task a student should be able to sit down and do with an AI tool.

The progression

The curriculum moves through five foundational concepts. At each point, a student should be able to do everything before it.

After module The student can
1. Programming AI with Language Write a prompt that is a program, supply inputs to it, and update it.
2. Giving AI Context Identify what types of information an LLM can and cannot know from its training data, supply new information to the LLM in a prompt, understand what a hallucination is, and write rules for how the LLM should handle ambiguity, missing information, or contradictions.
3. Multimodal AI Context Use a picture as context and perform basic visual operations on image-based context.
4. Instructing AI by Example Understand example-based prompts, in-context learning, chain of thought, and style replication by example.
5. Programming AI with Personas Describe what a persona is, how a persona changes the behavior of an LLM, and how to design and use personas to guide the LLM's work.
6. Organizing & Processing Information with AI Extract, transform, and organize information in a variety of forms in order to synthesize new outputs such as outlines, tables, and analyses.

A student who can do all six has met the curriculum's outcome: building and solving sophisticated problems with large language models through prompt engineering.

Module 1: Programming AI with Language

Concepts

Learning objectives

  1. Write an instruction, in a conversation with an LLM, that tells it what to do at a future point in the conversation. Then follow up in the conversation and provide the input it needs to perform the computation.
  2. Express the logic of a program in language: the steps in order, the rules for what the LLM should do in particular situations, what it must remember between turns, and the format its responses must follow.
  3. Update a prompt-based program conversationally by sending a new or changed rule, and confirm the changed behavior by providing the same input again.
  4. Test a prompt-based program by running it, noticing where its behavior differs from what the student intended, and revising the prompt to close the gap.
  5. Apply the same approach to different kinds of input, such as numbers, passages of text, observations, topics, or the messages a player sends in a game.

Fluency looks like

Module 2: Giving AI Context

Concepts

Learning objectives

  1. Explain next-word prediction in the LLM training process, and how it leads the LLM to recognize and complete patterns using the context in the conversation.
  2. Identify what types of information an LLM can and cannot know from its training data, and supply the information it cannot know in a prompt.
  3. Understand what a hallucination is, recognize one in a response, and explain what context was missing.
  4. Write a prompt that gives the LLM a job, the input to work on, what matters about the result, and the output format, so that the result fits the student's actual situation instead of a typical one.
  5. Write rules for how the LLM should handle missing information, invalid or off-task input, ambiguity, and contradictions, so that it asks or reports instead of guessing.

Fluency looks like

Module 3: Multimodal AI Context

Concepts

Learning objectives

  1. Provide a photograph or drawing as context, together with a written instruction that says what to do with what the LLM can see.
  2. Perform each of the five visual operations on image-based context by writing the prompt for it.
  3. Choose the operation that fits a goal: an inventory calls for extract, a decision against a goal calls for interpret, a recipe from ingredients calls for transform.
  4. Write rules for what the LLM should do about anything in the picture it cannot read or see, and check any assumption it states about what is not visible.

Fluency looks like

Module 4: Instructing AI by Example

Concepts

Learning objectives

  1. Write a few-shot prompt: input and output pairs in a consistent format, followed by a new input for the LLM to complete, with no rule stated.
  2. Build a classifier for something the student sorts in their own life, find how few examples it takes, and add one example that teaches a boundary the others left out.
  3. Teach a procedure or a format by example, including one the LLM has never seen, such as a made-up language.
  4. Ask for a chain of thought with think step by step, and then design the chain with a worked example so the LLM reasons the student's way.
  5. Replicate a style from samples of writing, and refine any result by quoting what to keep and what to drop.

Fluency looks like

Module 5: Programming AI with Personas

Concepts

Learning objectives

  1. Describe what a persona is and how giving the LLM a persona changes what it notices, how it works, and what it produces.
  2. Design role-based, personality-based, and example-driven personas for the same problem, make a persona more specific, and predict how each guides the LLM's work differently.
  3. Choose the persona that should do a piece of work, and state the reason.
  4. Build a persona that acts as a system: describe the thing, its rules, its inputs, its state, and the fields of its responses. Change its rules while it is running, break it on purpose, and repair it.

Fluency looks like

Module 6: Organizing & Processing Information with AI

Concepts

Learning objectives

  1. Write an extract instruction that names the kind of pieces wanted, and apply it to notes, receipts, messages, transcripts, or articles.
  2. Write a transform instruction that names the form wanted, and check what the transform lost.
  3. Write an organize instruction that names the order or the groups, and try a second organization when the first does not answer the question.
  4. Combine all three in one instruction to synthesize a new output such as an outline, a table, a plan, or an analysis, and expand any part of it further.
  5. Identify where the LLM filled a gap from context, from training, or by invention, and add instructions that make it mark anything not in the input.

Fluency looks like

Satisfactory completion

A student has completed the curriculum at a satisfactory level when they have completed all six modules with their teacher, have turned in all six assignments with each part completed as the step asked, and can do the fluency tasks above for each module. A student who meets this standard has earned recognition, such as a Certificate of AI Foundations from the school.