skills · Retrieval-augmented generation
RAG Fundamentals
Retrieval on your own documents, measured.
Al terminar, podrás:
- A test set written before the system
- A baseline that each later change is compared with
- Keyword, embedding, hybrid and reranked search compared on your set
- Answers that cite their chunks, and a fixed reply when the answer is not found
- A planted-instruction test
- A ship note with numbers, failures and cost
Desde $9/mes7,5 horas5 capítulos20 lecciones
Por ahora, los cursos están en inglés.
“The model does not know your documents.”
Sobre este curso
Para quién es
- You write basic Python and want to build a working tool around a language model, not only call one
- You have documents (course notes, a project's docs, a handbook) you want to ask questions of, and want answers you can check
- You have seen a chat assistant answer confidently and wrongly, and want to know how much retrieval fixes
Lo que necesitas
- Basic Python and a terminal
- No machine learning background, no GPU
Habilidades que practicarás
- Retrieval-augmented generation
- BM25
- Embeddings
- Hybrid search
- Reranking
- Prompt assembly
- Retrieval evaluation
- Prompt injection testing
Cuánto tiempo lleva
Unas 7,5 horas en total
- Capítulo 1 · The model does not know your documents1,5 horas
- Capítulo 2 · Getting documents in1,5 horas
- Capítulo 3 · Search by meaning, and when it misses1,5 horas
- Capítulo 4 · Answers you can check1,5 horas
- Capítulo 5 · Evaluate, decide, ship1,5 horas
Qué incluye
- 20 lecciones
- 86 lecturas
- 20 ejemplos resueltos
- 40 ejercicios
- 40 comprobaciones rápidas
- 20 mitos comunes
- 20 cuestionarios
- 5 controles de fin de capítulo
Plan de estudios
5 capítulos, 20 lecciones
El curso completo: cada capítulo y lección. Toca un capítulo para expandirlo. Las lecciones se abren al empezar.
Carrera
Adónde puede llevarte este curso
Los roles con los que se relaciona este curso y las habilidades que podrás incluir en tu currículum y en LinkedIn cuando lo termines.
Habilidades que desarrollarás
Listas para pegar en tu currículum o en tu perfil de LinkedIn cuando termines el curso.
- Scoping a retrieval-augmented generation problemExplain what retrieval-augmented generation does and does not fix
- Writing a retrieval test setBuild evaluation datasets for search and retrieval
- Building a keyword-search retrieval pipeline in PythonImplement document chunking and BM25 search in Python
- Measuring retrieval with hit rate and MRREvaluate retrieval quality with hit rate at k and mean reciprocal rank
- Inspecting and cleaning extracted document textBuild document loaders for HTML, PDF and plain text
- Choosing chunk size and overlap by measurementTune document chunking parameters against an evaluation set
- Structure-aware chunking with context headersSplit documents by section and add contextual headers to chunks
- Using document metadata for versioning and dated sourcesExtract and use document metadata for filtering in retrieval
- Implementing embedding-based searchImplement semantic search with sentence embeddings and cosine similarity
- Comparing retrieval methods on a test setCompare keyword and dense retrieval question by question on an evaluation set
- Hybrid search with reciprocal rank fusionCombine keyword and dense retrieval with reciprocal rank fusion
- Reranking with a cross-encoder and measuring latencyAdd a cross-encoder reranking stage to a retrieval pipeline
- Prompting for cited answers and a fixed not-found replyDesign prompts that require source citations for each statement
- Choosing context size from measured answersTune the number of retrieved passages against answer quality
- Testing a retrieval pipeline for indirect prompt injectionTreat retrieved content as untrusted input
- Checking generated answers against their sourcesEvaluate answer faithfulness claim by claim against retrieved context
- Diagnosing failures in a retrieval-augmented generation pipelinePerform error analysis on RAG system outputs
- Measuring the cost and latency of a model-backed pipelineMeasure token usage, cost per request and latency by stage
- Choosing between retrieval, long context, structured queries and promptingAssess whether retrieval-augmented generation fits a use case
- Reporting evaluation results and limitsDocument system performance, failure modes, cost and limitations
Preguntas
Antes de comprometerte
Empieza hoy