What you build in Part 2
One production AI application, built stage by stage.
Start with a real business case and grow the same application each week. By the final class, you can demonstrate the code, cloud deployment, evaluation evidence, and operating guide.
01Week 2Streaming LLM web app
Ask a question in the browser and watch the model answer appear. Handle slow calls, empty input, errors, and usage.
02Week 3Searchable knowledge base
Turn approved documents into versioned passages. Compare keyword, vector, and hybrid search in Weaviate.
03Week 4Agentic RAG assistant
Route a question to retrieval, answer from permitted evidence, show a citation, and abstain when sources cannot support a claim.
04Week 4Voice experience
Let a buyer ask aloud and hear a grounded answer while keeping the existing text and retrieval paths working.
05Weeks 5–6Secure business tools
Check only the buyer’s orders in PostgreSQL and trace recalled supplier lots through a knowledge graph.
06Week 7Operated cloud system
Release tested images, inspect traces and alerts, recover from backup, and demonstrate the stack on AWS or Azure.
AI application layerPython, FastAPI, LLM APIs, structured outputs, and agent tools.
Grounded knowledgeEmbeddings, vector search, RAG, Weaviate, and retrieval evaluation.
Business dataPostgreSQL, authorization, human handoff, knowledge graphs, and graph queries.
Realtime experienceBrowser audio, transcription, speech output, and voice interaction.
Cloud deliveryDocker Compose, GitHub Actions, Terraform, and AWS or Azure.
LLMOpsTracing, evaluations, metrics, dashboards, backup, and recovery.