A.I.

A

“The question of whether a computer can think is no more interesting than the question of whether a submarine can swim.” – Edsger Dijkstra

Essentials

  1. Deep Dive into LLMs like ChatGPT — Andrej Karpathy
    Video · Foundations
    An end-to-end explanation of how language models become chatbots. Watch in several sittings.

  2. Transformers, the tech behind LLMs — 3Blue1Brown
    Video + illustrated article · Foundations
    Build visual intuition for tokens, embeddings, and transformers.

  3. AI Evals: Everything You Need to Know — Hamel Husain
    Article · Product quality
    Learn how to identify failures, define good outputs, and measure whether an AI product is improving.

  4. Building Effective Agents — Anthropic
    Article · Agents
    Understand workflows versus agents and decide how much autonomy a product needs.

  5. People + AI Guidebook — Google PAIR
    Guide · Product design
    Explore user needs, expectations, feedback, and graceful handling of AI errors.

Go deeper: visual explanations and practical guides

Reading List – Papers

 

Learning Lists – Youtube

  • AI Infrastructure Explained (GPUs, vLLM, and LLM-D) – video
  • AI Product Management – Complete Course – AI Agents, RAG, Evals, LLMs.

Stanford CME295: Transformers and Large Language Models (Autumn 2025)

Taught by Afshine Amidi and Shervine Amidi · 9 lectures · Full playlist on YouTube · Course syllabus & slides

  1. Lecture 1: Transformer (1:41:58)
    Background on NLP and tasks, tokenization, embeddings, Word2vec/RNN/LSTM, attention mechanism, Transformer architecture
  2. Lecture 2: Transformer-based models & tricks (1:47:19)
    Attention approximation, MHA/MQA/GQA, position embeddings, RoPE, Transformer-based architectures, BERT and derivatives
  3. Lecture 3: Large Language Models (1:48:44)
    Definition and architecture, mixture of experts, context length and temperature, sampling, prompting and in-context learning, chain of thought, self-consistency
  4. Lecture 4: LLM training (1:47:27)
    Pretraining, quantization, hardware optimization, supervised finetuning (SFT), parameter-efficient finetuning (LoRA)
  5. Lecture 5: LLM tuning (1:47:42)
    Preference tuning, RLHF overview, reward modeling, PPO and variants, DPO
  6. Lecture 6: LLM reasoning (1:47:10)
    Reasoning models, RL for reasoning, GRPO, scaling
  7. Lecture 7: Agentic LLMs (1:49:23)
    Retrieval-augmented generation, advanced RAG, function calling, agents, ReAct framework
  8. Lecture 8: LLM evaluation (1:49:25)
    LLM-as-a-judge overview, best practices and benefits, biases and pitfalls
  9. Lecture 9: Current trends (1:51:31)
    Recap, trending topics, closing thoughts

Learning Lists – Youtube Channels

Learning lists – Courses

How transformer LLMs work – Deeplearning.ai course
Anthropic skill jar – https://anthropic.skilljar.com/
Open AI Academy – https://academy.openai.com/
Google AI – https://grow.google/ai
IBM Skill build – https://skillsbuild.org/
AWS Skill builder – https://skillbuilder.aws/category/role/decision-maker
Course Fast AI – https://course.fast.ai/
AI for Beginners (Microsoft) – https://microsoft.github.io/AI-For-Beginners/
Meta AI – https://ai.meta.com/resources/
Google “Learn AI Skills” – https://ai.google/learn-ai-skills/
IBM AI Product Manager Professional Certificate – https://www.coursera.org/professional-certificates/ibm-ai-product-manager
AI Product Management Specialization (Duke / Coursera) – https://www.coursera.org/specializations/ai-product-management-duke
Designing & Building AI Products & Services (MIT xPRO) – https://executive-ed.xpro.mit.edu/designing-building-ai-products-services

Learning lists – Books

Artificial Intelligence: A Modern Approach, Stuart Russell and Peter Norvig – https://aima.cs.berkeley.edu
Understanding Deep Learning – https://udlbook.github.io/udlbook