Course curriculum

  • 1

    Khái quát về khóa học

    • Lời chào từ đội ngũ VietAI

    • Các nguồn tự học bổ ích

    • Nội quy lớp học

    • Phương thức học

  • 2

    Tuần 1: NLP basics review

    • Khai giảng NLP20203 (26/03)

      FREE PREVIEW
    • Slide lý thuyết

    • Record Khai giảng + Lý thuyết tuần 1 (26/03)

    • Quiz 1.1

    • Chat Text Buổi 1

    • Record buổi thực hành tuần 1 (30/03)

    • [Coding 1.1] Intro to Hugging Face ecosystem

    • [Coding 1.2] Statistical-based Language Model

    • Quiz 1.2

  • 3

    Tuần 2: Attention mechanism and Transformer

    • Slide 2.1: Attention and Transformer (02/04)

    • Record 2.1: Bài giảng Attention and Transformer (02/04)

    • [Coding 2.1] 🤗 Datasets

    • [Coding 2.2] Text Summarization

    • [Quiz 2.1] Attention and Transformer

    • Record 2.2: Bài giảng thực hành Huggingface Datasets và Text Summarization

    • [Quiz 2.2] Huggingface Datasets và Text Summarization

  • 4

    Tuần 3: Encoder-based Transformers architecture BERT and applications

    • Introduction to BERT and its Family (09/04)

    • [Quiz 3.1] BERT & Its Family

    • BERT-Week3.pptx

    • Record 3.1: Bài giảng BERT and its Family (09/04)

    • [Coding 3.1] Training RoBERTa model with HuggingFace

    • Record 3.2: Bài giảng Training RoBERTa model with HuggingFace

  • 5

    Tuần 4: Decoder-based Transformers architecture

    • Slide 4.1: Slide về mô hình GPT

    • Record 4.1: Bài giảng về mô hình GPT

    • Assignment 1: Neural Machine Translation

    • [Coding 4.1] GPT from scratch

    • Record 4.2: GPT from scratch

    • [Quiz 4.1:] GPT

    • [Quiz 4.2] GPT from scratch

  • 6

    Tuần 5: Encoder-Decoder based Transformers architecture

    • [Record 5.1] Review giữa khoá

    • [Slide 5.2] T5 & Variants Introduction

    • [Record 5.2] Bài giảng T5 & Variant Introduction

    • [Slide 5.3] Evaluate & Accelerate

    • [Records 5.4] Thực hành Evaluate & Accelerate

    • [Quiz 5.1] T5 & Variants

    • [Quiz 5.2] Evaluate & Accelerate

  • 7

    Tuần 6: Advanced training techniques

    • [ 6.1 Slide] Advanced training techniques

    • [6.2 Record] Advances training techniques

    • [6.3 Source Code] File Code Distributed Training

    • Assignment 2: Lora with Advanced Training Techniques

    • [6.4 Record] Advances training technique

    • [Quiz 6.1] Advances training techniques

    • [Quiz 6.2] Coding Advances training techniques

    • [Solution] Assignment 2: Lora with Advanced Training Techniques

  • 8

    Tuần 7: Deploy NLP models in production

    • Deploy NLP models in production

    • Record 7.1: Bài giảng Deploy NLP models in production

    • Quiz 7.1: Deploy NLP models in production

    • Record 7.2: Guest lecture

    • Record 7.3: Tổng kết