Course curriculum
-
1
Khái quát về khóa học
-
Lời chào từ đội ngũ VietAI
-
Các nguồn tự học bổ ích
-
Nội quy lớp học
-
Phương thức học
-
-
2
Tuần 1: NLP basics review
-
Khai giảng NLP20203 (26/03)
FREE PREVIEW -
Slide lý thuyết
-
Record Khai giảng + Lý thuyết tuần 1 (26/03)
-
Quiz 1.1
-
Chat Text Buổi 1
-
Record buổi thực hành tuần 1 (30/03)
-
[Coding 1.1] Intro to Hugging Face ecosystem
-
[Coding 1.2] Statistical-based Language Model
-
Quiz 1.2
-
-
3
Tuần 2: Attention mechanism and Transformer
-
Slide 2.1: Attention and Transformer (02/04)
-
Record 2.1: Bài giảng Attention and Transformer (02/04)
-
[Coding 2.1] 🤗 Datasets
-
[Coding 2.2] Text Summarization
-
[Quiz 2.1] Attention and Transformer
-
Record 2.2: Bài giảng thực hành Huggingface Datasets và Text Summarization
-
[Quiz 2.2] Huggingface Datasets và Text Summarization
-
-
4
Tuần 3: Encoder-based Transformers architecture BERT and applications
-
Introduction to BERT and its Family (09/04)
-
[Quiz 3.1] BERT & Its Family
-
BERT-Week3.pptx
-
Record 3.1: Bài giảng BERT and its Family (09/04)
-
[Coding 3.1] Training RoBERTa model with HuggingFace
-
Record 3.2: Bài giảng Training RoBERTa model with HuggingFace
-
-
5
Tuần 4: Decoder-based Transformers architecture
-
Slide 4.1: Slide về mô hình GPT
-
Record 4.1: Bài giảng về mô hình GPT
-
Assignment 1: Neural Machine Translation
-
[Coding 4.1] GPT from scratch
-
Record 4.2: GPT from scratch
-
[Quiz 4.1:] GPT
-
[Quiz 4.2] GPT from scratch
-
-
6
Tuần 5: Encoder-Decoder based Transformers architecture
-
[Record 5.1] Review giữa khoá
-
[Slide 5.2] T5 & Variants Introduction
-
[Record 5.2] Bài giảng T5 & Variant Introduction
-
[Slide 5.3] Evaluate & Accelerate
-
[Records 5.4] Thực hành Evaluate & Accelerate
-
[Quiz 5.1] T5 & Variants
-
[Quiz 5.2] Evaluate & Accelerate
-
-
7
Tuần 6: Advanced training techniques
-
[ 6.1 Slide] Advanced training techniques
-
[6.2 Record] Advances training techniques
-
[6.3 Source Code] File Code Distributed Training
-
Assignment 2: Lora with Advanced Training Techniques
-
[6.4 Record] Advances training technique
-
[Quiz 6.1] Advances training techniques
-
[Quiz 6.2] Coding Advances training techniques
-
[Solution] Assignment 2: Lora with Advanced Training Techniques
-
-
8
Tuần 7: Deploy NLP models in production
-
Deploy NLP models in production
-
Record 7.1: Bài giảng Deploy NLP models in production
-
Quiz 7.1: Deploy NLP models in production
-
Record 7.2: Guest lecture
-
Record 7.3: Tổng kết
-