TTTK2313 ARTIFICIAL INTELLIGENCE · MODULE 2
From next-token prediction to agents, deepfakes and the law: the 2026 edition.
Ts. Dr. Mohd Nor Akmal Khalid
Center for Artificial Intelligence Technology (CAIT), FTSM, UKM
Semester 1 · Session 2026/2027
Acknowledgement: this deck builds on the original M2 Generative AI materials developed by Prof. Dr. Siti Norul Huda Sheikh Abdullah, Dr. Afzan Adam and Dr. Anahita Ghazvini.
Photo: Bruce Poon, CC BY-SA 4.0, via Wikimedia Commons
Roadmap · 12 parts, 6 acts
01
History
02
How LLMs Work
03
Training & Alignment
04
Diffusion & Multimodal
05
Reasoning & Agents
06
Evaluation & Benchmarks
07
Validation & Hallucination
08
Applications
09
Deepfakes & Detection
10
Work, Learning, Planet, Law
11
Governance
12
Future
■ ACT 1 · FOUNDATIONS
■ ACT 2–3 · GENERATION & AGENCY
■ ACT 4 · TRUST
■ ACT 5–6 · SOCIETY
■ Light Deep dive slides (16) hold the formulas, runnable code, architectures and sources for self-study after class.
TTTK2313 · M2 GENERATIVE AI · ROADMAP
STANFORD AI INDEX 2026
53%
of the world’s population adopted generative AI within three years.
For comparison, PCs took about 15 years and the internet about 7 years to reach a similar level.
4 in 5 US high-school and college students now use AI for schoolwork.
TTTK2313 · M2 GENERATIVE AI · WHY THIS MATTERS
ACT 1 · FOUNDATIONS
01 History
02 How LLMs Work
03 Training & Alignment
TTTK2313 · M2 GENERATIVE AI · ACT 1
01 · History
1966
ELIZA
Rule-based chatbot; people still confided in it
2014
GAN
Generator vs discriminator in a game
2017
Transformer
“Attention Is All You Need”
2020
GPT-3 · DDPM
Scale for text, diffusion for images
2022
ChatGPT
Instruction-tuned chat goes mainstream
2024
Reasoning
Models that “think” before answering
2025
Open reasoning
DeepSeek-R1, coding agents, MCP spreads
2026
Long-horizon agents
Agents work for hours on end
TTTK2313 · M2 GENERATIVE AI · 01 HISTORY
02 · How LLMs work
learns P(y | x)
“Is this a kucing or an anjing?” Draws a boundary and outputs a label, class or score.
learns P(x) or P(x, y)
“Draw me a kucing.” Models the whole data distribution, then samples new data: text, images, audio.
TTTK2313 · M2 GENERATIVE AI · 02 HOW LLMS WORK
02 · How LLMs work
Models never see letters or words. They see token IDs: sub-word pieces from a fixed vocabulary of tens of thousands to about 260k entries.
Languages that are less common in the training data are usually split into more tokens, so the same meaning costs more compute and money.
DID YOU KNOW?
This is why some chatbots famously miscounted the letter “r” in strawberry: they see tokens, not letters.
TTTK2313 · M2 GENERATIVE AI · 02 HOW LLMS WORK
Deep dive · self-study · 02 Tokenization
FORMULATION
V₀ = all single characters (or bytes)
(a, b)* = argmax count(a, b)
Vₖ₊₁ = Vₖ ∪ {ab} until |V| = target
Count adjacent pairs in the corpus; merge the most frequent pair into one new token; repeat. GPT-4o’s vocabulary ≈ 200k tokens.
STEPS
PYTHON · RUNS AS-IS
from collections import Counter
def merge(w, a, b):
out, i = [], 0
while i < len(w):
if w[i:i + 2] == [a, b]: out.append(a + b); i += 2
else: out.append(w[i]); i += 1
return out
corpus = "makan makanan dimakan minum".split()
words = [list(w) for w in corpus]
for step in range(1, 5):
pairs = Counter(p for w in words for p in zip(w, w[1:]))
(a, b), n = pairs.most_common(1)[0]
words = [merge(w, a, b) for w in words]
print(step, a + b, n, words[1]) # watch "makanan"
OUTPUT
1 an 4 ['m', 'a', 'k', 'an', 'an']
2 ma 3 ['ma', 'k', 'an', 'an']
3 mak 3 ['mak', 'an', 'an']
4 makan 3 ['makan', 'an']
Sources: Sennrich, Haddow & Birch (2016), Neural machine translation of rare words with subword units, ACL · OpenAI tiktoken (o200k_base vocabulary).
TTTK2313 · M2 GENERATIVE AI · DEEP DIVE · SELF-STUDY
02 · How LLMs work
king − man + woman = ?
Searching all 343k words in the vocabulary, the nearest answer (after the input words) is queen.
Each word becomes 300 numbers. Similar meanings land close; royalty sits apart from everyday people.
Try it live ▸ projector.tensorflow.org
Real data: spaCy en_core_web_lg vectors, t-SNE to 2-D.
● people ● food ● animals ● countries ● computing
TTTK2313 · M2 GENERATIVE AI · 02 HOW LLMS WORK
Deep dive · self-study · 02 Embeddings
FORMULATION
cos(u, v) = u·v / (‖u‖ ‖v‖) ∈ [−1, 1]
v(king) − v(man) + v(woman) ≈ v(queen)
Each word is a point in ℝ³⁰⁰. Cosine ≈ 1: same direction (similar meaning); ≈ 0: unrelated. Differences between vectors capture relations such as gender or tense.
STEPS
PYTHON · RUNS AS-IS
import spacy, numpy as np
nlp = spacy.load("en_core_web_lg") # 300-d word vectors
v = lambda w: nlp.vocab[w].vector
def cos(a, b):
return a @ b / (np.linalg.norm(a) * np.linalg.norm(b))
print(f"{cos(v('king'), v('queen')):.2f}") # similar
print(f"{cos(v('king'), v('banana')):.2f}") # unrelated
t = v("king") - v("man") + v("woman")
ids, _, _ = nlp.vocab.vectors.most_similar(t[None], n=10)
out = [nlp.vocab.strings[i].lower() for i in ids[0]]
print([w for w in dict.fromkeys(out)
if w not in {"king", "man", "woman"}][:3])
OUTPUT
0.73
0.22
['queen', 'prince', 'kings']
Sources: Mikolov et al. (2013), Efficient estimation of word representations in vector space, arXiv:1301.3781 · spaCy en_core_web_lg (GloVe-style vectors).
TTTK2313 · M2 GENERATIVE AI · DEEP DIVE · SELF-STUDY
02 · How LLMs work
Ali
memberi
buku
kepada
Siti
kerana
dia
rajin.
0.62
0.18
0.08
0.07
Illustrative weights
Every token asks every other token “how relevant are you to me?”, then blends their information. All tokens are processed in parallel, which is why Transformers scale.
softmax(QKᵀ / √d) · V
Query · Key = relevance; Value = content
Try it live ▸ moebio.com/attention
TTTK2313 · M2 GENERATIVE AI · 02 HOW LLMS WORK
Deep dive · self-study · 02 Attention
FORMULATION
Q = XW_q, K = XW_k, V = XW_v
Attention = softmax(QKᵀ / √dₖ + M) · V
MultiHead = [head₁ ‖ … ‖ headₕ] · W_o
X: T×d token vectors. QKᵀ scores how relevant each token is to every other; dividing by √dₖ keeps the softmax from saturating; mask M = −∞ above the diagonal stops a token seeing the future; each row of weights sums to 1.
STEPS
PYTHON · RUNS AS-IS
import numpy as np
rng = np.random.default_rng(0)
T, d = 4, 8 # 4 tokens, 8-dim
X = rng.normal(size=(T, d)) # token vectors
Wq, Wk, Wv = (rng.normal(size=(d, d)) for _ in range(3))
Q, K, V = X @ Wq, X @ Wk, X @ Wv
S = Q @ K.T / np.sqrt(d) # relevance scores
S += np.triu(np.full((T, T), -np.inf), 1) # causal mask
A = np.exp(S - S.max(1, keepdims=True))
A = A / A.sum(1, keepdims=True) # softmax per row
out = A @ V # blend values
print(A.round(2)[-1], out.shape) # last token's weights
OUTPUT
[0.05 0.35 0.04 0.56] (4, 8)
Sources: Vaswani et al. (2017), Attention is all you need, NeurIPS · Alammar (2018), The Illustrated Transformer.
TTTK2313 · M2 GENERATIVE AI · DEEP DIVE · SELF-STUDY
Deep dive · self-study · 02 Architecture
FORMULATION
params ≈ 12 · L · d² + V · d
GPT-2 small: L = 12, d = 768, V = 50 257
12·12·768² ≈ 85 M + 38.6 M ≈ 124 M
Per block: attention 4d² (W_q, W_k, W_v, W_o) + MLP 8d² (d → 4d → d). Biases, norms and the 1024×768 position table (≈0.8 M) are left out.
STEPS
Sources: Vaswani et al. (2017), NeurIPS · Radford et al. (2019), Language models are unsupervised multitask learners (GPT-2), OpenAI.
TTTK2313 · M2 GENERATIVE AI · DEEP DIVE · SELF-STUDY
02 · How LLMs work
The model outputs a probability for every token in its vocabulary. One is sampled, appended, and the loop runs again: that is autoregressive generation.
Temperature controls how adventurous the sampling is. Low = predictable. High = creative but error-prone.
Note: images are not made token-by-token like this. They come from diffusion (Part 04).
TTTK2313 · M2 GENERATIVE AI · 02 HOW LLMS WORK
Deep dive · self-study · 02 Generation
FORMULATION
P(x₁ … x_T) = ∏ₜ P(xₜ | x₍<ₜ₎)
pᵢ = exp(zᵢ / τ) / Σⱼ exp(zⱼ / τ)
ℒ = −(1/T) Σₜ log P(xₜ | x₍<ₜ₎), PPL = eᴸ
z: the model’s raw scores (logits) for every vocabulary entry. τ < 1 sharpens, τ > 1 flattens. Top-p keeps the smallest set of tokens whose probability adds up to at least p. Training minimises the cross-entropy ℒ.
STEPS
PYTHON · RUNS AS-IS
import numpy as np
vocab = ["rajin", "pandai", "baik", "malas", "lapar"]
z = np.array([3.0, 2.2, 1.5, 0.5, -1.0]) # logits
rng = np.random.default_rng(1)
def probs(z, tau): # softmax(z / tau)
p = np.exp(z / tau); return p / p.sum()
def top_p(p, keep=0.9):
idx = np.argsort(p)[::-1] # likeliest first
cut = np.searchsorted(np.cumsum(p[idx]), keep) + 1
q = p[idx[:cut]] / p[idx[:cut]].sum() # renormalise
return idx[rng.choice(cut, p=q)]
for tau in (0.5, 1.0, 1.5):
p = probs(z, tau); print(tau, p.round(2), vocab[top_p(p)])
print("CE loss:", round(-np.log(probs(z, 1.0)[0]), 2)) # target
OUTPUT
0.5 [0.79 0.16 0.04 0.01 0. ] rajin
1.0 [0.56 0.25 0.13 0.05 0.01] baik
1.5 [0.45 0.27 0.17 0.09 0.03] rajin
CE loss: 0.57
Sources: Holtzman et al. (2020), The curious case of neural text degeneration (nucleus / top-p sampling), ICLR · Jurafsky & Martin, Speech and Language Processing, 3rd ed. draft (n-gram LMs; Transformers).
TTTK2313 · M2 GENERATIVE AI · DEEP DIVE · SELF-STUDY
Quick check 1/5 · press → to reveal
A
It becomes more creative and varied
B
It (almost) always picks the most probable next token
C
It refuses to answer uncertain questions
D
It uses fewer tokens per answer
✓ YES
B. Temperature → 0 sharpens the distribution until the top token always wins: repeatable, but not necessarily correct.
TTTK2313 · M2 GENERATIVE AI · 02 HOW LLMS WORK
03 · Training & alignment
1
Pre-training
DATA · trillions of tokens
INPUT
“Ibu negara Malaysia: …”
↓
TASK
predict the next token
↓
LEARNS
“Kuala” ✓ loss ↓
→ base model
2
Fine-tuning (SFT)
DATA · thousands of expert pairs
INPUT
“Terangkan fotosintesis.”
↓
TARGET
an expert’s ideal answer
↓
LEARNS
the assistant’s style
→ follows instructions
3
Preference tuning
DATA · tens of thousands of rankings
INPUT
one prompt → answers A, B
↓
HUMAN
A ≻ B (A is better)
↓
UPDATE
RLHF (RM + PPO) or DPO
→ helpful, polite, safer
4
RL with verifiers
DATA · checkable maths and code
INPUT
“17 × 23 = ?”
↓
MODEL
thinks step by step → 391
↓
VERIFIER
391 ✓ → reward +1
→ reasoning model
Stage 1 is where data ethics bites: consent, copyright and bias all enter through the training corpus (see Part 10).
TTTK2313 · M2 GENERATIVE AI · 03 TRAINING & ALIGNMENT
03 · Training & alignment
A base model only knows “what text usually comes next”. Online, a question is often followed by more questions, such as a quiz list.
Instruction tuning and preference tuning teach it the assistant role: answer, stay on task, refuse harmful requests.
TTTK2313 · M2 GENERATIVE AI · 03 TRAINING & ALIGNMENT
Deep dive · self-study · 03 Alignment
| STAGE | DATA | OBJECTIVE (MINIMISE ℒ) |
|---|---|---|
| 1 Pre-training | trillions of raw tokens | ℒ = −Σₜ log π_θ(xₜ | x₍<ₜ₎) |
| 2 Supervised fine-tuning | (prompt x, ideal answer y) | same loss, on the answer tokens only |
| 3a Reward model | x with preferred y⁺ and rejected y⁻ | ℒ = −log σ( r(x, y⁺) − r(x, y⁻) ) |
| 3b RLHF (PPO) | prompts + reward model r | maximise E[ r(x, y) ] − β · KL( π_θ ‖ π₀ ) |
| 3c DPO (no reward model) | the same preference pairs | ℒ = −log σ( β log π_θ(y⁺|x)/π₀(y⁺|x) − β log π_θ(y⁻|x)/π₀(y⁻|x) ) |
π_θ: the model being trained · π₀: frozen copy after SFT (the reference) · σ: sigmoid · r: reward model score · β: how far the model may drift from π₀ (the KL term stops it gaming the reward). DPO folds the reward model into a closed-form loss on preference pairs.
PIPELINE
Sources: Ouyang et al. (2022), Training language models to follow instructions with human feedback, NeurIPS · Rafailov et al. (2023), Direct preference optimization, NeurIPS · Christiano et al. (2017), NeurIPS.
TTTK2313 · M2 GENERATIVE AI · DEEP DIVE · SELF-STUDY
03 · Training & alignment
Error ↓
Training compute (log) →
Accuracy ↑
Thinking tokens at inference →
Train-time scaling (2020–): more parameters, data and compute give predictably lower error (Kaplan 2020; Chinchilla 2022: ~20 tokens per parameter).
Test-time scaling (2024–): let the model think longer at inference. More “thinking” often means better answers.
TTTK2313 · M2 GENERATIVE AI · 03 TRAINING & ALIGNMENT
Deep dive · self-study · 03 Scaling
FORMULATION
L(N, D) = E + A / Nᵅ + B / Dᵝ
E = 1.69, A = 406.4, B = 410.7, α = 0.34, β = 0.28
C ≈ 6 · N · D training FLOPs
compute-optimal (Approaches 1–2): D ≈ 20 · N
N: parameters · D: training tokens · L: test loss · E: irreducible loss of natural text. Growing only N or only D hits diminishing returns; Chinchilla showed both should grow together.
STEPS
PYTHON · RUNS AS-IS
E, A, B, a, b = 1.69, 406.4, 410.7, 0.34, 0.28 # fitted
def loss(N, D): # N params, D tokens
return E + A / N**a + B / D**b
for N, D in [(7e9, 140e9), (7e9, 2e12), (70e9, 1.4e12)]:
C = 6 * N * D # training FLOPs
print(f"N={N:.0e} D={D:.1e} C={C:.1e} "
f"L={loss(N, D):.2f}")
OUTPUT
N=7e+09 D=1.4e+11 C=5.9e+21 L=2.18
N=7e+09 D=2.0e+12 C=8.4e+22 L=2.02
N=7e+10 D=1.4e+12 C=5.9e+23 L=1.94
Sources: Kaplan et al. (2020), Scaling laws for neural language models, arXiv:2001.08361 · Hoffmann et al. (2022), Training compute-optimal LLMs (Chinchilla), NeurIPS; fit from Approach 3.
TTTK2313 · M2 GENERATIVE AI · DEEP DIVE · SELF-STUDY
ACT 2 · GENERATION
04 Diffusion & Multimodal
→ Case: Sora
→ World models
TTTK2313 · M2 GENERATIVE AI · ACT 2
04 · Diffusion & multimodal
01 · FORWARD (TRAINING)
Add noise to real images step by step until only static remains.
02 · REVERSE (GENERATION)
A network predicts the noise, then removes it a little at a time.
03 · THE PROMPT STEERS
Your text is encoded into numbers that guide every step.
TTTK2313 · M2 GENERATIVE AI · 04 DIFFUSION & MULTIMODAL
Deep dive · self-study · 04 Diffusion
FORMULATION
xₜ = √ᾱₜ · x₀ + √(1 − ᾱₜ) · ε, ε ~ N(0, I)
ℒ = E ‖ ε − ε̂(xₜ, t, c) ‖²
xₜ₋₁ = (xₜ − (1−αₜ)/√(1−ᾱₜ) · ε̂) / √αₜ + σₜ z
Forward: blend image x₀ with noise ε; ᾱₜ → 0 as t → T. Training: a network ε̂ learns to predict the noise, guided by the text embedding c. Sampling (code →): start from noise and subtract predicted noise T times.
The code’s toy model knows one image, so it can only regenerate it; a real U-Net or DiT learns ε̂ from millions of images and can make new ones.
PYTHON · RUNS AS-IS
import numpy as np
rng = np.random.default_rng(0)
T = 50 # same schedule as slide 23
c = np.cos(np.arange(T + 1) / T * np.pi / 2)
ab = np.maximum(c ** 2, 1e-4) # alpha-bar_t
x0 = np.linspace(-1, 1, 64) # toy "image": 64 pixels
def eps_hat(x, t): # ideal denoiser if x0 is the ONLY image
return (x - np.sqrt(ab[t]) * x0) / np.sqrt(1 - ab[t])
x = rng.normal(size=x0.shape) # start from pure noise
for t in range(T, 0, -1): # reverse process: T -> 1
a = ab[t] / ab[t - 1] # alpha_t
e = eps_hat(x, t) # predicted noise
x = (x - (1 - a) / np.sqrt(1 - ab[t]) * e) / np.sqrt(a)
if t > 1: # + sigma_t * z
s = np.sqrt((1 - a) * (1 - ab[t - 1]) / (1 - ab[t]))
x = x + s * rng.normal(size=x.shape)
if t in (50, 25, 1):
print(f"t={t-1:2d} error = {np.abs(x - x0).mean():.3f}")
OUTPUT
t=49 error = 0.882
t=24 error = 0.525
t= 0 error = 0.000
Sources: Ho, Jain & Abbeel (2020), Denoising diffusion probabilistic models, NeurIPS · Nichol & Dhariwal (2021), Improved DDPM (cosine schedule), ICML · Rombach et al. (2022), Latent diffusion, CVPR.
TTTK2313 · M2 GENERATIVE AI · DEEP DIVE · SELF-STUDY
04 · Diffusion & multimodal
Text → Text
LLMs and reasoning models; chat, code, translation
Text → Image
Diffusion and autoregressive image models; editing by instruction
Text → Video + Audio
Veo 3 and rivals generate synced speech and sound in one pass
Text → World
Genie 3: interactive worlds you can walk through
Text → 3D
Game assets, product mock-ups, digital twins
Text → Task
Agents that browse, code, fill forms (Part 05)
TTTK2313 · M2 GENERATIVE AI · 04 DIFFUSION & MULTIMODAL
Case study · March 2026
3.3M → 1.1M
monthly app downloads, Nov 2025 → Feb 2026
$2.1M
reported lifetime app revenue
$1B
Disney licensing deal that collapsed with it
Lesson: OpenAI announced the shutdown on 24 Mar 2026 without giving a reason; reports point to falling use, plus deepfakes of public figures and copyrighted characters. Capability is not the same as a safe, viable product.
TTTK2313 · M2 GENERATIVE AI · 04 · SOURCE: TECHCRUNCH, 24 MAR 2026
04 · Diffusion & multimodal
Video: Google DeepMind, Genie 3
Genie 3 (Google DeepMind, 2025): type a prompt, then steer through the world it generates live, at 720p and 24 fps.
Ameca robot · Willy Jackson, CC BY-SA 4.0, Wikimedia
Why it matters: robots and AI agents can practise in generated worlds before touching the real one.
TTTK2313 · M2 GENERATIVE AI · 04 DIFFUSION & MULTIMODAL
ACT 3 · AGENCY
05 Reasoning models
05 Agents & tools
05 How far can they go?
TTTK2313 · M2 GENERATIVE AI · ACT 3
05 · Reasoning & agents
Reasoning models write a hidden chain of thought first: they set up, compute and check before replying.
The cost: more tokens, more time, more energy per answer. The benefit: far fewer slips on maths, logic and code.
TTTK2313 · M2 GENERATIVE AI · 05 REASONING & AGENTS
05 · Reasoning & agents
Model
tries a problem
Verifier
unit tests · maths checker
Reward
+1 correct · 0 wrong
Update
reinforce what worked
RL with verifiable rewards (RLVR): no human labels needed when a program can check the answer.
DeepSeek-R1 (Jan 2025) showed this openly: its R1-Zero variant learned to reason from reward alone.
Open problem: what is the verifier for an essay, a diagnosis, or a legal opinion?
TTTK2313 · M2 GENERATIVE AI · 05 REASONING & AGENTS
Deep dive · self-study · 05 Reasoning
FORMULATION
rᵢ = verify(oᵢ) ∈ {0, 1}, i = 1 … G
Âᵢ = (rᵢ − mean(r)) / std(r)
J = E[ (1/G) Σᵢ min(ρᵢÂᵢ, clip(ρᵢ, 1±ε) Âᵢ) ]
− β · KL(π_θ ‖ π₀)
G answers oᵢ to one question q, each scored by a program. Above-average answers get  > 0 and become more likely. ρᵢ = π_θ(oᵢ|q) / π_old(oᵢ|q). The group mean is the baseline: no value network. (Per-token averaging omitted.)
STEPS
PYTHON · RUNS AS-IS
import numpy as np
def verify(answer, truth): # the "verifier"
return 1.0 if answer.strip() == truth else 0.0
truth = "42" # e.g. 6 × 7
group = ["42", "41", "42", "48", "42", "36"] # G = 6 samples
r = np.array([verify(a, truth) for a in group])
adv = (r - r.mean()) / (r.std() + 1e-8) # group-relative
print("rewards ", r)
print("advantages", adv.round(2))
# raise log-prob where A > 0, lower it where A < 0
OUTPUT
rewards [1. 0. 1. 0. 1. 0.]
advantages [ 1. -1. 1. -1. 1. -1.]
Sources: Shao et al. (2024), DeepSeekMath (introduces GRPO), arXiv:2402.03300 · DeepSeek-AI (2025), DeepSeek-R1, Nature 645 · Schulman et al. (2017), PPO, arXiv:1707.06347.
TTTK2313 · M2 GENERATIVE AI · DEEP DIVE · SELF-STUDY
05 · Reasoning & agents
agent = LLM + tools + memory + loop
MCP (Model Context Protocol) is a common plug that lets one agent use calendars, files, databases and email: “USB-C for AI tools”.
Good agents pause for a human before irreversible actions like sending, paying or deleting.
TTTK2313 · M2 GENERATIVE AI · 05 REASONING & AGENTS
Deep dive · self-study · 05 Agents
aₜ = LLM(goal, o₁, a₁, …, oₜ) → oₜ₊₁ = tool(aₜ)
PYTHON · AGENT LOOP (SKETCH)
def run_agent(goal, tools, llm, max_steps=8):
memory = [f"Goal: {goal}"]
for _ in range(max_steps):
step = llm(memory, tools) # think + choose
if step.kind == "final":
return step.text # done
if step.tool in RISKY and not ask_human(step):
memory.append("Human declined; try another way.")
continue
result = tools[step.tool](**step.args) # act
memory.append(f"{step.tool}: {result}") # observe
return "Stopped: step budget used up."
STEPS
Sources: Yao et al. (2023), ReAct: synergizing reasoning and acting in language models, ICLR · Anthropic (2024), Model Context Protocol specification · Schick et al. (2023), Toolformer, NeurIPS.
TTTK2313 · M2 GENERATIVE AI · DEEP DIVE · SELF-STUDY
05 · Reasoning & agents
121 min
o3
Apr 2025
101 min
Claude Opus 4
May 2025
214 min
GPT-5
Aug 2025
320 min
Claude Opus 4.5
Nov 2025
~4 months
doubling time of the task length (in human-expert minutes) agents complete with 50% success, since 2023.
Source: METR TH1.1 (Jan 2026). Feb 2026: Claude Opus 4.6 ≈ 14.5 h (wide CI, 6–98 h), near the suite’s ceiling.
TTTK2313 · M2 GENERATIVE AI · 05 · SOURCE: METR TH1.1
Quick check 2/5 · press → to reveal
A
Hallucination
B
Prompt injection
C
Model collapse
D
Overfitting
✓ YES
B. Prompt injection hides instructions inside data the agent reads. Defences: separate data from instructions, limit tool permissions, require human approval.
TTTK2313 · M2 GENERATIVE AI · 05 REASONING & AGENTS
ACT 4 · TRUST
06 Evaluation & Benchmarks
07 Hallucination
07 Validation
TTTK2313 · M2 GENERATIVE AI · ACT 4
06 · Evaluation & benchmarks
| Method | Measures | Weak spot |
|---|---|---|
| BLEU · ROUGE | n-gram overlap with a reference text | punishes valid paraphrases |
| Precision · Recall · F1 | correct labels on fixed classes | needs a single right answer |
| MMLU · HLE · SWE-bench | exam-style accuracy | saturation, data contamination |
| Arena-style voting | which answer people prefer | style can beat substance |
| LLM-as-judge | a model grades outputs | judge bias, self-preference |
| Time horizon · ARC-AGI-3 | long tasks, novel environments | costly to run |
The first two rows are where the old deck stopped. LLM evaluation now mixes all six. Formulas, worked examples and benchmark links for every row: next 4 deep-dive slides.
TTTK2313 · M2 GENERATIVE AI · 06 EVALUATION & BENCHMARKS
Deep dive · self-study · 06 Evaluation · 1/4
BLEU · ROUGE: overlap with a reference
FORMULATION
pₙ = matched n-grams / candidate n-grams
BLEU = BP · exp( Σₙ ¼ · log pₙ ), BP = min(1, e^(1 − r/c))
ROUGE-N = matched n-grams / reference n-grams
r, c: reference and output lengths. BLEU: precision (translation). ROUGE: recall (summaries).
WORKED EXAMPLE
Ref “kucing itu tidur di atas tikar”, output “kucing tidur di atas tikar”: p₁ = 5/5, p₂ = 3/4, BP = e^(1−6/5) = 0.82; ROUGE-1 = 5/6, F1 = 0.91. A correct paraphrase in other words scores far lower.
BENCHMARKS & DATA (CLICK)
WMT shared tasks · translation test sets
CNN / DailyMail · summarisation
HF evaluate · BLEU, ROUGE, F1 code
Precision · Recall · F1: correct labels
FORMULATION
P = TP / (TP + FP), R = TP / (TP + FN)
F1 = 2PR / (P + R)
Macro-F1 = (1/K) Σₖ F1ₖ
TP, FP, FN: true positives, false positives, false negatives. Macro-F1 weights every class equally, so rare classes count.
WORKED EXAMPLE
A spam filter flags 50 e-mails: 40 are spam (TP), 10 are not (FP), and it misses 20 spam (FN) → P = 0.80, R = 0.67, F1 = 0.73.
BENCHMARKS & DATA (CLICK)
GLUE / SuperGLUE · classification, NLI
SQuAD · QA, exact match + token F1
Malay LLM benchmarks · Malay tasks (Mesolitica)
Sources: Papineni et al. (2002), BLEU, ACL · Lin (2004), ROUGE, ACL Workshop · Wang et al. (2019), GLUE, ICLR · Rajpurkar et al. (2016), SQuAD, EMNLP.
TTTK2313 · M2 GENERATIVE AI · DEEP DIVE · SELF-STUDY
Deep dive · self-study · 06 Evaluation · 2/4
MMLU · HLE: exam-style accuracy
FORMULATION
Acc = correct / N
95% CI ≈ Acc ± 1.96 · √( Acc(1 − Acc) / N )
Gaps inside the interval are noise. Contamination: if test questions (or long n-gram matches) appear in training data, scores are inflated.
WORKED EXAMPLE
MMLU has 14,042 test questions. A model at 85.0% has a 95% interval of about ±0.6 points, so 85.0% vs 85.4% is a tie.
BENCHMARKS & DATA (CLICK)
MMLU · 57 subjects, multiple choice
Humanity’s Last Exam · expert-level, unsaturated
GSM8K · grade-school maths
MalayMMLU · Bahasa Melayu exam questions
HumanEval · SWE-bench: code that runs
FORMULATION
pass@k = 1 − C(n − c, k) / C(n, k)
n programs per task, c pass the tests: chance ≥ 1 of k tries passes.
PYTHON · RUNS AS-IS
from math import comb
def pass_at_k(n, c, k): # n samples, c of them correct
if n - c < k: return 1.0
return 1 - comb(n - c, k) / comb(n, k)
print([round(pass_at_k(20, 3, k), 3) for k in (1, 5, 10)])
OUTPUT
[0.15, 0.601, 0.895]
BENCHMARKS & DATA (CLICK)
HumanEval · 164 Python problems
SWE-bench · % of real GitHub issues resolved (hidden tests pass)
LiveCodeBench · fresh problems vs contamination
Sources: Hendrycks et al. (2021), MMLU, ICLR · Phan et al. (2025), Humanity’s Last Exam · Chen et al. (2021), pass@k, arXiv:2107.03374 · Jimenez et al. (2024), SWE-bench, ICLR · MalayMMLU (2024), Findings of EMNLP.
TTTK2313 · M2 GENERATIVE AI · DEEP DIVE · SELF-STUDY
Deep dive · self-study · 06 Evaluation · 3/4
Arena voting: ratings from preferences
FORMULATION
E_A = 1 / (1 + 10^((R_B − R_A)/400))
R′_A = R_A + K · (S_A − E_A)
Bradley–Terry: P(A ≻ B) = σ(β_A − β_B)
S = 1 win, ½ tie, 0 loss. LMArena fits Bradley–Terry scores to many anonymous head-to-head votes and reports confidence intervals.
WORKED EXAMPLE
A (rated 1500) meets B (1400): E_A = 0.64. A loses (S = 0) with K = 32, so A drops to 1479.5 and B rises to 1420.5.
BENCHMARKS & DATA (CLICK)
LMArena · live leaderboard, vote yourself
Chatbot Arena conversations · 33k voted chats
LLM-as-judge: a model grades outputs
FORMULATION
win rate = (wins + ½ · ties) / N
κ = (pₒ − pₑ) / (1 − pₑ)
κ (Cohen’s kappa): judge–human agreement beyond chance; pₒ observed, pₑ expected by chance. Swap answer order and average to cancel position bias.
WORKED EXAMPLE
The judge agrees with human raters on 80 of 100 pairs, chance agreement is 0.5 → κ = 0.6 (moderate). Report κ before trusting the judge.
Sources: Elo (1978), The rating of chessplayers · Chiang et al. (2024), Chatbot Arena, ICML · Zheng et al. (2023), Judging LLM-as-a-judge with MT-Bench, NeurIPS · Cohen (1960), Educ. Psychol. Meas. 20.
TTTK2313 · M2 GENERATIVE AI · DEEP DIVE · SELF-STUDY
Deep dive · self-study · 06 Evaluation · 4/4
Time horizon: task length an agent can finish
FORMULATION
p(success | t) = σ( α − β · log₂ t )
h₅₀ = 2^(α/β) (where p = 0.5)
t: how long the task takes a skilled human. Fit the logistic curve to an agent’s successes and failures; h₅₀ is the length it completes half the time.
WORKED EXAMPLE
α = 3, β = 0.5 → p = 0.82 on 8-minute tasks, 0.50 on 64-minute tasks, 0.18 on 512-minute tasks; h₅₀ = 2⁶ = 64 minutes.
BENCHMARKS & DATA (CLICK)
METR time horizons · live chart of frontier models
Kwa et al. (2025) · method and task suite
ARC-AGI-3: novel interactive games
FORMULATION
level = min( (human actions / AI actions)², cap )
game = Σₗ ℓ · levelₗ / Σₗ ℓ , total = mean over games
No instructions or stated goal: the agent must explore to learn each game. Later levels weigh more (weight ℓ), and wasted actions are penalised quadratically.
WORKED EXAMPLE
A 5-level game: the AI clears levels 1–4, each with twice the human’s actions → each (½)² = 0.25 → game = (1+2+3+4)·0.25 / 15 = 16.7%.
BENCHMARKS & DATA (CLICK)
ARC Prize · games, leaderboard, human play
Scoring method · official ARC-AGI-3 docs
Sources: Kwa et al. (2025), Measuring AI ability to complete long tasks, arXiv:2503.14499 · ARC Prize Foundation (2026), ARC-AGI-3, arXiv:2603.24621.
TTTK2313 · M2 GENERATIVE AI · DEEP DIVE · SELF-STUDY
06 · Evaluation & benchmarks
SWE-BENCH VERIFIED · REAL GITHUB ISSUES
60%→~100%
of a scaled human baseline in one year (AI Index 2026); raw solve rate ≈ 81%.
ARC-AGI-3 · INTERACTIVE PUZZLE GAMES
<1% vs 100%
frontier AI vs humans at launch (25 Mar 2026): no instructions, no stated goal; explore and work it out.
Once a test saturates, it stops telling models apart, so the field keeps inventing harder ones.
“When a measure becomes a target, it ceases to be a good measure.” Goodhart’s law, in Marilyn Strathern’s phrasing
TTTK2313 · M2 GENERATIVE AI · 06 EVALUATION & BENCHMARKS
07 · Validation & hallucination
Why it happens: training and evaluation reward a confident guess over “I don’t know” (Kalai et al., OpenAI 2025).
EXAM ANALOGY
Multiple-choice test, no penalty for wrong answers: guessing always beats leaving it blank. Models learn the same trick.
TTTK2313 · M2 GENERATIVE AI · 07 VALIDATION & HALLUCINATION
07 · Validation & hallucination
01
Question
“Bila minggu ulang kaji Semester 1?”
02
Retrieve
search FTSM calendar chunks (vector DB)
03
Augment
question + top-k passages in the prompt
04
Answer
“11–17 Jan 2027” + [Kalender FTSM]
RAG lets the model look things up in trusted documents and cite them, so you can check. Add an abstain rule (“if not in sources, say so”) to cut fabrication further.
TTTK2313 · M2 GENERATIVE AI · 07 VALIDATION & HALLUCINATION
Deep dive · self-study · 07 Grounding
FORMULATION
score(q, d) = cos( e(q), e(d) )
context = top-k chunks by score
e(·): an embedding model (TF-IDF here, a neural embedder in practice). Chunk size, overlap and k are the main tuning knobs.
PYTHON · RUNS AS-IS
import sklearn.feature_extraction.text as sk
docs = ["MK14 (4-10 Jan 2027): minggu kuliah terakhir",
"Minggu ulang kaji: 11-17 Jan 2027",
"Peperiksaan akhir: 18 Jan - 7 Feb 2027",
"Cuti pertengahan semester: 9-15 Nov 2026"]
q = "Bila minggu ulang kaji Semester 1?"
vec = sk.TfidfVectorizer().fit(docs) # 1 index
D, Q = vec.transform(docs), vec.transform([q])
score = (D @ Q.T).toarray().ravel() # 2 cosine
top = score.argsort()[::-1][:2] # 3 top-k
ctx = "\n".join(f"[{i}] {docs[i]}" for i in top)
prompt = (f"Jawab HANYA daripada sumber.\n{ctx}\n"
f"Soalan: {q}") # 4 augment
print(score.round(2), docs[top[0]])
OUTPUT
[0.14 0.59 0. 0.21] Minggu ulang kaji: 11-17 Jan 2027
Sources: Lewis et al. (2020), Retrieval-augmented generation for knowledge-intensive NLP, NeurIPS · Toy corpus: FTSM academic calendar, Semester 1 2026/2027.
TTTK2313 · M2 GENERATIVE AI · DEEP DIVE · SELF-STUDY
07 · Validation & hallucination
Data quality
Missing values, mixed date formats, impossible outliers (a GPA of 12.0)
Task-fit metrics
Pick metrics that match the job: factuality, faithfulness to sources, not just BLEU
Bias
Identify sources → measure gaps across groups → mitigate (reweight, adversarial training)
Human review
Relevance, factuality, coherence, safety. “Photosynthesis produces nitrogen” fails factuality
TTTK2313 · M2 GENERATIVE AI · 07 VALIDATION & HALLUCINATION
07 · Validation & hallucination
Each generation learns only from what the previous model wrote. Rare cases vanish first, then the output narrows to the obvious answer: garbage in, garbage out.
Real simulation: 60 samples per generation, decoded with a slight preference for likely outputs (τ = 0.8).
DID YOU KNOW?
Shumailov et al., Nature (2024). The fix: keep curated human data in every training round.
TTTK2313 · M2 GENERATIVE AI · 07 VALIDATION & HALLUCINATION
Quick check 3/5 · press → to reveal
A
Raise the temperature
B
Ground it with retrieval + citations, and allow “I don’t know”
C
Pass its answers through an AI humanizer
D
Make the system prompt longer
✓ YES
B. Retrieval gives it something true to say, citations make it checkable, and permission to abstain removes the incentive to guess.
TTTK2313 · M2 GENERATIVE AI · 07 VALIDATION & HALLUCINATION
ACT 5 · APPLICATIONS & DEEPFAKES
08 Research at FTSM
09 Deepfakes
09 Detection & provenance
TTTK2313 · M2 GENERATIVE AI · ACT 5
08 · Applications · FTSM research
Face hallucination for forensics
Sparse-representation super-resolution of CCTV faces. Zamani, Sheikh Abdullah et al., Malaysian J. Cybersecurity & Applications.
Synthetic retinal images
End-to-end VAEs-GAN pipeline, no vessel masks needed. Saeed, Sheikh Abdullah et al., Multimedia Tools & Applications 83 (2024).
SmoothBigGAN
Smooth S-shaped rectified activations stabilise GAN training. Ghazvini, Sheikh Abdullah & Ayob, Applied Intelligence 55 (2025).
TTTK2313 · M2 GENERATIVE AI · 08 APPLICATIONS
08 · FTSM flagship · Wahana Rintis Semantik Ayat Nasional
01 · DIGITISE
Scan
Heritage books, manuscripts and microfilm digitised at UKM’s library.
i2S CopiBook · A2 · 400 dpi
02 · CURATE
Corpus
Collect → clean → structure → expert validation → performance test.
AI-ready Malay corpus
03 · TRAIN
LLM-BM
A Malay foundation language model, trained and fine-tuned on UKM compute.
NVIDIA H200 · AURA @ DigitalUKM
Watan AI
Q&A over official UKM documents
ARIF
Malay text checked to DBP standards
JARO
Rumi ↔ Jawi transliteration chat
SANUBARI
Health-science answers in Malay
NADI
Taking a patient’s medical history
TTTK2313 · M2 GENERATIVE AI · 08 APPLICATIONS
08 · FTSM flagship · the team
INFRA · 4
infrastructure
CAKNA · 1
engagement
BM · 20
Malay-language models in 9 domains ↓
MALAY LANGUAGE MODEL
Foundation LLM for the national language
Dr. Mohd Nor Akmal Khalid
LANGUAGE & LITERATURE
EN–MS translation by fine-tuning the LLM
Assoc. Prof. Dr. Sabrina Tiun
JAWI
Jawi transliteration chatbot
Assoc. Prof. Dr. Mohammad Faidzul Nasrudin
LAW
AI for drafting legal contracts
Assoc. Prof. Dr. Muhamad Helmi Md Said
MEDICINE & HEALTH
Patient-history chatbot for internal medicine
Assoc. Prof. Dr. Noor Akmal Shareela Ismail
EDUCATION & STEM
TERAS-STEM: Malay data for STEM learning
Dr. Zainal Rasyid Mahayuddin
IOT & ROBOTICS
Lightweight Malay LLM for IoT edge devices
Dr. Ahmad Tarmizi Abdul Ghani
IMAGE
Bahasa-Bench: testing vision-language models in Malay
Assoc. Prof. Dr. Azizi Abdullah
ETHNIC LANGUAGES
Smart translator for Malaysia’s native languages
Assoc. Prof. Dr. Rabiah Abdul Kadir
Photos and roster: warisan.ukm.my/pasukan · one example project and lead per domain
TTTK2313 · M2 GENERATIVE AI · 08 APPLICATIONS
09 · Deepfakes · Malaysian case study
Late Dec 2025
Users prompt X’s Grok image tool to make sexualised edits of real photos, including of women and minors.
10 Jan 2026
Indonesia blocks Grok, calling non-consensual sexual deepfakes a violation of human rights and dignity.
11 Jan 2026
MCMC blocks Grok in Malaysia over “repeated misuse”; lifted on 23 Jan after xAI added safeguards.
2026
The EU adds a ban on “nudifier” apps and AI-generated CSAM to its AI Act.
TTTK2313 · M2 GENERATIVE AI · 09 · SOURCE: NPR, 12 JAN 2026
09 · Deepfakes · live demo
AI · AGE 10
AI · AGE 20
REAL PHOTO
AI · AGE 40
AI · AGE 50
AI · AGE 60
AI · AGE 70
AI · AGE 80
Which one is the real photo?
One real profile photo plus a prompt gave seven convincing “me”s, from age 10 to 80. Generation follows probability and noise, not truth.
Demo: Ts. Dr. Mohd Nor Akmal Khalid. Only the highlighted photo is real.
TTTK2313 · M2 GENERATIVE AI · 09 DEEPFAKES & DETECTION
09 · Deepfakes & detection
61%
of non-native English (TOEFL) essays flagged as AI, averaged over 7 popular detectors (Liang et al., Patterns 2023).
0–30%
of fully AI-written test papers caught by three popular tools; “humanised” text did even better (Van Vlasselaer et al., 2026).
TTTK2313 · M2 GENERATIVE AI · 09 DEEPFAKES & DETECTION
09 · Deepfakes & detection · the “AI humanizer”
Generate
LLM drafts text
Humanize
paraphrase · style transfer · inject “burstiness”
Detect
classifier scores the text
Adapt
detector retrains, humanizer adapts…
Legitimate use
Improving clarity, tone and accessibility of your own work, and saying you used AI.
Misuse
Disguising authorship to deceive assessors, or mass-producing SEO spam pages.
TTTK2313 · M2 GENERATIVE AI · 09 DEEPFAKES & DETECTION
09 · Deepfakes & detection
C2PA CONTENT CREDENTIALS
Signed metadata: who made it, with what tool, what edits. Rich, but stripped by screenshots.
INVISIBLE WATERMARKS
Signal hidden in the pixels. Google’s SynthID has marked 100B+ images and videos; OpenAI, NVIDIA and ElevenLabs adopted it in 2026.
TTTK2313 · M2 GENERATIVE AI · 09 DEEPFAKES & DETECTION
Deep dive · self-study · 09 Provenance
FORMULATION
green list Gₜ = hash(xₜ₋₁) → γ·|V| tokens
logit ℓᵢ ← ℓᵢ + δ for i ∈ Gₜ (generation)
z = (g − γT) / √( T γ (1 − γ) ) (detection)
The previous token seeds a secret split of the vocabulary; green tokens get a logit boost δ. Detector counts green tokens g among T. Human text has ≈ γT green tokens by chance (z ≈ 0); z > 4 is strong evidence.
STEPS
PYTHON · RUNS AS-IS
from math import sqrt
def z_score(green, T, gamma=0.25):
"""green: tokens found in the green list; T: total."""
sd = sqrt(T * gamma * (1 - gamma))
return (green - gamma * T) / sd
print(round(z_score(green=52, T=200), 2)) # human-like
print(round(z_score(green=120, T=200), 2)) # watermarked
# rule of thumb: flag as watermarked when z > 4
OUTPUT
0.33
11.43
Sources: Kirchenbauer et al. (2023), A watermark for large language models, ICML · Dathathri et al. (2024), Scalable watermarking for identifying LLM outputs (SynthID-Text), Nature 634.
TTTK2313 · M2 GENERATIVE AI · DEEP DIVE · SELF-STUDY
Quick check 4/5 · press → to reveal
A
The signed metadata manifest
B
An invisible pixel watermark, if the generator embedded one
C
Both of them, always
D
Neither of them, ever
✓ YES
B. Metadata lives beside the pixels and is lost on screenshot; a watermark lives in the pixels. That is why platforms layer both.
TTTK2313 · M2 GENERATIVE AI · 09 DEEPFAKES & DETECTION
ACT 6 · SOCIETY & GOVERNANCE
10 Work, learning, planet, law
11 Governance
12 Future
TTTK2313 · M2 GENERATIVE AI · ACT 6
10 · Society · work
Employment of workers aged 22–25, Nov 2022 → Jun 2026
+10%
−11%
least AI-exposed jobs
most AI-exposed jobs
−19%
young workers in the most exposed jobs vs where they would otherwise be.
Fewer new hires, not layoffs. Experienced workers are unaffected. Where AI augments people, employment is flat or rising.
Brynjolfsson, Chandar & Chen, “Canaries in the Coal Mine?” (Stanford, Aug 2026 update)
TTTK2313 · M2 GENERATIVE AI · 10 SOCIETY
10 · Society · learning
4 in 5
US high-school and college students use AI for schoolwork (AI Index 2026)
6%
of US teachers say their school’s AI policy is clear (AI Index 2026)
Photo: D00264450, CC BY-SA 4.0, via Wikimedia Commons
“Cognitive debt”: in an MIT EEG preprint with 54 participants (Kosmyna et al., 2025), essay writers using an LLM showed the weakest brain connectivity, and most could not quote their own essay.
Rule of thumb: think first, then prompt. Use AI as a sparring partner, not a ghostwriter.
TTTK2313 · M2 GENERATIVE AI · 10 SOCIETY
10 · Society · planet
Photo: Carl Lender, CC BY 2.0, via Wikimedia Commons
2026
7%
of national electricity used by data centres (10,544 GWh)
2035 PROJECTION
31%
of national electricity (73,274 GWh); Johor is the main growth hub
Discuss: who pays for the new grid, how much water cooling uses, and who gets the jobs?
Source: Ministry of Energy Transition and Water Transformation projections, via Malay Mail (Jul 2026)
TTTK2313 · M2 GENERATIVE AI · 10 SOCIETY
10 · Society · law
US · 2025
Bartz v. Anthropic
US$1.5B settlement over pirated books used in training data
US · 2025
Kadrey v. Meta
Training ruled fair use on that record; authors had not shown market harm
Germany · 2025
GEMA v. OpenAI
Munich court: memorising and reproducing song lyrics infringed copyright
UK · 2025
Getty v. Stability AI
Getty’s main copyright claim failed; narrow trademark findings
Photo: Djembayz, CC BY-SA 3.0, Wikimedia Commons
So far, how data was obtained and whether outputs copy works matter more than training itself.
TTTK2313 · M2 GENERATIVE AI · 10 SOCIETY
11 · Governance · Malaysia
Tier 1 · Unacceptable
designed to cause harm → prohibited
Tier 2 · High risk
risk to life, liberty or the law → strict duties
Tier 3 · Low risk
minimal foreseeable harm → baseline duties
Photo: CEphoto, Uwe Aranas, CC BY-SA 3.0, Wikimedia Commons
CENTRAL AI AUTHORITY
AI safety & incident reporting · investigation & enforcement · enablement (sandboxes)
FIVE PRINCIPLES
Human dignity · Transparency & explainability · Accountability · Safety & security · Data governance
Public consultation by the National AI Office, 10–31 Jul 2026. Builds on the 2024 National Guidelines on AI Governance & Ethics (AIGE).
TTTK2313 · M2 GENERATIVE AI · 11 GOVERNANCE
11 · Governance · European Union
Photo: Diliff, CC BY-SA 3.0, via Wikimedia Commons
Why care in Malaysia? EU rules reach any company that sells into the EU.
2 Feb 2025
Prohibited practices apply
2 Aug 2025
Duties for general-purpose AI models
2 Aug 2026
Art. 50: tell people they are facing AI
2 Dec 2026
Watermark AI content (systems already on sale)
2 Dec 2027
Stand-alone high-risk systems
2 Aug 2028
High-risk AI inside products
New, 2026
Bans on AI-generated CSAM and “nudifier” apps
TTTK2313 · M2 GENERATIVE AI · 11 GOVERNANCE
11 · Governance · you
Disclose
Say when and how you used AI in your work.
Verify
Check every fact, number and citation against a source.
Protect
Never paste personal, confidential or exam data into public tools.
Credit
Cite sources and respect others’ creative work.
Think
Do the thinking first; let AI challenge it, not replace it.
TTTK2313 · M2 GENERATIVE AI · 11 GOVERNANCE
12 · Future
Reliability
Can hallucination be engineered close to zero, or only managed?
Verifiers
Rewards for essays, medicine and law, not just maths and code
Agent safety
Prompt injection, permissions, and who is accountable for an agent’s actions
Energy & water
Efficient models and smaller on-device AI
Bahasa & sovereignty
Malay and low-resource languages; local models such as ILMU (YTL AI Labs, 2025)
Work & skills
Rebuilding the entry-level ladder that AI is eroding
TTTK2313 · M2 GENERATIVE AI · 12 FUTURE
Quick check 5/5 · press → to reveal
A
Mass layoffs of existing staff
B
Lower salaries across the board
C
Fewer new hires
D
No measurable effect
✓ YES
C. The adjustment shows up in hiring, not firing or pay. The first rung of the career ladder is the one that is thinning.
TTTK2313 · M2 GENERATIVE AI · 10 SOCIETY
Exit ticket · 2 minutes
01
Write one sentence: a habit you will change.
02
Name one claim from today you want to verify yourself.
03
One question you still have for next week’s tutorial.
TTTK2313 · M2 GENERATIVE AI · WRAP-UP
References · 1/2
Brynjolfsson, Chandar & Chen (2026). Canaries in the Coal Mine? Six Facts… Stanford Digital Economy Lab, Aug 2026 update.
Stanford HAI (2026). The 2026 AI Index Report.
Anthropic (2026). Economic Index report: Learning curves, Mar 2026.
METR (2026). Time Horizon 1.1, 29 Jan 2026.
ARC Prize Foundation (2026). ARC-AGI-3 Technical Report.
Kalai, Nachum, Vempala & Zhang (2025). Why language models hallucinate. arXiv:2509.04664.
Shumailov et al. (2024). AI models collapse when trained on recursively generated data. Nature 631.
Liang et al. (2023). GPT detectors are biased against non-native English writers. Patterns 4(7).
TTTK2313 · M2 GENERATIVE AI · REFERENCES
References · 2/2
Van Vlasselaer et al. (2026). Who wrote this? Reliability of AI detection tools in HE. Int. J. Educ. Integrity.
Kosmyna et al. (2025). Your Brain on ChatGPT. arXiv:2506.08872.
Vaswani et al. (2017). Attention is all you need. NeurIPS · Ho, Jain & Abbeel (2020). DDPM. NeurIPS.
Ouyang et al. (2022). Training LMs to follow instructions with human feedback · DeepSeek-AI (2025). DeepSeek-R1.
Baker McKenzie (2026). Malaysia: Public Consultation on the AI Governance Bill · White & Case (2026). EU AI Omnibus.
NPR (12 Jan 2026) Grok blocked · TechCrunch (24 Mar 2026) Sora · InfoQ (May 2026) SynthID · Malay Mail (1 Jul 2026) data centres.
Google DeepMind (2025). Genie 3 · YTL AI Labs (2025). ILMU technical report.
FTSM works: Zamani et al. (MJCA); Saeed et al. (2024) MTAP 83; Ghazvini et al. (2025) Applied Intelligence 55 · WaRiSAN MELAYU (2026), warisan.ukm.my.
TTTK2313 · M2 GENERATIVE AI · REFERENCES
Questions, doubts, counter-arguments: all welcome.
Next module: M3 · Knowledge Acquisition & Validation
Acknowledgement: original M2 materials by Prof. Dr. Siti Norul Huda Sheikh Abdullah, Dr. Afzan Adam and Dr. Anahita Ghazvini.
Photo: UKM gong, Wolfiewhite, CC0, via Wikimedia Commons