From an audit of 2.5 million papers: roughly 146,900 hallucinated citations in 2025 publications alone.
Nearly all of them passed peer review. Nobody set out to deceive. They simply did not check.
Rate of papers containing at least one fabricated reference. Sixfold in two years.
Study in The Lancet (2026), Columbia University researchers — over 2 million papers and 97 million citations. The 2024 bar is interpolated for display; 2026 covers the first seven weeks.
No form to sign here. Only culture is left.
Fabrication and falsification can now happen without intent.
Did your participants consent to third-party processing?
Every prompt is a data transfer.
This slot is not a fifth topic. It is a stress test on the first four.
Two live demonstrations
Including a prompting demo and how to choose tools
Accountability · transparency · confidentiality · validity · justice
What you can do tomorrow morning
Red, amber or green
What becomes expensive when everything else becomes cheap
Q&A in the final 15 minutes. I would rather have sharp questions than polite ones.
Questions and gaps.
Summary and synthesis.
Instruments, translation.
Participant transcripts.
Coding, interpretation.
Drafting and editing.
Abstracts, peer review.
Focuses on stage 6 — writing. The easiest to detect, and the least dangerous.
Stages 3, 4 and 5 — participant data and methodological judgement. Damage here cannot be undone.
Predicting the word most likely to come next.
It does not “know” a source exists. It produces the convincing shape of one.
The assured tone comes from academic prose patterns — not from certainty.
So what is actually happening when it answers? Let's watch.
Illustrative simulation: the mechanism is accurate, the numbers are invented for teaching.
One word per click
Perfect format. Plausible page range. The journal name sounds exactly right.
No valid DOI, no database record. It was not copied — it was generated.
Reviewers check whether a reference looks right. The shape is right.
Rates are higher for specialised and under-represented topics. Researchers working on local context carry the highest risk.
JMIR Mental Health (2025); cross-model benchmark (2026); Walters & Wilder (2023) reported 55% for GPT-3.5 and 18% for GPT-4.
“Wellbeing”, “entrepreneurship” — answered using definitions dominant in an English-language corpus. Your construct shifts meaning without you noticing.
Is the pattern it identifies a real phenomenon, or an artefact of the algorithm?
AI summaries flatten disagreement. A live debate becomes a false consensus.
In social science, a tool that flattens nuance produces wrong findings in a way that looks entirely reasonable.
Each pass keeps what is probable and drops what is rare. Fine detail dies first; only bold, high-frequency shapes survive.
Model collapse, not drift. Drift is the world moving around a fixed model; collapse is a model trained on its own output, losing the tails.
About 146,900 fabricated citations entered the record in 2025 — and that record is training data. Local scholarship sits in the tails, and tails go first.
Careful, original, human-collected data is what stops this. Not a sentimental claim — it is the finding.
Clip compressed and silenced for this deck; the printed PDF substitutes four sampled frames. Model collapse: Shumailov, I., et al. (2024). AI models collapse when trained on recursively generated data. Nature, 631, 755–759.
There is no undo button. Every stop is outside your control — and the route is different every time.
Interview transcripts, recordings, case notes, contact details — anything that could identify a participant.
Student records and assessment material not already public.
Unpublished manuscripts, embargoed findings, grant proposals, peer reviews, examiner reports.
Instruments, datasets, code or material under a confidentiality obligation.
Default position when in doubt: do not upload.
| Stage | Useful for | Not for |
|---|---|---|
| 1 · Idea | Generating alternative questions; stress-testing your argument | Deciding what the literature gap is, unchecked |
| 2 · Review | Summarising papers you have already read | Finding references without verification |
| 3 · Design | Checking items for clarity and ambiguity | Translating instruments without validation |
| 4 · Collection | Drafting protocols and interview guides | Processing participant transcripts in public tools |
| 5 · Analysis | Generating code; a second lens on your themes | Replacing a second coder |
| 6 · Writing | Language fluency and argument structure | Generating findings or discussion |
| 7 · Dissemination | Drafting lay summaries; alternative titles | Reviewing other people's manuscripts |
The right column is not merely a moral prohibition — every item is a task the model cannot perform reliably.
The difference is not prompt length. It is where the information came from — from you, or from the model's memory.
Illustrative example; actual output varies by tool and version.
Who you are, what study, for which reader.
The material you supply — and a ban on anything else.
List, compare, classify. Not “please help me”.
Fields you specify — so the gaps become visible.
The single sentence that saves the most trouble.
I am a [role] at [faculty], writing [type of output] on [research topic].
Use ONLY the material I have attached below. Do not add sources, references or figures from anywhere else.
List the construct and instrument used by each article, and state any contradictions between them.
Return a table with the fields: Article | Construct | Instrument | Sample size | Main finding.
If a field is not in the text I supplied, write “not stated”. Do not estimate and do not fill gaps.
Four of these five parts are your work — knowledge of your own study. Which is why a good prompt cannot simply be copied from someone else.
“From the attached, extract [fields] into a table. Write not stated where absent.”
Why: gaps become visible.
“Give the three strongest objections a critical reviewer would raise.”
Why: nothing leaves; rehearses Reviewer 2.
“Where do these sources conflict? Quote the conflicting lines.”
Why: undoes the flattening of debate.
“Explain [concept], then list what I should verify independently.”
Why: output becomes a checklist.
“Translate these items, then translate your translation back.”
Why: surfaces drift early.
“Propose three alternative outlines. Outlines only — no prose.”
Why: the sentences stay yours.
What every pattern has in common: you supply the material, and the model does something structural to it.
Good for drafting, structure, explanation and code. Dangerous for anything needing a source.
e.g. ChatGPT · Claude · Gemini · Copilot
Good for finding literature and querying your own documents. A citation may exist yet not support the claim.
e.g. Elicit · Consensus · Scite · Semantic Scholar · NotebookLM
Screening, extraction, references, qualitative coding. Narrow scope, far easier to audit and report.
e.g. Rayyan · Covidence · ASReview · Zotero · NVivo / MAXQDA / ATLAS.ti
Most capable, hardest to audit. Condition: log every step, or you cannot write your Methods section.
e.g. deep-research modes in major assistants; agents that browse and execute code
Data never leaves. Lower performance, but often the only legitimate option for participant data.
e.g. Ollama · LM Studio · local-first QDA tools
The first question is not “which is smartest”, but: does it search? can it be audited? does my data leave?
Examples current as of August 2026 — illustrations of each type, not endorsements. If a tool shows no links to real documents, it is a generative engine.
Scopus, Web of Science, EconLit. AI does not replace the search — it reorders what the search returned.
Rayyan, Covidence or ASReview — decisions stay in one auditable, exportable place.
Ranking changes the order you read in. It does not change what is included.
This single step converts “I used AI” into a reportable method.
In Methods, alongside your PRISMA flow.
AI can reorder the pile. It cannot decide what is in it. Keep the inclusion decision human and the disagreement rate visible.
Your codebook exists before any tool sees the data — otherwise the model's categories quietly become yours.
Strip identifiers, or run a local model so transcripts never leave the machine.
Require a supporting quote for every theme, so each one is traceable.
Where you disagree, write an analytic memo. That memo is the finding.
UKM's baseline standard: validation must be reported, not merely performed.
The value is in the disagreement, not the agreement. If the model only confirms what you already coded, it has told you nothing.
Variable names, types and structure are enough. Raw rows are rarely needed.
Stata, R or Python. The comments are how you learn what it assumed.
One mean, one cross-tab, one coefficient. If it matches, continue.
Divergence between two routes is the cheapest bug detector you have.
No participant data need be uploaded, the output is testable against a known answer, and errors announce themselves as errors rather than as fluent prose.
Code that runs is not code that is correct. A silent logic error still produces a table — and the table still looks publishable.
You are responsible for every line, including the ones you did not type.
Who answers when the output is wrong?
What must be declared, and where?
Is this data yours to give away?
Can it be repeated?
Whose context becomes the default answer?
Each one already has an official document behind it. You do not need to invent policy.
If you cannot defend a sentence in a viva or an integrity inquiry, that sentence does not yet belong in your manuscript — no matter who typed it.
The line is not how much AI was used. The line is whether AI contributed intellectual content.
Declared in the Methods and Acknowledgements sections. For UKM theses: Appendix B2 of the UKM Generative AI Guideline.
In a small population, context alone can identify a participant.
A 2025 research-ethics editorial recommends informing participants and obtaining explicit consent.
NIH prohibits reviewers from uploading application content to online AI tools.
“If my participants reread the form they signed, would they expect their words to be sent to a foreign company's servers?”
It can be a second lens. It cannot be a second coder.
It can speed things up — if accuracy rates are reported and human cross-checked.
Subtle bugs still produce output. You test every line.
Tool · version · date · prompt · data supplied · output accepted · how it was verified.
The gap between these two columns is your expertise. The model gives no warning that it is answering about somewhere else — and your reader will not notice either.
Illustrative of a typical response pattern, not a transcript of any particular model. Weaker performance on under-represented languages and contexts is documented in the studies cited on slide 11.
| Boundary line | Principle | Official reference |
|---|---|---|
| 1 · Accountability | Accountability | COPE · MOHE (2024) · UKM (2025) |
| 2 · Transparency | Honesty | Publisher policies · UKM Appendix B2 |
| 3 · Confidentiality | Respect for participants | Ethics approval · UKM data baseline |
| 4 · Validity | Reliability | ERA Living Guidelines |
| 5 · Justice | Fairness and equity | National AIGE (2024) · UNESCO |
There is not one new principle here. AI does not create new ethics — it makes old ethics much easier to breach without noticing.
Data baseline standards, the ETHICAL framework, and the official disclosure form (Appendix B2).
AI cannot be a co-author; all content must be properly acknowledged.
Seven principles of responsible AI, including fairness, privacy and accountability.
European Commission (updated 2026), COPE, Elsevier, Springer, Sage, Wiley.
And closest of all: your own ethics approval. The scope on that form is the real contract with your participants.
An honest note: the UKM guideline itself warns that traffic-light models create an “enforcement illusion” — this is a communication tool, not a control mechanism.
Check university, funder and target journal policies.
Consider social impact, not just efficiency.
Understand the technology enough to know when it drifts.
State your use openly and specifically.
Do not take output at face value.
Institutional accounts, not free public ones.
Read the terms: what happens to your data.
Seven steps, not seven abstract values.
Eacersall et al. (2024). Adopted in the UKM Generative AI Guideline (2025), section 2.2.
Summarise at a high level. Do not paste raw transcripts.
Strip identifiers before any tool touches the data.
Their data terms differ entirely from free accounts.
Check retention settings. It is not the default, and it changes.
For sensitive data, nothing ever leaves. Adequate for many text tasks.
Agree tools and data types with your supervisor at the start, and record it.
Specific — name the actual task · Assessable — readers can judge its effect · State the verification — what you did to check it.
“During the preparation of this work the author(s) used…” — followed by the tool name, the purpose, an acknowledgement that the authors reviewed and edited the result, and a statement of full responsibility for the content.
All of these articles were published. Disclosure does not block publication — it protects you when someone asks later.
Data: Xu, Z. (2025). Patterns and purposes: A cross-journal analysis of AI tool usage in academic writing. arXiv:2502.00632 — declarations in Elsevier open-access journals, 2024.
UKM Generative AI Guideline (2025) — AI detector scores are probabilistic signals that can produce false positives.
Section 2.2 and Appendix B2 in particular. Thirty minutes.
Done once, applies to every future project.
Permitted tools, prohibited data, how it will be recorded.
A single text file is enough.
All four can be done in under two hours, and none requires anyone's approval.
Coding is not anonymisation. Among 28 entrepreneurs in one district, business type and contextual detail identify individuals easily.
Approval a year ago does not cover this. The consent form almost certainly says nothing about overseas third-party processing.
What should have happened: thorough anonymisation and a local model; or a protocol amendment to the ethics committee.
The translating: amber. No participant data was exposed, and assisted translation is a legitimate starting point if declared.
Distributing it unvalidated: red. This is a validity failure. Semantic equivalence is not psychometric equivalence — and 400 responses cannot be rescued afterwards.
What should have happened: back-translation, expert panel, cognitive pilot, and reported reliability for the Malay version.
The breach happened at the moment of upload, not in the writing. An unpublished manuscript is confidential work entrusted to a reviewer.
Explicitly prohibited. NIH bars reviewers from uploading application content; UKM lists unpublished manuscripts among prohibited material.
Writing it himself restores nothing. If time does not permit a proper review, the right answer is to decline the invitation.
The use is legitimate. Language improvement on human-authored text is assistive use; MOHE places no restriction on proofreading tools.
First condition: supervision. UKM requires supervisor permission for material use in a thesis, and a supervisor may restrict it early on to protect the development of writing skill.
Second condition: it stays green only while it is genuinely language. Once the tool starts suggesting arguments, it has crossed into amber.
What remains valuable is what cannot be generated: choosing the right question, recognising suspicious data, understanding context that exists in no corpus, and being willing to say “I am not yet sure”.
Models are weakest on under-represented languages, unfamiliar contexts, and topics specific to one place.
That is a precise description of this faculty's work — the Malaysian economy, local household behaviour, Islamic finance, domestic policy.
The gap in the world's corpus is your field of expertise. Not something to be protected from AI.
A Malay foundation language model and campus inference infrastructure at UKM — text analysis without data leaving the campus.
Open-source models on your own machine are already adequate for many text tasks.
Quality datasets and instruments validated in Malay.
None of these requires new policy, a meeting, or anyone's approval. All three begin tomorrow morning, with you.
Slides, disclosure templates and links to every official document will be shared through the workshop secretariat.
ILMU · IMAN · AMAL
Three yeses — proceed and declare. One no — stop.
Universiti Kebangsaan Malaysia (2025). Guideline on Responsible Use of Generative Artificial Intelligence in Teaching, Learning, and Research Supervision. Centre for Teaching and Curriculum Development, UKM.
Kementerian Pendidikan Tinggi (2024). Garis Panduan Penggunaan Teknologi Kecerdasan Buatan Generatif (KBG) dalam PdP Pendidikan Tinggi. JPT, MOHE.
MOSTI (2024). National Guidelines on AI Governance & Ethics (AIGE).
European Commission (2026). Living Guidelines on the Responsible Use of Generative AI in Research (updated version). ERA Forum, DG RTD.
COPE (2023, updated 2024). Authorship and AI tools: COPE Position Statement.
NIH (2023). The Use of Generative AI Technologies is Prohibited for the NIH Peer Review Process (NOT-OD-23-149).
Eacersall, D., et al. (2024). Navigating ethical challenges in generative AI-enhanced research: The ETHICAL framework. arXiv:2501.09021.
Xu, Z. (2025). Patterns and purposes: A cross-journal analysis of AI tool usage in academic writing. arXiv:2502.00632.
Linardon, J., et al. (2025). Influence of topic familiarity and prompt specificity on citation fabrication using LLMs. JMIR Mental Health, 12, e80371.
Walters, W. H., & Wilder, E. I. (2023). Fabrication and errors in the bibliographic citations generated by ChatGPT. Scientific Reports, 13.
Samuel, G., & Wassenaar, D. (2025). Joint editorial: Informed consent and AI transcription of qualitative data. JERHRE.
UKM Research Ethics Secretariat. Guidelines and forms. ukm.my/jepukm
Disclosure of AI use: Claude (Anthropic) was used in August 2026 to search and screen policy documents, structure the slide sequence, and generate the display code. All policy sources were checked against the original documents by the speaker, who takes full responsibility for the accuracy and final content.
| → ↓ Space PageDown | Next slide (forward button on the remote) |
| ← ↑ PageUp Backspace | Previous slide (back button) |
| L | Switch animation mode: manual (one click = one step) or auto (self-repeating) |
| R | Restart this slide's animation from the beginning |
| M | Force animation on — overrides a machine's “reduce motion” accessibility setting |
| B . | Black screen / return (blank button) |
| F F5 | Fullscreen |
| G | Contents list — jump to any slide |
| T / Shift+T | 60-minute timer / reset |
| Home End | First / last slide |
| P | Print dialog for PDF export |
Manual mode (default): on the ten animated slides, the
remote's forward button advances the animation one step at a time, just like PowerPoint. After
the final step, the next click moves to the following slide. The back button steps backwards
before returning to the previous slide.
Auto mode: press L. Animations play and repeat
on their own with no clicks; forward goes straight to the next slide. The current mode is shown
in the bottom-right corner.
PDF export: press P, choose Save as PDF, Landscape, Margins: None, and enable Background graphics. Animations print in their final state.