Governments love a good scapegoat. When a crisis hits, you do not blame the underlying cultural friction or the structural gaps in your own legal framework. You blame the algorithm.
The Malaysian government recently hauled TikTok over the coals, demanding answers for why the platform failed to block a fake account using artificial intelligence to insult the King. The mainstream media swallowed the narrative whole, framing this as a story about tech platforms failing to police their content. You might also find this similar story interesting: The AI Hindenburg and the Corporate Prisoner Dilemma Devouring Our Privacy.
This is a fundamental misunderstanding of how content moderation works.
Malaysia is demanding a technological solution to a human political problem. They want TikTok to act as a flawless digital shield for the monarchy. It is an impossible ask. Expecting automated systems to perfectly parse the nuance of regional political speech, deepfakes, and royal defamation is not just unrealistic; it betrays a profound ignorance of AI mechanics. As discussed in latest articles by Engadget, the effects are significant.
The Myth of the Perfect Content Filter
When regulatory bodies demand that platforms automatically block deepfakes or offensive content before they go live, they assume AI operates with absolute certainty. They think it is a binary switch. It is not.
Computer vision models and natural language processing systems do not understand the concept of "insulting the King." They analyze pixels, audio frequencies, and text strings based on probabilistic training data.
- The Context Blindspot: An AI can detect a face swap. What it cannot do is determine intent. Is the video a malicious smear campaign? Is it political satire? Is it a news report exposing the fake?
- The Scale Problem: TikTok processes millions of uploads per minute in Malaysia alone. To scan every video against a hyper-specific, legally complex standard like royal defamation requires a level of compute and contextual awareness that does not exist.
- The False Positive Trap: If TikTok tunes its automated moderation tools to be aggressive enough to catch every single potential royal slight, it will accidentally censor millions of ordinary citizens talking about history, politics, or current events.
I have spent years looking at content moderation architectures. I have seen tech firms pour tens of millions into content filtering only to realize that a slight shift in regional slang completely breaks the system. When you force a platform to choose between massive fines or over-censorship, they will choose over-censorship every time. That does not protect a monarchy. It just silences a population.
Why Malaysia Is Asking the Wrong Question
The questions being asked in parliament and by regulators are entirely flawed. They ask, "Why did TikTok let this happen?"
They should be asking, "Why do we believe a private company headquartered in California and Singapore should be the sole arbiter of our national legal standards?"
When a government passes the buck of enforcement to a social media platform, it admits a lack of sovereign control. It is an acknowledgment that local law enforcement cannot keep pace with digital speech. So, they lean on corporate entities to act as judge, jury, and executioner.
Consider the baseline mechanics of a deepfake attack on a public figure.
- Creation: A bad actor uses localized, open-source tools to generate a video. This does not happen on TikTok. It happens offline or on decentralized networks.
- Distribution: The asset is uploaded across dozens of burner accounts simultaneously using VPNs and automated scripts.
- Amplification: Human networks, driven by existing political polarization, share the content because it aligns with their biases.
TikTok is merely the venue where the asset lands. Blaming the venue for the existence of the patron is a broken strategy.
The Brutal Reality of Regional Content Moderation
Let's look at how content moderation actually functions behind the scenes. It is not a shiny operations room filled with supercomputers making flawless ethical choices. It is a grinding, highly flawed assembly line.
[User Upload]
β
βΌ
[Automated Hash Matching] ββ(Match Found)βββΊ [Immediate Takedown]
β
βΌ (No Direct Match)
[AI Predictive Scoring] ββ(High Risk)βββΊ [Human Moderator Queue]
β
βΌ
[8-Second Evaluation]
β
βΌ
[Keep Up or Remove]
This pipeline breaks down constantly when applied to niche political regulations, such as Malaysia's Sedition Act or royal defamation laws.
The human moderators checking this content are rarely legal scholars. They are third-party contractors based in regional hubs like Kuala Lumpur or Manila. They have roughly eight to fifteen seconds to look at a video, read the flags, and make a decision. They are working with a checklist.
If an account uses a sophisticated AI voice clone to deliver an insult wrapped in deep local subtext or obscure Malay slang, a human reviewer might miss it entirely. An automated scanner has even less chance.
Stop Chasing the Algorithm (Do This Instead)
If governments want to protect their institutions from digital manipulation, they must stop treating tech companies like utility providers that can just turn off the "bad content" valve. The current playbook is obsolete.
Here is how you actually address the threat of AI-driven political subversion.
Decentralize Verification, Don't Centralize Censorship
Instead of demanding that platforms catch every fake after it is uploaded, state institutions must adopt cryptographic verification protocols. If the palace or government ministries issue communication, it must be digitally signed using verifiable credentials. Let the public verify authenticity at the source, rather than forcing platforms to guess what is real.
Shift the Cost Burden to the Creators
The current system makes it free to generate and distribute malicious content, while the platform and the state bear the cost of cleanup. Regulators need to focus on tracking the financial pipelines of coordinated inauthentic behavior (CIB). Find the local entities funding the burner accounts and the compute power. Strip away their anonymity through banking and telecom choke points, not content reporting buttons.
Accept the Deflation of Media Trust
This is the hardest pill for any establishment to swallow. The era of a controlled information space is over. The more a government panics over a single AI-generated video, the more power they yield to the creators of that video. High-profile demands for explanations only signal vulnerability. They show that the institution is fragile enough to be disrupted by a pixelated asset on an algorithmic feed.
The demand for TikTok to explain itself is political theater. It provides the illusion of action while ignoring the reality that technology has outpaced the state's capacity to control information. You cannot algorithmically engineer reverence. You cannot code an AI to defend a crown.