For a while video was a holdout of sorts - e.g. if someone posted video content of themselves or their voice you could trust a real person was behind it.
But now convincing fake video generation is easily accessible, so one more holdout stands to fall.
It does seem like some kind of ID system is going to be the only way. Sucky but inevitable.
I often have the following thought: technological advancement, for all its boons, inevitably leads down destructive roads in the long run. Sooner or later we open a pandora's box.
> convincing fake video generation is easily accessible, so one more holdout stands to fall.
Is it though? I have absolutely no doubt we'll get there but I haven't seen any evidence of this in the wild. My Youtube feed is becoming overrun with content with clearly generated scripts and often generated narration. But I haven't seen a single instance (that I'm aware of) of generated video being passed off as real.
Yes I have seen hundreds of tweets and reddit posts showcasing game-changing video technologies like AI face replacement and yes they look incredible in the 45 second demo reels, but every instance I have seen of real-world usage was comically bad.
The technology isn't inherently evil. The actual problem is the way our societies are set up, ironically incentivizing sociopathic behaviour even among members of a single nation, nevermind when geopolitics get involved.
I essentially see it like this: imagine giving a hand grenade to a three year old. The grenade isn't inherently evil, but it raises the existential stakes for that three year old and anyone in their vicinity.
There comes some hypothetical point where technology has advanced so much that anyone has the power to destroy the world.
But now convincing fake video generation is easily accessible, so one more holdout stands to fall.
It does seem like some kind of ID system is going to be the only way. Sucky but inevitable.
I often have the following thought: technological advancement, for all its boons, inevitably leads down destructive roads in the long run. Sooner or later we open a pandora's box.