FEC Commissioner emphasizes necessity of ‘content moderation’ to combat AI-generated election misinformation.

TORONTO—A commissioner for the United States’ Federal Election Commission says that the government must compel tech companies to moderate more content in order to prevent the spread of AI-driven election disinformation.

Big Tech companies are creating a monster in AI that will unleash havoc on the U.S. electoral system, FEC Commissioner Ellen Weintraub said at the June 27 Collision tech conference.

“For business reasons, the tech companies created this monster,” Weintraub said.

“It is going to be harder and harder to tell what is true.”

US Wants Companies to Control Content

While technology has allowed for the “democratization of information,” Weintraub said, that democratization was hastening the spread of both true and false information.

Because the U.S. government is constitutionally barred from controlling speech and the press, Weintraub said, it would need to compel tech companies to adopt more strict “content moderation” policies to prevent the spread of misinformation.

This is particularly true in the age of AI, Weintraub said, saying that the “explosion of AI” would have profound effects on the electoral process as deepfakes and false information proliferate throughout the media ecosystem.

“Technology is having a huge impact on democracy,” Weintraub said.

To that end, Weintraub said that the tech companies controlling social media will have to “tame” the monster they created by reestablishing content moderation policies such as those used in the 2016 presidential election to thwart reported foreign election interference.

Only through a “whole of society effort,” with government and corporations working toward the same goal, could the “virality” of false information be combatted, Weintraub said.

The comments echoed recent remarks made by former Google CEO Eric Schmidt, who said in an interview with CNBC that “the 2024 elections are going to be a mess.”

“[Tech companies are] working on it, but they haven’t solved it yet,” Schmidt said. “And, in fact, the trust and safety groups are getting made smaller, not larger.”

Censorship and Surveillance Mar Government Misinformation Programs

Weintraub’s comments come as governments throughout the world struggle with balancing the liberty of their citizens and the potential threat posed by misleading or false information in times of crisis.

The United States is no exception to this trend. The websites for numerous government departments ranging from the Office of the Surgeon General to the Department of Homeland Security to the Food and Drug Administration all now house dedicated pages and multimedia content lamenting the rise of misinformation and disinformation.

“Inaccurate information spreads widely and at speed making it more difficult for the public to identify verified facts and advice from trusted sources, such as the FDA,” the agency says in one video on its website.

Some websites, including the FDA’s, portray misinformation as a virus not unlike Coronavirus, even going so far as to encourage Americans to “stop the spread.”

The nation’s recent experiences with government-backed content moderation is far from utopian, however. The executive branch currently faces multiple probes into alleged unconstitutional behavior across administrations including the use of content moderation policies as a tool for censorship and surveillance.

The Republican-led House Judiciary Select Subcommittee on the Weaponization of the Federal Government released a report (pdf)