Meta Discovers Deceptive Content Network Likely Generated by Artificial Intelligence

On Wednesday, June 9, the social media company Meta announced that it has found content 'likely generated by artificial intelligence' that is being deceptively published on its platforms, Facebook and Instagram. According to Meta, this generated content includes laudatory comments about Israel's management of the Gaza war, which can be seen under posts from international news organizations and American lawmakers on the company's platforms. The social media company stated in a quarterly security report that these accounts, posing as Jewish students, African Americans, and other concerned citizens, targeted audiences in the U.S. and Canada. Meta indicated that this campaign is linked to a political marketing firm based in Tel Aviv, Israel. The Israeli firm did not respond to a request for comment from Reuters. Meta has discovered some AI-generated content on its social media platforms for about five years. However, the company's new security report confirms the use of more advanced generative AI technologies that are widespread. Researchers are concerned that generative AI, which can quickly and cheaply produce human-like text, images, and even voices, could lead to the spread of misinformation and affect election outcomes. Nevertheless, Meta experts say that images of politicians generated by AI are still not entirely realistic and can be identified as fake. According to Meta, despite the advancements in generative AI technology, the social media company is not worried about disruptions or the dissemination of coordinated messages on its platforms. With upcoming elections in Europe and the U.S., Meta and other tech giants are under pressure to prevent potential misuse of new AI technology in this arena.