Adobe unveils a new AI tool that can detect photoshopped faces
Adobe in collaboration with researchers from the University of California, Berkeley, have developed an artificial intelligence (AI) tool that can detect whether images, videos, audios, and documents have been manipulated using Photoshop software. In other words, the AI tool will help identify fake images, videos, audios, and documents.
โWhile we are proud of the impact that Photoshop and Adobeโs other creative tools have made on the world, we also recognize the ethical implications of our technology,โ said the company in a blog post. โFake content is a serious and increasingly pressing issue.โ
The researchers have published their work in a new paper titled, โDetecting Photoshopped Faces by Scripting Photoshop,โ explaining how the AI detects the use of a Photoshop tool called โFace Aware Liquifyโ, which not only can make alterations to facial features, but also can make changes to facial expressions.
โThe featureโs effects can be delicate which made it an intriguing test case for detecting both drastic and subtle alterations to faces,โ said Adobe.
In order to detect manipulated images, videos, documents, and audio, Adobe trained a Convolutional Neural Network (CNN), a form of deep learning, on a database of paired faces that were modified using the Face Liquify feature of Photoshop. A subset of those photos was randomly chosen for training. In addition, an artist was hired to alter images that were mixed into the data set.
โWe started by showing image pairs (an original and an alteration) to people who knew that one of the faces was altered,โ says Adobe researcher Oliver Wang. โFor this approach to be useful, it should be able to perform significantly better than the human eye at identifying edited faces.โ
It showed the altered and unaltered images to some human volunteers to see how good or bad they are to identify which photo was fake. While humans were only able to detect the fake faces 53% of the time, the AI trained on manipulated photos were able to correctly identify 99% of them. The tool is even able to revert altered images to its original, unedited appearance, with results that impressed even the researchers.
โIt might sound impossible because there are so many variations of facial geometry possible. But, in this case, because deep learning can look at a combination of low-level image data, such as warping artifacts, as well as higher level cues such as layout, it seems to work,โ says Professor Alexei A. Efros, UC Berkeley.
โThe idea of a magic universal โundoโ button to revert image edits is still far from reality,โ Adobe researcher Richard Zhang, who helped conduct the work, added. โBut we live in a world where itโs becoming harder to trust the digital information we consume, and I look forward to further exploring this area of research.โ
According to Adobe, the AI is a major step towards verifying the validity of digital media created with Adobe tool and to identify and discourage misuse of images to spread fake news.
โThis is an important step in being able to detect certain types of image editing, and the undo capability works surprisingly well,โ says the head of Adobe Research, Gavin Miller. โBeyond technologies like this, the best defense will be a sophisticated public who know that content can be manipulated โ often to delight them, but sometimes to mislead them.โ
Also read-