Deepfakes Detection Using Deep Learning

Résumé: Deepfakes or the hyper-realistic imitation of authentic audio-visual content, are widely spread techniques specially with the use of pre-trained generative adversarial network (GANs) that makes it easier to automatically swap a person's face with another in a video. Due to their devastating impacts on the world, distinguishing between real and deepfake videos has become a fundamental issue. Therefore, automated methods to identify these deepfake videos are required in light of recent public scandals. Much research has been devoted to developing detection methods to reduce the potential negative impact of deepfakes.In this study, we developed an open-source platform called « Deepfake Detection », it presents a new detection technique which consists of two parts: the first part is a binary classification model that can classify videos as fake or real. The second part is another model with different input and output from the first one. It can identify which generation method among these three: FaceSwap, Face2Face and DeepFakes were used to create these deepfakes (categorical classification). We collected our samples from FaceForensics++ dataset. The preprocessing phase was necessary for this study, from frame extraction to face cropping (Region of Interest) and data augmentation. After that we split our data into train and test sets. Next, Convolutional Neural Networks (CNNs) and transfer learning approaches were employed for this work, we implemented Seven CNN-pretrained models in the first part (binary classification), with several trials and different fine-tuning parameters to determine which model is the most suitable for our situation as well as the criteria that influenced our results. The selected CNN-pretrained models are: VGG16, Inception-v3, InceptionResNet-v2, Xception, MobileNet-V2, MobileNet-V3 and ResNet50-V2. Based on the evaluation results, we reached the highest accuracy of 100% with ResNet50-V2 in both parts (the binary and categorical classification). Lastly, we developed our web application, for users to interact with our models.

Publié dans la revue: