Have you ever noticed that your smartphone Android suddenly runs out of space, although you have not installed anything new? Or did you find several identical photos in the gallery with a difference of seconds? These are classic signs file duplications of a problem that every third user faces. Duplicates don’t just take up precious space: they slow down the system, complicate the search for the necessary data, and can even lead to crashes in applications.

In this article we will figure out why Android creates copies of files, what types of duplicates exist (from harmless cache duplicates to dangerous "shadow" files), and how to distinguish system backups from garbage that can be deleted without risk to data. You'll learn simple ways to manually clean up, the best apps to automatically find duplicates, and what to do if duplicates appear over and over again. We will pay special attention to the hidden pastures of duplicates - folders DCIM/.thumbnails, Download and messenger caches, where copies of files multiply like mushrooms after rain.

What is file duplication and why is it a problem

Duplicate files on Android are identical copies of the same document, image, video or audio recording, stored in different folders or under different names. They do not arise by chance: the system or applications create them for specific purposes. For example:

  • 📸 Photo thumbnails in a folder .thumbnails — speed up loading of the gallery, but can weigh gigabytes.
  • 🔄 Backups from Google Photos or WhatsApp — insure against data loss, but often remain after recovery.
  • 📥 Incomplete downloads — when the file is downloaded again due to a connection failure.
  • 🤖 Application cache —temporary files that should be deleted automatically, but sometimes they get stuck.

The main danger of duplicates is inefficient use of memory. For example, 10 copies of a video weighing 100 MB each will take up 1 GB, although you only need the original. But there are other risks:

  • ⚡ System slowdown: the more files, the longer Android indexes them for search.
  • 🔍 Data confusion: when editing a file, it is not always clear which version relevant.
  • 🛑 Application crashes: some apps (for example, Telegram or Viber) may conflict when working with duplicate media files.
📊 How often do you check your smartphone memory for duplicate files?
Never
Once every six months
Only when space runs out
Regularly, once a month

It is interesting that on devices with Android 12+ and a file system F2FS duplicates may appear more often due to the peculiarities of the mechanism deduplication (combining identical blocks of data). This technological solution should save space, but sometimes it has the opposite effect.

The main reasons for the appearance of duplicates on Android

Duplicates do not come out of nowhere. Their creation is provoked both by user actions and internal system processes. Here are the key sources:

Cause Typical duplicate files How to prevent
Automatic backup (Google Photos, Mi Cloud) Photos, videos, contacts Disable synchronization for unnecessary folders
Errors during downloading (connection loss, repeated attempts) APK files, documents, music Use download managers with control checks amounts
Messenger caching (WhatsApp, Telegram) Photos, stickers, voice messages Limit automatic media loading in chat settings
File system errors (for example, after incorrectly removing the SD card) Any files with names like file(1).jpg Always use the "Safe Removal" function

The duplicates that it creates itself are especially insidious Android when updating the system. For example, when switching from Android 10 to Android 11 some users found files of the form backup_20231015.tar in the root folder of the device—archives with data from the previous OS version. Deleting them manually is dangerous: it is better to use the tool Settings → System → Backup → Delete old data.

💡

If you often move files between the internal memory and the SD card, use applications like Solid Explorer with the "Move and Replace" function. This will reduce the risk of creating duplicates when copying.

How to find duplicate files: manual and automatic methods

Before deleting duplicates, they need to be detected. There are two approaches: manual search (for experienced users) and automated (using specialized applications). Let's start with the first one.

Manual search for duplicates

To do this, you will need any file manager with a sorting function by size or date (for example, Files by Google, FX File Explorer). Follow the algorithm:

  1. Open the manager and go to Internal memory or SD card.
  2. Sort the files by size (descending) - duplicates often have the same weight.
  3. Check the folders:
    • 📁 DCIM/.thumbnails — photo thumbnails
    • 📁 Download — re-uploads
    • 📁 Android/data — application cache
    • 📁 Pictures/Screenshots —screenshots with the same content
  • Look for files with similar names, for example:
    • IMG_20231015_123456.jpg and IMG_20231015_123456(1).jpg
    • document.pdf and document_copy.pdf

    For convenience, you can use the command in ADB (requires developer mode enabled):

    adb shell find /sdcard -type f -exec md5sum {} + | sort | uniq -w32 -dD

    This command will find all files with the same checksum MD5 (i.e. identical).

    Applications for finding duplicates

    If the manual method seems complicated, use specialized utilities. The best of them:

    • 🔍 Files by Google (built-in Cleanup function) - finds duplicates of photos and documents.
    • 🧹 Duplicate Files Fixer - scans by content, not by name.
    • 📊 SD Maid - searches for duplicates in system folders (requires root for full access).
    • 🖼️ Remo Duplicate Photos Remover — specializes in media files.

    ☑️ Preparing to search for duplicates

    Done: 0 / 4

    Important: some applications (for example, CCleaner) may mark files with similar names but different contents as duplicates. Always check the scan results before deleting!

    How to safely remove duplicates without losing data

    Deleting duplicates is a more responsible process than searching for them. An error could result in the loss of your only copy of an important file. Follow this algorithm:

    1. Check the originality: before deleting, open the file and make sure you have a backup copy of it (for example, in Google Drive or on a PC).
    2. Use the recycle bin: many file managers (for example, Mi File Manager) send deleted files to the recycle bin, from where they can be recovered within 30 days.
    3. Start with the largest files: videos and archives take up more space, so cleaning them will give the maximum effect.
    4. Exclude system duplicates: do not touch files in folders:
      • /system
      • /data/app
      • /android/obb (game data is stored here)

    • To mass delete duplicate photos in Google Photos:

    1. Open the application and go to Photo → Utilities → Free up space.
    2. Click View duplicates —the system will show groups of identical pictures.
    3. Select which copies to leave (usually the highest quality), and click Delete.
      4. What to do if, after deleting duplicates, space is not freed up?

      This may occur due to the peculiarities of the file system Android. After deletion, files do not disappear instantly - they are marked as “free”, and the system uses their space for new data. To force clear the cache, reboot the device or use the command: 

      adb shell sync; adb shell echo 3 > /proc/sys/vm/drop_caches

      (requires developer rights).

      Be especially careful with duplicates in the folder WhatsApp/Media. The following are often stored here:

      • 📹 Videos automatically downloaded from chats (can be duplicated in Gallery).
      • 🎵 Voice messages with the same content, but different time stamps.
      • 🖼️ Stickers and GIF animations that WhatsApp caches for quick access.
    💡

    Never delete files with the extension .nomedia in messenger folders - they prevent duplication of media in the gallery, but are not garbage.

    Hidden duplicates: where to look and how to delete

    Not all duplicates are on the surface. Some are hidden in system folders or disguised as service files. Here's where to look for them:

    1. Folder .thumbnails (thumbnails)

    This folder contains small copies of all images and videos on the device. weigh from 500 MB to 2-3 GB, although the originals have long been deleted. To clear it:

    1. Open the file manager and turn on the display of hidden folders (in Files by Google: ⋮ → Settings → Show hidden files).
    2. Go to DCIM/.thumbnails.
    3. Delete all files inside. They will be restored automatically the next time you view the gallery.

    2. Application cache

    Many apps (for example, Instagram, TikTok) create temporary copies of content to speed up loading. To clear the cache:

    1. Go to Settings → Applications → [Select application] → Storage → Clear cache.
    2. For mass clearing, use SD Maid or CCleaner (section "Clearing the cache").

    3. Duplicates in cloud services

    Google Photos, Yandex Disk and other services can synchronize the same files several times. Check:

    • 📂 Folder Google Photos/Backup for copies from DCIM/Camera.
    • 🔄 Synchronization settings in Google Drive —sometimes files are duplicated between "My Drive" and "Sharing".
    💡

    If you use Mi Cloud on smartphones Xiaomi, check the folder MIUI/Backup/AllBackup. Old backup copies of applications that are taking up space may be stored here. up to 5-10 GB.

    4. Duplicates in the media database

    Sometimes Android erroneously indexes the same file several times. This appears as duplicate elements in the gallery or music player. To reset the media database:

    1. Go. in Settings → Applications → Show all → Media storage.
    2. Click Storage → Clear data.
    3. Reboot the device. media files.
    💡

    Cleaning the media database does not delete the files themselves, but only resets their index. This is safe, but after the procedure, the gallery and player will take longer to load on the first start.

    How to prevent duplicates from appearing in the future

    The fight against duplicates will be endless if you do not eliminate the reasons for their occurrence. measures:

    1. Set up backup

    Disable automatic uploading of unnecessary data to the cloud:

    • B Google Photos: Settings → Backup and synchronization → Select folders for backup.
    • V WhatsApp: ⋮ → Settings → Chat → Backup → Only when connected to Wi-Fi.

    2. Control downloads

    Use download managers with checking for duplicates:

    • 📥 Advanced Download Manager —allows you to resume downloading instead of creating a new copy.
    • 🔗 1DM+ —supports checksums to detect duplicates.

    3. Optimize the work of instant messengers.

    Limit automatic media loading:

    • V Telegram: Settings → Data and memory → Automatic media loading → Never.
    • V Viber: ⋮ → Settings → Media → Autoload → Wi-Fi only.

    4. Clean your device regularly

    Select 5 minutes a month for:

    • 🧹 Clearing the cache through Settings → Memory → Cached data.
    • 🔍 Checking the folder Download for unnecessary files.
    • 📁 Deleting old screenshots (folder Pictures/Screenshots).
    💡

    On smartphones Samsung with shell One UI there is a built-in "Device Care" tool (Settings → Device Maintenance), which automatically finds duplicates and offers to delete them.

    Frequent errors when working with duplicates and how to avoid them

    Many users, in an attempt to free up space, take actions that only aggravate the problem. Here are the most common mistakes:

    ⚠️ Attention: Deleting files from the folder /android/obb will lead to crashes in games. These files are not duplicates, but application data (level cache, textures and. etc.).

    1. Deleting files with the extension .nomedia

    These files do not take up much space (usually 0-1 KB), but they perform an important function: they hide folders from being scanned by a media player. By deleting them, you risk clogging the gallery with thousands of unnecessary images (for example, from. cache WhatsApp).

    2. Using "cleaners" without checking

    Applications like Clean Master or DU Speed Booster are often marked as duplicates:

    • 📄 Application configuration files (for example, com.android.providers.media.databases).
    • 🎵 Music files with the same metadata, but different bitrates.
    • 📋 Logs of system processes (folder /data/log).

    Always check what exactly the app suggests deleting!

    3. Cleaning the folder Android/data without backup

    Game saves, application settings and downloaded data are stored here. Deleting this folder is equivalent to resetting the application to factory settings. If you need to free up space, it is better to:

    • 🎮 Transfer heavy games to an SD card (if supported).
    • 🗑️ Manually delete unnecessary APKs from the folder Download.

    4. Ignoring duplicates in the cloud

    Many clear the phone's memory, but forget about Google Drive or Yandex Drivewhere the same files can stored in several copies. Check:

    • 📂 Trash folder in cloud services - files here take up space, although they seem to be deleted.
    • 🔄 Document versions c Google Docs/Sheets —old editions can duplicate current files.
    💡

    Before mass deleting duplicates, create a backup copy of important data on your PC or external drive. Even system tools like Google. Photo sometimes make mistakes when identifying “unnecessary” files.

    FAQ: Answers to frequently asked questions about duplicates on Android

    Is it possible to delete all files from a folder .thumbnails?

    Yes, it is safe. The folder contains only thumbnails (small copies of images), which the system will restore automatically the next time you view the gallery. From 500 MB to 3 GB will be freed. places.

    Why do they appear again after deleting duplicates in Google Photos do they appear again?

    This happens due to the "Backup and Synchronization" function. If you deleted duplicates on your phone, but they remain in the cloud, Google Photos will restore them the next time you update. Disable synchronization for unnecessary folders or delete duplicates directly in the web version Google Photos (photos.google.com).

    How to distinguish a duplicate from the original?

    Compare:

    • 📅 Date of creation: the original is usually older.
    • 📏 Size: duplicates can be compressed (for example, copies from WhatsApp weigh less than the originals).
    • 🏷️ Metadata: original photos contain EXIF data (location of shooting, camera model).

    Use applications like EXIF Viewer to view metadata.

    Why do more duplicates appear on the SD card than in the internal memory?

    This is due to the peculiarities of the file system FAT32/exFAT on memory cards:

    • 🔄 When copying files, the system can create temporary copies that are not always deleted.
    • 📁 Some applications (for example, cameras) save files first to internal memory and then duplicate them to SD.
    • 🛑 If you remove the card incorrectly (without the "Safely Remove" function), "ghost" duplicates appear - files with zero size.

    Solution: format the SD card in exFAT (if the device supports) and use the safe removal function.

    Can duplicate files slow down your phone?

    Yes, but indirectly. The duplicates themselves do not affect performance, but:

    • 🔍 Indexing: Android spends resources on scanning unnecessary files when searching or updating the gallery.
    • 📱 Lack of memory: if duplicates occupy the last gigabytes, the system begins to aggressively close background applications, which creates the impression "brakes".
    • 🔄 Fragmentation: on devices with FAT32 (for example, old SD cards), a large number of files increases fragmentation, slowing down reading/writing.

    Clearing duplicates especially noticeably speeds up work on devices with 16-32 GB of memory.

    Duplicating files on Android is a problem that is easier to prevent than to fix. Regular memory checks, proper backup settings and conscious use of instant messengers will help keep your device in order. If duplicates have already taken up a critical amount of space, start with the largest files (videos, archives) and system folders like .thumbnails. Remember: the main thing is not the number of deleted duplicates, but the safety of the original data.