fastdup is a powerful free tool designed to rapidly extract valuable insights from your image & video datasets. Assisting you to increase your dataset images & labels quality and reduce your data operations costs at an unparalleled scale.

Features

  • pip install fastdup from PyPI
  • Documentation available
  • Explore the results in a interactive web UI
  • Examples available
  • fastdup handles labeled/unlabeled datasets in image or video format, providing a range of features
  • High-quality analysis to identify duplicates/near-duplicates, outliers, mislabels, broken images, and low-quality images
  • Highly scalable, capable of processing 400M images on a single CPU machine. Scales up to billions of images
  • Optimized C++ engine enables high performance even on low-resource CPU machines
  • Runs locally or on your cloud infrastructure. Your data stays where it is

Project Samples

Project Activity

See All Activity >

Categories

Machine Learning

License

MIT License

Follow fastdup

fastdup Web Site

Other Useful Business Software
Gen AI apps are built with MongoDB Atlas Icon
Gen AI apps are built with MongoDB Atlas

Build gen AI apps with an all-in-one modern database: MongoDB Atlas

MongoDB Atlas provides built-in vector search and a flexible document model so developers can build, scale, and run gen AI apps without stitching together multiple databases. From LLM integration to semantic search, Atlas simplifies your AI architecture—and it’s free to get started.
Start Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of fastdup!

Additional Project Details

Operating Systems

Linux, Mac, Windows

Programming Language

Python

Related Categories

Python Machine Learning Software

Registered

2024-08-16