Discord Bug Bans 8,200 Users for Posting Grid Images
A bug in Discord's content moderation system has resulted in approximately 8,200 users being incorrectly banned since May for posting inoffensive images containing grids, such as chessboards, game textures, and video game inventory screenshots. The Verge reported that around 8,000 users were banned during this period, with an additional 200 banned over a recent weekend. Discord acknowledged the issue on X, stating that all affected accounts have been reinstated. The company explained that its safety systems use perceptual hashing to match images against known harmful material, but a bug prevented cleared accounts from being unbanned correctly. Discord said it is working on safeguards to prevent such "quiet" bans in the future. Perceptual hashing, as described by UK regulator Ofcom, converts images to grayscale, downsizes them, divides them into a grid, and assigns brightness values to create unique identifiers. This technology is used by Microsoft's PhotoDNA to combat CSAM and by platforms like Dropbox for copyright detection. The incident highlights the limitations of automated content moderation systems.
Key facts
- Discord banned around 8,200 users since May for posting images with grids.
- The bug affected users sharing chessboards, game textures, and video game inventory screenshots.
- Discord stated on X that all affected accounts have been reinstated.
- The company acknowledged a bug prevented cleared accounts from being unbanned.
- Discord's safety system uses perceptual hashing to match images against known harmful material.
- Perceptual hashing converts images to grayscale, downsizes them, and divides them into a grid.
- Microsoft's PhotoDNA uses perceptual hashing to combat CSAM.
- Dropbox uses similar technology for copyright detection.
Entities
Institutions
- Discord
- The Verge
- Ofcom
- Microsoft
- Dropbox
- Apple
- PetaPixel
- Meta
- Oversight Board
- Tumblr
- TechCrunch