Skip to content

[Bug]: a LOT of update in oc_filecache due to duplicatefinder? #164

@vincib

Description

@vincib

What happened?

Hi,

Here we have a Nextcloud 31.0.7 using DuplicateFinder 1.7.3

our Nextcloud have 3 325 712 files (counted in oc_filecache)

Recently, Nextcloud was found to be very very slow by our users. We investigated and found a php fpm doing thousands of updates in oc_filecache similar to :

UPDATE `oc_filecache` SET `mtime` = GREATEST(`mtime`, 1762311748), `etag` = '4f3e8a690abe4' WHERE (`storage` = 790) AND (`path_hash` IN ('d98f00b204e9800998ecf8427ed41d8c', 'df73a32cb03e437d88fd04924529ff0e', 'and other hashes...')) 

The problem is that those hundreeds of thousands of queries were batched in a single transaction, which took hours to finish...

We tried to cancel that transaction, and mariadb told us it had to rollback 6 millions lines 🤯

We finally disabled DuplicateFinder and that weird behavior stopped.

Relevant log output

Version

30.x

Installation Type

Standard Installation

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions