Face recognition job not running

[restuccia]

Which version of recognize are you using?

8.2.0

Enabled Modes

Object recognition, Face recognition

TensorFlow mode

Normal mode

Downstream App

Memories App

Which Nextcloud version do you have installed?

30.0.6

Which Operating system do you have installed?

Debian 12

Which database are you running Nextcloud on?

MySQL

Which Docker container are you using to run Nextcloud? (if applicable)

No response

How much RAM does your server have?

16GB

What processor Architecture does your CPU have?

x86_64

Describe the Bug

The background face recognition job does not run correctly. Only a few photos have been classified, apparently four days ago when I installed Recognize.

I get the following error in the admin panel:

For context, I am running Nextcloud on Yunohost. Thanks!

Expected Behavior

The face recognition job should run, faces should be classified, and there should be no error in the admin panel.

To Reproduce

Install Recognize
Enable face recognition

Debug log

{"reqId":"XXXX","level":2,"time":"2025-02-18T12:21:28+00:00","remoteAddr":"","user":"--","app":"recognize","method":"","url":"--","message":"Problem with faces classifier","userAgent":"--","version":"30.0.6.2","exception":{"Exception":"ErrorException","Message":"Classifier process error","Code":0,"Trace":[{"file":"/var/www/nextcloud/apps/recognize/lib/Classifiers/Images/ClusteringFaceClassifier.php","line":104,"function":"classifyFiles","class":"OCA\\Recognize\\Classifiers\\Classifier","type":"->"},{"file":"/var/www/nextcloud/apps/recognize/lib/BackgroundJobs/ClassifyFacesJob.php","line":42,"function":"classify","class":"OCA\\Recognize\\Classifiers\\Images\\ClusteringFaceClassifier","type":"->"},{"file":"/var/www/nextcloud/apps/recognize/lib/BackgroundJobs/ClassifierJob.php","line":74,"function":"classify","class":"OCA\\Recognize\\BackgroundJobs\\ClassifyFacesJob","type":"->"},{"file":"/var/www/nextcloud/apps/recognize/lib/BackgroundJobs/ClassifyFacesJob.php","line":34,"function":"runClassifier","class":"OCA\\Recognize\\BackgroundJobs\\ClassifierJob","type":"->"},{"file":"/var/www/nextcloud/lib/public/BackgroundJob/Job.php","line":61,"function":"run","class":"OCA\\Recognize\\BackgroundJobs\\ClassifyFacesJob","type":"->"},{"file":"/var/www/nextcloud/lib/public/BackgroundJob/TimedJob.php","line":88,"function":"start","class":"OCP\\BackgroundJob\\Job","type":"->"},{"file":"/var/www/nextcloud/lib/public/BackgroundJob/TimedJob.php","line":75,"function":"start","class":"OCP\\BackgroundJob\\TimedJob","type":"->"},{"file":"/var/www/nextcloud/cron.php","line":162,"function":"execute","class":"OCP\\BackgroundJob\\TimedJob","type":"->"}],"File":"/var/www/nextcloud/apps/recognize/lib/Classifiers/Classifier.php","Line":240,"message":"Problem with faces classifier","exception":{},"CustomMessage":"Problem with faces classifier"}}
{"reqId":"XXXX","level":3,"time":"2025-02-18T12:21:28+00:00","remoteAddr":"","user":"--","app":"core","method":"","url":"--","message":"Error while running background job OCA\\Recognize\\BackgroundJobs\\ClassifyFacesJob (id: 144418, arguments: {\"storageId\":7,\"rootId\":78})","userAgent":"--","version":"30.0.6.2","exception":{"Exception":"ErrorException","Message":"Classifier process error","Code":0,"Trace":[{"file":"/var/www/nextcloud/apps/recognize/lib/Classifiers/Images/ClusteringFaceClassifier.php","line":104,"function":"classifyFiles","class":"OCA\\Recognize\\Classifiers\\Classifier","type":"->"},{"file":"/var/www/nextcloud/apps/recognize/lib/BackgroundJobs/ClassifyFacesJob.php","line":42,"function":"classify","class":"OCA\\Recognize\\Classifiers\\Images\\ClusteringFaceClassifier","type":"->"},{"file":"/var/www/nextcloud/apps/recognize/lib/BackgroundJobs/ClassifierJob.php","line":74,"function":"classify","class":"OCA\\Recognize\\BackgroundJobs\\ClassifyFacesJob","type":"->"},{"file":"/var/www/nextcloud/apps/recognize/lib/BackgroundJobs/ClassifyFacesJob.php","line":34,"function":"runClassifier","class":"OCA\\Recognize\\BackgroundJobs\\ClassifierJob","type":"->"},{"file":"/var/www/nextcloud/lib/public/BackgroundJob/Job.php","line":61,"function":"run","class":"OCA\\Recognize\\BackgroundJobs\\ClassifyFacesJob","type":"->"},{"file":"/var/www/nextcloud/lib/public/BackgroundJob/TimedJob.php","line":88,"function":"start","class":"OCP\\BackgroundJob\\Job","type":"->"},{"file":"/var/www/nextcloud/lib/public/BackgroundJob/TimedJob.php","line":75,"function":"start","class":"OCP\\BackgroundJob\\TimedJob","type":"->"},{"file":"/var/www/nextcloud/cron.php","line":162,"function":"execute","class":"OCP\\BackgroundJob\\TimedJob","type":"->"}],"File":"/var/www/nextcloud/apps/recognize/lib/Classifiers/Classifier.php","Line":240,"message":"Error while running background job OCA\\Recognize\\BackgroundJobs\\ClassifyFacesJob (id: 144418, arguments: {\"storageId\":7,\"rootId\":78})","exception":{},"CustomMessage":"Error while running background job OCA\\Recognize\\BackgroundJobs\\ClassifyFacesJob (id: 144418, arguments: {\"storageId\":7,\"rootId\":78})"}}

[SimonBard]

What happens when you run it manually ?

occ recognize:cluster-faces
or
occ recognize:classify

[tecbeat]

I’m experiencing the same issue with face clustering not working correctly.

The issue:
Only a few photos were classified right after I installed Recognize. Since then, the background face recognition job doesn’t run correctly. The admin panel shows an error, and the logs report:

occ recognize:cluster-faces

Result:

Clustering face detections for user xxx
ClusterDebug: Retrieving face detections for user xxx
ClusterDebug: Not enough face detections found
(for every user)

occ recognize:classify
(seems working)

Edit:
Failed to generate preview of 119679 with dimension 1024 with nextcloud preview manager: No provider successfully handled the preview generation
generating preview of 119679 with dimension 1024 using gdlib
PHP Fatal error: Allowed memory size of 536870912 bytes exhausted (tried to allocate 364603328 bytes) in /var/www/html/custom_apps/recognize/lib/Classifiers/Classifier.php on line 375
(Approximately 30GB of usable memory possible)

It seems face classification works individually, but clustering fails. Any ideas on how to fix or troubleshoot this?

Thanks in advance!

[marcelklehr]

Hey! What is the status of Node.js on your installation? Can you post a screenshot?

[tecbeat]

I have restarted the scanning, but it seems the queue is building up again.

[marcelklehr]

Mh, node.js looks good. Somehow the classifier process stops in an unforeseen way, perhaps because it's running out of memory. There should be another Warning-level log message above the "Classifier process error" message that logs the output from the process, can you check for that?

[marcelklehr]

Also, try reducing the batch size for face classification to 50 as is recommended for WASM mode

[tecbeat]

Thanks for your help! I set the batch size to 50, but it didn't significantly change anything and no new classifications were made. Unfortunately, I can't find any other errors.

[tecbeat]

[marcelklehr]

So, without more info on why the background job fails, I can't be of much help unfortunately. Do you have your log level set to higher than 2?

Regarding occ recognize:classify and recognize:cluster-faces: The classify command seems to fail due to an error in Nextcloud's preview generator, which recognize uses to scale images down. Not sure why it runs out of memory, but I can't help with that unfortunately. The cluster-faces command does not strictly-speaking fail, right now: As it says in the above screenshot you posted, each user must have at least 120 face recognitions before clustering kicks in for the respective user, as it is too unreliable with fewer face recognitions.