Skip to content

Conversation

@mkuemmel
Copy link
Collaborator

Checked it also on Raphael's dataset. And it does identify the bad apples.

@mkuemmel
Copy link
Collaborator Author

Perfect, also the check now happens earlier:

2025-09-26T19:42:03CEST BackgroundModel  INFO : Background for image: Masked(Masked(ProcessedImage(BufferedImage(/project/ls-mohr/users/martin.kuemmel/cluster_sepp_example/CORR-0268528-102.fits),ConstantImage<2048,4176>(0.070091))) with 0.0% weight image masked pixels;) with 38.0% weight image masked pixels; median: 0.0968899 rms: 4.06483!
2025-09-26T19:42:05CEST PsfPlugin ERROR : Failed loading a psf file: /project/ls-mohr/users/martin.kuemmel/cluster_sepp_example/CORR-0091740-102.psf
2025-09-26T19:42:05CEST SourceXtractor FATAL : Malformed variable PSF, coefficient matrices contains NANs
2025-09-26T19:42:05CEST Python::Interpreter  INFO : Python GIL acquired 63 times
INFO:    Cleaning up image.

@mkuemmel
Copy link
Collaborator Author

With only the good PSFEx files everything is golden:

bash-5.1$ tail euclid_slurm.usm-cl-bt01n2.11443608.err
2025-09-27T07:37:09CEST Progress  INFO : Elapsed: 10:29:39
2025-09-27T07:37:09CEST SourceXtractor  INFO : total 189544 sources detected
2025-09-27T07:37:09CEST ElementsProgram  INFO : ##########################################################
2025-09-27T07:37:09CEST ElementsProgram  INFO : #
2025-09-27T07:37:09CEST ElementsProgram  INFO : #  C++ program:  sourcextractor++ stops 
2025-09-27T07:37:09CEST ElementsProgram  INFO : #
2025-09-27T07:37:09CEST ElementsProgram  INFO : ##########################################################
2025-09-27T07:37:09CEST ElementsProgram  INFO : ##########################################################
2025-09-27T07:37:09CEST Python::Interpreter  INFO : Python GIL acquired 63 times
INFO:    Cleaning up image...

That was: 10 true cores, 20GB RAM and 10h run time.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants