-
Notifications
You must be signed in to change notification settings - Fork 602
Open
Description
Describe the bug
I tried to use Release/balanceddatapartition to partition the dataset by the following command.
./balanceddatapartition -d 420 -v float -f XVEC -i msong/msong_base.fvecs -c 200 -m L2
Then, I got the following output.
[1] Using AVX512 InstructionSet!
Authorization required, but no authorization protocol specified
Authorization required, but no authorization protocol specified
Authorization required, but no authorization protocol specified
[1] rank 0 data:(994185,420) machines:1 clusters:200 type:3 threads:10 lambda:0.000000 samples:1000 maxcountperpartition:9941
[1] rank 0 init centers
[server:3290477] *** Process received signal ***
Segmentation fault (core dumped)
After add -t 1, the I got more error messages.
[1] Using AVX512 InstructionSet!
Authorization required, but no authorization protocol specified
Authorization required, but no authorization protocol specified
Authorization required, but no authorization protocol specified
[1] rank 0 data:(994185,420) machines:1 clusters:200 type:3 threads:1 lambda:0.000000 samples:1000 maxcountperpartition:9941
[1] rank 0 init centers
[server:3292645] *** Process received signal ***
[server:3292645] Signal: Segmentation fault (11)
[server:3292645] Signal code: Address not mapped (1)
[server:3292645] Failing at address: 0xc8000000f0
[server:3292645] [ 0] /lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x716f2fc42520]
[server:3292645] [ 1] ./balanceddatapartition(+0x24ab0)[0x5a2b66ecfab0]
[server:3292645] [ 2] /home/cur_usr/miniconda3/envs/test/lib/libgomp.so.1(GOMP_parallel+0x43)[0x716f2ff77c58]
[server:3292645] [ 3] ./balanceddatapartition(+0x8b46a)[0x5a2b66f3646a]
[server:3292645] [ 4] ./balanceddatapartition(+0x22e5c)[0x5a2b66ecde5c]
[server:3292645] [ 5] /lib/x86_64-linux-gnu/libc.so.6(+0x29d90)[0x716f2fc29d90]
[server:3292645] [ 6] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0x80)[0x716f2fc29e40]
[server:3292645] [ 7] ./balanceddatapartition(+0x23f25)[0x5a2b66ecef25]
[server:3292645] *** End of error message ***
Segmentation fault (core dumped)
I am not sure if I can use the Release/balanceddatapartition program for partitioning the data. Or can you please offer me some alternative choices to partition the dataset. The python binding seems to work well.
Thank you.
Metadata
Metadata
Assignees
Labels
No labels