Skip to content

Bug for balanceddatapartition #437

@innovation-png

Description

@innovation-png

Describe the bug
I tried to use Release/balanceddatapartition to partition the dataset by the following command.
./balanceddatapartition -d 420 -v float -f XVEC -i msong/msong_base.fvecs -c 200 -m L2
Then, I got the following output.

[1] Using AVX512 InstructionSet!
Authorization required, but no authorization protocol specified
Authorization required, but no authorization protocol specified
Authorization required, but no authorization protocol specified
[1] rank 0  data:(994185,420) machines:1 clusters:200 type:3 threads:10 lambda:0.000000 samples:1000 maxcountperpartition:9941
[1] rank 0 init centers
[server:3290477] *** Process received signal ***
Segmentation fault (core dumped)

After add -t 1, the I got more error messages.

[1] Using AVX512 InstructionSet!
Authorization required, but no authorization protocol specified
Authorization required, but no authorization protocol specified
Authorization required, but no authorization protocol specified
[1] rank 0  data:(994185,420) machines:1 clusters:200 type:3 threads:1 lambda:0.000000 samples:1000 maxcountperpartition:9941
[1] rank 0 init centers
[server:3292645] *** Process received signal ***
[server:3292645] Signal: Segmentation fault (11)
[server:3292645] Signal code: Address not mapped (1)
[server:3292645] Failing at address: 0xc8000000f0
[server:3292645] [ 0] /lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x716f2fc42520]
[server:3292645] [ 1] ./balanceddatapartition(+0x24ab0)[0x5a2b66ecfab0]
[server:3292645] [ 2] /home/cur_usr/miniconda3/envs/test/lib/libgomp.so.1(GOMP_parallel+0x43)[0x716f2ff77c58]
[server:3292645] [ 3] ./balanceddatapartition(+0x8b46a)[0x5a2b66f3646a]
[server:3292645] [ 4] ./balanceddatapartition(+0x22e5c)[0x5a2b66ecde5c]
[server:3292645] [ 5] /lib/x86_64-linux-gnu/libc.so.6(+0x29d90)[0x716f2fc29d90]
[server:3292645] [ 6] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0x80)[0x716f2fc29e40]
[server:3292645] [ 7] ./balanceddatapartition(+0x23f25)[0x5a2b66ecef25]
[server:3292645] *** End of error message ***
Segmentation fault (core dumped)

I am not sure if I can use the Release/balanceddatapartition program for partitioning the data. Or can you please offer me some alternative choices to partition the dataset. The python binding seems to work well.

Thank you.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions