encoding problem when reading csv file

[mattiat]

PCA works with our usual colaus1.focus.mr file however when I made a smaller csv file just by copy-pasting part of our original file it failed in reading the file. It seems to be an encoding problem using csv.reader. One way to fix it is to use pandas.read_csv() which doesn’t seem to have this problem.

[mattiat]

I remove a few lines (simply using Excel) from colaus1.focus.mr and the method run without error.

@BKhalili Can you share the file? What program did you use when you copy/pasted?
I think it might have changed the encoding...
https://en.wikipedia.org/wiki/Endianness
https://stackoverflow.com/questions/17912307/u-ufeff-in-python-string

[BKhalili]

I also used Excel but copied few lines to a new file. Yes as I mentioned it is an encoding problem. However I think we should make sure that this error will not occur for other users. For example pandas read_csv doesn't have this problem. I will email you the data file I created.

[BKhalili]

This problem still exists.