Use correct string encodings

[rafaqz]

dbase files specify the string encoding, and occasionally it's not ascii. We should probably read that and use something like:
https://github.com/JuliaStrings/StringEncodings.jl

To convert to UTF8.

See:
JuliaGeo/Shapefile.jl#63

[ErickChacon]

I have a dbf file that include the letter ñ (common in spanish). It is read adequately with ArchGDAL.jl, but not with Shapefile.jl which uses DBFTables.jl.

[rafaqz]

Yes that's expected currently, someone needs to implement what I suggested above.

Try a PR if you like.

[rafaqz]

A good approach would be to connect StringEncodings.jl to the dbf byte codes or "Language driver id" in the table here: http://www.dbase.com/Knowledgebase/INT/db7_file_fmt.htm

There is already a field for this in the header, we just don't use it

DBFTables.jl/src/DBFTables.jl

Line 54 in 7ea8090

lang_id::UInt8

We limit to ascii on write, we can also fix that:

DBFTables.jl/src/DBFTables.jl

Line 90 in 7ea8090

out = replace(rpad(x, len), !isascii => x -> '_' ^ textwidth(x))

Probably the reason its like this is there is no real spec for dbf, there are just implementations, and they differ:
https://stackoverflow.com/questions/52607578/where-is-the-definitive-official-specification-of-the-dbase-dbf-file-format

[ErickChacon]

I have no experience at all with DBFTables.jl, but I wil try to take a look and follow your suggestions.