Unable to sync contacts from SOGO 5 server

[Gchbg]

Hello,

I cannot get DAVx5 to sync contacts with a SOGO 5 server. It uploads contacts succesfully but is unable to download any contacts. Calendar sync works fine. Also, SOGO 2 works fine.

The relevant portion of the logs (with my e-mail address replaced by the string REDACTED):

2022-08-22 15:23:43 284 [syncadapter.SyncManager] Found remote resource: 1CB5E-63038300-D-75630000.vcf
2022-08-22 15:23:43 284 [syncadapter.SyncManager] 1CB5E-63038300-D-75630000.vcf has been added remotely, queueing download
2022-08-22 15:23:43 281 [syncadapter.ContactsSyncManager] Downloading 1 vCard(s): []
2022-08-22 15:23:43 281 [HttpClient] --> REPORT https://sogo5.servermx.com/SOGo/dav/REDACTED/Contacts/personal/ http/1.1
2022-08-22 15:23:43 281 [HttpClient] Depth: 0
2022-08-22 15:23:43 281 [HttpClient] User-Agent: DAVx5/4.2.2-gplay (2022/06/21; dav4jvm; okhttp/4.9.3) Android/12
2022-08-22 15:23:43 281 [HttpClient] Accept-Language: en-US, en;q=0.7, *;q=0.5
2022-08-22 15:23:43 281 [HttpClient] Content-Type: application/xml; charset=utf-8
2022-08-22 15:23:43 281 [HttpClient] Content-Length: 320
2022-08-22 15:23:43 281 [HttpClient] Host: sogo5.servermx.com
2022-08-22 15:23:43 281 [HttpClient] Connection: Keep-Alive
2022-08-22 15:23:43 281 [HttpClient] Accept-Encoding: gzip
2022-08-22 15:23:43 281 [HttpClient] 
2022-08-22 15:23:43 281 [HttpClient] <?xml version='1.0' encoding='UTF-8' ?><CARD:addressbook-multiget xmlns="DAV:" xmlns:CARD="urn:ietf:params:xml:ns:carddav"><prop><getcontenttype /><getetag /><CARD:address-data content-type="text/vcard" /></prop><href>/SOGo/dav/REDACTED/Contacts/personal/1CB5E-63038300-D-75630000.vcf</href></CARD:addressbook-multiget>
2022-08-22 15:23:43 281 [HttpClient] --> END REPORT (320-byte body)
2022-08-22 15:23:43 281 [at.bitfire.dav4jvm.BasicDigestAuthHandler] Adding Basic authorization header for https://sogo5.servermx.com/SOGo/dav/REDACTED/Contacts/personal/
2022-08-22 15:23:43 281 [HttpClient] <-- 207 Multi-Status https://sogo5.servermx.com/SOGo/dav/REDACTED/Contacts/personal/ (34ms)
2022-08-22 15:23:43 281 [HttpClient] Date: Mon, 22 Aug 2022 13:23:44 GMT
2022-08-22 15:23:43 281 [HttpClient] Server: Apache/2.4.54 (Debian)
2022-08-22 15:23:43 281 [HttpClient] Sogo-Request-Duration: 0.014449
2022-08-22 15:23:43 281 [HttpClient] Pragma: no-cache
2022-08-22 15:23:43 281 [HttpClient] Content-Type: text/xml; charset="utf-8"
2022-08-22 15:23:43 281 [HttpClient] Content-Length: 581
2022-08-22 15:23:43 281 [HttpClient] Cache-Control: no-cache
2022-08-22 15:23:43 281 [HttpClient] Access-Control-Allow-Origin: *
2022-08-22 15:23:43 281 [HttpClient] Keep-Alive: timeout=5, max=98
2022-08-22 15:23:43 281 [HttpClient] Connection: Keep-Alive
2022-08-22 15:23:43 281 [HttpClient] 
2022-08-22 15:23:43 281 [HttpClient] <?xml version="1.0" encoding="utf-8"?>
<D:multistatus xmlns:D="DAV:" xmlns:C="urn:ietf:params:xml:ns:carddav"><D:response><D:href>/SOGo/dav/REDACTED/Contacts/personal/1CB5E-63038300-D-75630000.vcf</D:href><D:propstat><D:prop><C:address-data>&#65279;BEGIN:VCARD
UID:1CB5E-63038300-D-75630000.vcf
VERSION:3.0
CLASS:PUBLIC
PROFILE:VCARD
N:TestLast;TestFirst
END:VCARD</C:address-data><D:getetag>&#65279;&quot;gcs00000000&quot;</D:getetag><D:getcontenttype>&#65279;text/x-vcard</D:getcontenttype></D:prop><D:status>HTTP/1.1 200 OK</D:status></D:propstat></D:response></D:multistatus>
2022-08-22 15:23:43 281 [HttpClient] <-- END HTTP (581-byte body)
2022-08-22 15:23:43 281 [syncadapter.ContactsSyncManager] Processing CardDAV resource 1CB5E-63038300-D-75630000.vcf
2022-08-22 15:23:43 281 [syncadapter.ContactsSyncManager] Received vCard without data, ignoring

Indeed, I can download the VCARD with curl just fine:

curl -u 'REDACTED' https://sogo5.servermx.com/SOGo/dav/REDACTED/Contacts/personal/1CB5E-63038300-D-75630000.vcf
BEGIN:VCARD
UID:1CB5E-63038300-D-75630000.vcf
VERSION:3.0
CLASS:PUBLIC
PROFILE:VCARD
N:TestLast;TestFirst
END:VCARD

Attempting to download any of my actual contacts has the same result.

An identical VCARD, when served by SOGO 2, is imported just fine.

curl -u 'REDACTED' https://sogo.servermx.com/SOGo/dav/REDACTED/Contacts/personal/7CF5-63038800-69-55C6E300.vcf
BEGIN:VCARD
UID:7CF5-63038800-69-55C6E300.vcf
VERSION:3.0
CLASS:PUBLIC
PROFILE:VCARD
N:TestLast;TestFirst
END:VCARD

2022-08-22 15:45:35 297 [syncadapter.ContactsSyncManager] Processing CardDAV resource 7CF5-63038800-69-55C6E300.vcf
2022-08-22 15:45:35 297 [syncadapter.ContactsSyncManager] Creating local contact
	PARAMETER #0 = at.bitfire.vcard4android.Contact@2ad945[addresses=[],anniversary=<null>,birthDay=<null>,categories=[],customDates=[],displayName=<null>,emails=[],familyName=TestLast,givenName=TestFirst,group=false,impps=[],jobDescription=<null>,jobTitle=<null>,members=[],middleName=<null>,nickName=<null>,note=<null>,organization=<null>,phoneNumbers=[],phoneticFamilyName=<null>,phoneticGivenName=<null>,phoneticMiddleName=<null>,prefix=<null>,relations=[],suffix=<null>,uid=7CF5-63038800-69-55C6E300.vcf,unknownProperties=BEGIN:VCARD
VERSION:3.0
CLASS:PUBLIC
PROFILE:VCARD
END:VCARD
,urls=[]]

Let me know if there's any further information I can provide. Thanks!

[devvv4ever]

We don't have a sogo 5 server yet. Can you maybe provide a test account for us and send the details to [email protected] - then we can have a look in detail. Maybe you also find details in the web server logs.

[Gchbg]

Thank you for your help!

I don't have access to the server logs as this server is part of a paid hosting service. However I could possibly contact their technical support with specific questions.

I have sent you the credentials to an empty test account. I have paid for it for the next 6 months.

[rfc2822]

Thanks for the test account. I found that your server sends an invalid byte-order mark (BOM) before every vCard content in response to a REPORT addressbook-multiget:

<?xml version="1.0" encoding="utf-8"?>
   <D:multistatus xmlns:D="DAV:" xmlns:C="urn:ietf:params:xml:ns:carddav"><D:response><D:href>/SOGo/dav/[email protected]/Contacts/personal/1CB5B-6303A900-7-3B8E0040.vcf</D:href><D:propstat><D:prop><C:address-data>&#65279;BEGIN:VCARD
   UID:1CB5B-6303A900-7-3B8E0040.vcf

Note the . It breaks parsing in compliant clients like DAVx5 (and Thunderbird). This needs to be fixed in SoGO. The related issue is: https://bugs.sogo.nu/view.php?id=5416 (I think there's already a fix available)

[Gchbg]

Thanks for the fast response! This sound like the likely culprit. The fix doesn't seem to have been merged yet, so I will wait until then to test again.