JSON as String in road subtype?

[larsskaug]

The road subtype in segments is a json of type string. Is that on purpose? It makes parsing this object hard in Spark. Can it be changed to a struct?

Here's what I see:

I read in segments as geoparquet as follows:

spark.read.format("geoparquet").load(baseURL+"theme=transportation/type=segment")

The resulting schema looks like this. Note that the road segment is a string.

root
 |-- id: string (nullable = true)
 |-- geometry: geometry (nullable = true)
 |-- bbox: struct (nullable = true)
 |    |-- xmin: float (nullable = true)
 |    |-- xmax: float (nullable = true)
 |    |-- ymin: float (nullable = true)
 |    |-- ymax: float (nullable = true)
 |-- version: integer (nullable = true)
 |-- update_time: string (nullable = true)
 |-- sources: array (nullable = true)
 |    |-- element: struct (containsNull = true)
 |    |    |-- property: string (nullable = true)
 |    |    |-- dataset: string (nullable = true)
 |    |    |-- record_id: string (nullable = true)
 |    |    |-- confidence: double (nullable = true)
 |-- subtype: string (nullable = true)
 |-- names: struct (nullable = true)
 |    |-- primary: string (nullable = true)
 |    |-- common: map (nullable = true)
 |    |    |-- key: string
 |    |    |-- value: string (valueContainsNull = true)
 |    |-- rules: array (nullable = true)
 |    |    |-- element: struct (containsNull = true)
 |    |    |    |-- variant: string (nullable = true)
 |    |    |    |-- language: string (nullable = true)
 |    |    |    |-- value: string (nullable = true)
 |    |    |    |-- between: array (nullable = true)
 |    |    |    |    |-- element: double (containsNull = true)
 |    |    |    |-- side: string (nullable = true)
 |-- class: string (nullable = true)
 |-- connector_ids: array (nullable = true)
 |    |-- element: string (containsNull = true)
 |-- road: string (nullable = true)

[brad-richardson]

Thanks @larsskaug for the feedback! This has been a common pain point and we have some ideas to resolve, could you read through this proposal and give us your thoughts? OvertureMaps/schema#184

[brad-richardson]

We've now removed the road JSON entirely in favor of top-level structured properties.