Add JsonToJsonl task

[anna-geller]

Feature description

Too many users have to tediously do:

  - id: json_to_ion
    type: io.kestra.plugin.serdes.json.JsonToIon
    from: "{{ outputs.download.uri }}"
    newLine: false # regular json

  - id: ion_to_jsonl
    type: io.kestra.plugin.serdes.json.IonToJson
    from: "{{ outputs.json_to_ion.uri }}"
    newLine: true # JSON-L

Only to get from the JSON returned by a typical API to a JSON-L format needed by kestra tasks such as e.g. ForEachItem.

We should instead allow (without going through Ion):

  - id: json_to_jsonl
    type: io.kestra.plugin.serdes.json.JsonToJsonl
    from: "{{ outputs.download.uri }}"

full example showing the current state:

id: iterate_over_json
namespace: company.team

tasks:
  - id: download
    type: io.kestra.plugin.core.http.Download
    uri: "https://api.restful-api.dev/objects"
    contentType: application/json
    method: GET
    failOnEmptyResponse: true
    timeout: PT15S

  - id: json_to_ion
    type: io.kestra.plugin.serdes.json.JsonToIon
    from: "{{ outputs.download.uri }}"
    newLine: false # regular json

  - id: ion_to_jsonl
    type: io.kestra.plugin.serdes.json.IonToJson
    from: "{{ outputs.json_to_ion.uri }}"
    newLine: true # JSON-L

  - id: for_each_item
    type: io.kestra.plugin.core.flow.ForEachItem
    items: "{{ outputs.ion_to_jsonl.uri }}"
    batch:
      rows: 1
    namespace: company.team
    flowId: mysubflow
    wait: true
    transmitFailed: true
    inputs:
      json: "{{ json(read(taskrun.items)) }}"

[sanskar9415]

i would like to work on this issue, can u please assign this to me?

[anna-geller]

@sanskar9415 any progress on this? :) unassigned for now but if you're working on this, let us know