Skip to content

REST API OffsetPaginator has_more params missing from OffsetPaginatorConfig #3548

@michaelconan

Description

@michaelconan

dlt version

1.20

Describe the problem

When the has_more option was added to OffsetPaginator, I missed an update to the typing for OffsetPaginatorConfig to allow this configuration via dictionary.

Expected behavior

Support for OffsetPaginator.has_more_path as follows:

resource = {
  "endpoint": {
    "paginator": {
        "type": "offset",
        "has_more_path": "hasMore",
    },
  }
}

Steps to reproduce

Configure RestAPI resource with paginator configuration:

resource = {
  "endpoint": {
    "paginator": {
        "type": "offset",
        "has_more_path": "hasMore",
    },
  }
}

Operating system

Linux

Runtime environment

Docker, Docker Compose

Python version

3.12

dlt data source

RestAPI

dlt destination

Google BigQuery

Other deployment details

No response

Additional information

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    questionFurther information is requested

    Type

    No type

    Projects

    Status

    Todo

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions