Skip to content

Latest commit

 

History

History
116 lines (78 loc) · 6.29 KB

CHANGELOG.md

File metadata and controls

116 lines (78 loc) · 6.29 KB
Raw

Changelog

Unreleased

0.8.0 - 2022-12-06

Added

  • Add new parameters for HTTP timeout configuration and thread pool size for Sink and Lookup source http requests.

Fixed

  • Fix issue with not cleaning Flink's internal task queue for AsyncIO requests after HTTP timeout in Lookup source - getindata#38

0.7.0 - 2022-10-27

  • Add to Lookup Source support for performing lookup on columns with complex types such as ROW, Map etc.
  • Add support for custom Json Serialization format for SQL Lookup Source when using GenericJsonQueryCreator The custom format can be defined using Flink's Factory mechanism. The format name can be defined using lookup-request.format option. The default format is json which means that connector will use FLink's json-format

0.6.0 - 2022-10-05

Added

  • Add support for other REST methods like PUT and POST to lookup source connector. The request method can be set using new optional lookup-source property lookup-method. If property is not specified in table DDL, GET method will be used for lookup queries.

0.5.0 - 2022-09-22

Added

  • Add Http Header value preprocessor mechanism, that can preprocess defined header value before setting it on the request.
  • Allow user to specify Authorization header for Basic Authentication. The value will be converted to Base64, or if it starts from prefix Basic , it will be used as is (without any extra modification).
  • Add TLS and mTLS support for Http Sink and Lookup Source connectors.
    New properties are:
    • gid.connector.http.security.cert.server - path to server's certificate.
    • gid.connector.http.security.cert.client - path to connector's certificate.
    • gid.connector.http.security.key.client - path to connector's private key.
    • gid.connector.http.security.cert.server.allowSelfSigned - allowing for self-signed certificates without adding them to KeyStore (not recommended for a production).
  • Add LookupQueryCreator and LookupQueryCreatorFactory interfaces (along with a "default" GenericGetQueryCreator implementation) for customization of queries prepared by Lookup Source for its HTTP requests.
  • Add ElasticSearchLiteQueryCreator that prepares q parameter query using Lucene query string syntax (in first versions of ElasticSearch called Search Lite).

0.4.0 - 2022-08-31

Added

  • Add new properties gid.connector.http.sink.error.code,gid.connector.http.sink.error.code.exclude, gid.connector.http.source.lookup.error.code and gid.connector.http.source.lookup.error.code.exclude to set HTTP status codes that should be interpreted as errors both for HTTP Sink and HTTP Lookup Source.
  • Use Flink's format support to Http Lookup Source.
  • Add HTTP Lookup source client header configuration via properties.
  • Add HttpPostRequestCallback and HttpPostRequestCallbackFactory interfaces (along with a "default" Slf4jHttpPostRequestCallback implementation) for customizable processing of HTTP Sink requests and responses in Table API.

Changed

  • Change dependency scope for org.apache.flink.flink-connector-base from compile to provided.
  • Changed DDL of rest-lookup connector. Dropped json-path properties, and add mandatory format property.

Removed

  • Remove dependency on org.apache.httpcomponents.httpclientfrom production code. Dependency is only for test scope.
  • Removed dependency on com.jayway.jsonpath.json-path

Fixed

  • Fix JavaDoc errors.

0.3.0 - 2022-07-21

  • Package refactoring. Hide internal classes that does not have to be used by API users under "internal" package. Methods defined in classes located outside "internal" package are considered "public API". Any changes to those methods should be communicated as "not backward compatible" and should be avoided.
  • Add checkstyle configuration to "dev" folder. Add checkstyle check during maven build
  • Add HTTP sink client header configuration via properties.

0.2.0 - 2022-07-06

0.1.0 - 2022-05-26

  • Implement basic support for Http connector for Flink SQL