CHANGELOG.md

Changelog

Release 2.4.1 (October 31st 2022)

• Dependency Updates:
  • Jackson from 2.12.7 to 2.13.4
  • Jackson Databind from 2.12.7 to 2.13.4.2

Release 1.6.1 (October 31st 2022)

• Dependency Updates:
  • Jackson Databind from 2.13.4 to 2.13.4.2

Release 2.4.0 (September 15th 2022)

• Dependency Updates:
  • AWS SDK v2 from 2.16.86 to 2.17.247 (pull request)
  • AWS SDK v1 from 1.12.7 to 1.12.276 (pull request)
  • Kinesis Consumer Library from 1.14.0 to 1.14.8 (pull request)
  • Guava from 29.0-jre to 30.0-jre (pull request)
  • Jackson from 2.12.1 to 2.12.7 (pull request)
• Relax validation to support new AWS regions without SDK update (pull request)

Release 1.5.0 (September 15th 2022)

• Dependency Updates:
  • AWS SDK v2 from 2.16.86 to 2.17.247 (pull request)
  • AWS SDK v1 from 1.12.7 to 1.12.276 (pull request)
  • Kinesis Consumer Library from 1.14.0 to 1.14.8 (pull request)
  • Guava from 29.0-jre to 30.0-jre (pull request)
  • Jackson from 2.12.1 to 2.12.7 (pull request)

Release 2.3.1 (January 4th 2022)

• Update log4j test dependency to 2.17.1 (pull request)

Release 2.3.0 (November 1st 2021)

• EAGER EFO registration strategy no longer de-registers consumers (pull request)
• Unregistering metric reporting for closed shards (pull request)

Release 1.4.0 (November 1st 2021)

• EAGER EFO registration strategy no longer de-registers consumers (pull request)

Release 1.3.0 (August 17th 2021)

• Unregistering metric reporting for closed shards (pull-request)
• Backporting changes from v2.2.0 to v1.x
  • Refactor requestRecords to prevent AWS SDK/Netty threads blocking for EFO (pull request)
  • Optionally populate ClientConfiguration from properties for EFO (pull request)
  • Increasing read timeout to 6 minutes and enabling TCP keep alive for EFO (pull request)

Release 2.2.0 (August 3rd 2021)

• Refactor requestRecords to prevent AWS SDK/Netty threads blocking for EFO (pull request
• Optionally populate ClientConfiguration from properties for EFO (pull request
• Increasing read timeout to 6 minutes and enabling TCP keep alive for EFO (pull request

Release 2.1.0 (June 29th 2021)

• Dependency Updates:
  • AWS SDK v1 from 1.11.844 to 1.12.7 (pull request)
  • AWS SDK v2 from 2.13.52 to 2.16.86 (pull request)
  • AWS DynamoDB Streams Kinesis Adapater from 1.5.0 to 1.5.3 (pull request)
  • Guava from 18 to 29.0-jre (pull request 1, pull request 2)
  • Jackson from 2.10.1 to 2.12.1 (pull request)

Release 1.2.0 (June 29th 2021)

• Dependency Updates:
  • AWS SDK v1 from 1.11.844 to 1.12.7 (pull request)
  • AWS SDK v2 from 2.13.52 to 2.16.86 (pull request)
  • AWS DynamoDB Streams Kinesis Adapater from 1.5.0 to 1.5.3 (pull request)
  • Guava from 18 to 29.0-jre (pull request)
  • Jackson from 2.10.1 to 2.12.1 (pull request)

Release 1.1.2 (May 27th, 2021)

• Backport Fix issue where KinesisDataFetcher.shutdownFetcher() hangs. (issue, pull request)

• Backport - Log error when shutting down Kinesis Data Fetcher. (issue, pull request)

• Backport - Treating TimeoutException as Recoverable Exception. (issue, pull request)

• Backport - Add time-out for acquiring subscription and passing events from network to source thread to prevent deadlock. (pull request)

Release 2.0.3 (April 20th, 2021)

• Fix issue where KinesisDataFetcher.shutdownFetcher() hangs. (issue, pull request)

• Log error when shutting down Kinesis Data Fetcher. (issue, pull request)

• Treating TimeoutException as Recoverable Exception. (issue, pull request)

• Adding a SQL connector module for SQL client. (pull request)

Release 2.0.2 (March 29th, 2021)

• Add time-out for acquiring subscription and passing events from network to source thread to prevent deadlock. (pull request)

Release 2.0.1 (March 23rd, 2021)

• Fix PollingRecordPublisher to respect SHARD_GETRECORDS_INTERVAL_MILLIS. (pull request) (Apache Flink JIRA)

• Update EFO consumer error handling to treat Interrupted exceptions as non-recoverable. (pull request) (Apache Flink JIRA)

Release 2.0.0 (December 22nd, 2020)

• Add KDS connector support in the Table API and SQL layer. (pull request)

Release 1.1.1 (March 23rd, 2021)

• Fix PollingRecordPublisher to respect SHARD_GETRECORDS_INTERVAL_MILLIS. (pull request) (Apache Flink JIRA)

• Update EFO consumer error handling to treat Interrupted exceptions as non-recoverable. (pull request) (Apache Flink JIRA)

Release 1.1.0 (December 22nd, 2020)

• Migrate EFO consumers to use DescribeStreamSummary rather than DescribeStream. DescribeStreamSummary has a higher TPS quota, resulting in reduced startup time for high parallelism sources. You may need add IAM permission for kinesis:DescribeStreamSummary while upgrading to this version (pull request)

• Fix issue preventing DynamoDB stream consumers to start from LATEST (pull request, issue)

Release 1.0.4 (November 11th, 2020)

• Fix issue when Polling consumer using timestamp with empty shard (pull request)

Release 1.0.3 (November 6th, 2020)

• Optimise ShardConsumer to clone DersializationSchema once per object rather than once per record (pull request)

Release 1.0.2 (October 30th, 2020)

• Ignore ReadTimeoutException from SubcribeToShard retry policy to prevent app restarting due to high backpressure (pull request)

• Optimise error handling. Introduced a separate error delivery mechanism to improve performance under high backpressure (pull request)

Release 1.0.1 (October 19th, 2020)

Bug Fixes

• Fix HTTP client dependency issue when using EFO consumer with STS Assume Role credential provider (pull request).

• Dependency version updates:

  • org.apache.httpcomponents:httpclient => 4.5.9 (shaded)
  • org.apache.httpcomponents:httpcore => 4.4.11 (shaded)