Salesforce

Snowflake Connector for Kafka Release Notes

« Go Back

Information

 
Summary
Last Modified DateNovember 27, 2023
Article Body

This article contains the release notes for the Snowflake JDBC Driver, including the following when applicable:

  • Behavior changes
  • New features
  • Customer-facing bug fixes

 

Note: Beginning with the January 2022 release, all release note information for this connector is published on this page. For release note information for previous versions, see the Server Release Notes.

Note:As of September 2023, Snowflake Connector for Kafka release notes are published on the Snowflake documentation site and will no longer appear on this page. Please update any links you might have saved.

 

Version 2.0.1 (August 25, 2023)

New Features and Updates

  • Improved performance for schematization permission checks during rebalance.

Bug Fixes

  • Fixed a bug that caused missing data in tables due to issues with internal cache clearing during rebalancing.

Version 2.0.0 (July 31, 2023)

New Features and Updates

  • Snowpipe Streaming with Kafka Connector is now Generally Available.

Bug Fixes

  • None.

Version 1.9.4 (July 13, 2023)

New Features and Updates

  • One client configuration:
    • Introduced the enable.streaming.client.optimization option, which is enabled by default.
    • With this client optimization, only one client is created for multiple topic partitions per Kafka connector. This feature can reduce client runtime and lower migration cost by creating larger files.
    • Note that in a high throughput scenario (for example, 50 MB/s per connector), we recommend that you disable this property if you see an increase in latency or costs.
  • Permissions and security:
    • Unified Snowflake role and user for Snowpipe Streaming for table creation and insertion.
    • Upgraded guava dependency to 32.0.1.
    • Upgraded Snowpipe Streaming SDK dependency to 2.0.1.

Bug Fixes

  • Fixed a wrong result issue that offsets are skipped when schematization is enabled.
  • Snowpipe Streaming Channels are not closed on rebalance.

 

Version 1.9.3 (May 22, 2023)

New Features and Updates

  • Added the ability to use one Streaming Ingest client (Default to false).
  • Started using the MDC context logger.
  • Upgraded to the following versions:
    • Ingest SDK version 1.1.4
    • JDBC version 3.13.30

Bug Fixes

  • Fixed an issue related to using the GET command when using the downscoped token on GCP.
  • Fixed Snowpipe-based KC’s commit offset behavior.

 

 

Version 1.8.2 (November 18, 2022)

New Features

  • Added docker setup resources to the Kafka connect repo. 
  • Added multiple fixes for Kubernetes cluster schematization schema mapping.
  • Added the correlationId to logging.
  • Moved rows with JsonProcessingException into the DLQ instead of ignoring them.
  • Added log granularity instance id logging for tasks.
  • Added support for schema evolution with schematization. 
  • Increased the version of protobuf-java from 3.19.4 to 3.19.6 in /test/test_data/protobuf.
  • Checked the schema evolution table option.
  • Added security upgrade for com.fasterxml.jackson.core:jackson-databind from 2.13.2.1 to 2.13.4.2.

Bug Fixes

  • Fixed Blackduck vulnerabilities.

Version 1.6.8/1.8.1 (August 24, 2022)

Bug Fixes

  • Upgraded the jackson-core and jackson-databind libraries to versions 2.13.1 and 2/13/2/1, respectively, to fix some issues with version 1.6.7.

Version 1.7.2 (January 18, 2022)

Bug Fixes

  • Upgraded the snowflake-jdbc library to version 3.13.14.
  • Upgraded the jackson-core and jackson-databind libraries to 2.12.6 to resolve Possible DoS if using JDK serialization to serialize JsonNode.
 

Version 1.7.0 (January 18, 2022)

No customer facing changes.

 

Version 1.6.5 (January 18, 2022)

Bug Fixes

  • Upgraded the jackson-core and jackson-databind libraries to 2.12.6 to resolve Possible DoS if using JDK serialization to serialize JsonNode.
TitleSnowflake Connector for Kafka Release Notes
URL NameSnowflake-Connector-for-Kafka-Release-Notes
CategoryProduct Release
Sub Category 
Article Record TypeRelease Notes

Powered by