Skip to content

Releases: Azure/azure-kusto-spark

v3.0_3.0.2

25 Jul 19:07
28c5b59
Compare
Choose a tag to compare

** Bug Fix from v3.0.1 **

  • Fix NPE on move extents when target is materialized views
  • Don't swallow timeout exception on queued ingestion

** New Feature **

  • New option -KUSTO_POLLING_ON_DRIVER - Polling and Move extents as spark job - currently disabled by default - next version will be enabled by default

v3.0.1

23 Jun 12:05
Compare
Choose a tag to compare

** New Features**

  • Upgrade to kusto java sdk v3.1.1

** Bug fix **

  • Fix device authentication
  • Avoid deprecated mapping ingestion property
  • Don't fail on alias extract
  • Materialized view move extents flag should only be used on engine v3

** Known Issue **

  • Doesn't work with materialized views

2.4_3.0.1

23 Jun 12:21
Compare
Choose a tag to compare

** New Features**

  • Upgrade to kusto java sdk v3.1.1

** Bug fix **

  • Fix device authentication
  • Avoid deprecated mapping ingestion property
  • Don't fail on alias extract
  • Materialized view move extents flag should only be used on engine v3

3.0_3.0.0

15 Mar 07:38
bbea730
Compare
Choose a tag to compare

New Features

  1. Transient storage is now a structure that can contain multiple storage credentials. This is supported by the new option, KUSTO_TRANSIENT_STORAGE.
  2. Add support for Materialized Views by using new SetNewIngestionTime feature in such cases

Breaking Changes

  1. The following were removed:
  • KUSTO_BLOB_CONTAINER("blobContainer")
  • KUSTO_BLOB_STORAGE_ACCOUNT_NAME("blobStorageAccountName")
  • KUSTO_BLOB_STORAGE_ACCOUNT_KEY("blobStorageAccountKey")
  • KUSTO_BLOB_STORAGE_SAS_URL("blobStorageSasUrl")
  1. Renamed KUSTO_MAX_RETRIES_ON_MOVR_EXTENTS to KUSTO_MAX_RETRIES_ON_MOVE_EXTENTS

Fixes

  1. Source shouldn't implement TableScan as we have PruneFilterScan
  2. Remove some redundant code around storage and put partition options inside read options

2.4_3.0.0

15 Mar 07:36
Compare
Choose a tag to compare

New Features

  1. Transient storage is now a structure that can contain multiple storage credentials. This is supported by the new option, KUSTO_TRANSIENT_STORAGE.
  2. Add support for Materialized Views by using new SetNewIngestionTime feature in such cases

Breaking Changes

  1. The following were removed:
  • KUSTO_BLOB_CONTAINER("blobContainer")
  • KUSTO_BLOB_STORAGE_ACCOUNT_NAME("blobStorageAccountName")
  • KUSTO_BLOB_STORAGE_ACCOUNT_KEY("blobStorageAccountKey")
  • KUSTO_BLOB_STORAGE_SAS_URL("blobStorageSasUrl")
  1. Renamed KUSTO_MAX_RETRIES_ON_MOVR_EXTENTS to KUSTO_MAX_RETRIES_ON_MOVE_EXTENTS

Fixes

  1. Source shouldn't implement TableScan as we have PruneFilterScan
  2. Remove some redundant code around storage and put partition options inside read options

3.0_2.9.3

30 Sep 14:27
ad01daa
Compare
Choose a tag to compare

** Bug Fix **

  • Remove retention policy if creation time specified

2.4_2.9.3

30 Sep 14:27
Compare
Choose a tag to compare

** Bug Fix **

  • Remove retention policy if creation time specified

3.0_2.9.2

14 Sep 08:06
44e4fee
Compare
Choose a tag to compare

** Bug Fix **

  • Move extents is now an async operation so that it doesn't timeout

v3.0_2.9.1

23 Aug 10:56
5edf903
Compare
Choose a tag to compare

Bug Fix:

  • Azure hadoop is now set to provided scope
  • ClientRequestProperties option can be used on write operations (used for schema check operation, table creation and move extents)
  • Transient errors check on extents move retry + specific handling of timeout until changed from SDK side

2.4_2.9.1

23 Aug 10:59
Compare
Choose a tag to compare

Bug Fix:

  • Azure hadoop is now set to provided scope
  • ClientRequestProperties option can be used on write operations (used for schema check operation, table creation and move extents)
  • Transient errors check on extents move retry + specific handling of timeout until changed from SDK side