Releases: Azure/azure-kusto-spark
Releases · Azure/azure-kusto-spark
v3.0_3.0.2
** Bug Fix from v3.0.1 **
- Fix NPE on move extents when target is materialized views
- Don't swallow timeout exception on queued ingestion
** New Feature **
- New option -KUSTO_POLLING_ON_DRIVER - Polling and Move extents as spark job - currently disabled by default - next version will be enabled by default
v3.0.1
** New Features**
- Upgrade to kusto java sdk v3.1.1
** Bug fix **
- Fix device authentication
- Avoid deprecated mapping ingestion property
- Don't fail on alias extract
- Materialized view move extents flag should only be used on engine v3
** Known Issue **
- Doesn't work with materialized views
2.4_3.0.1
3.0_3.0.0
New Features
- Transient storage is now a structure that can contain multiple storage credentials. This is supported by the new option,
KUSTO_TRANSIENT_STORAGE
. - Add support for Materialized Views by using new SetNewIngestionTime feature in such cases
Breaking Changes
- The following were removed:
- KUSTO_BLOB_CONTAINER("blobContainer")
- KUSTO_BLOB_STORAGE_ACCOUNT_NAME("blobStorageAccountName")
- KUSTO_BLOB_STORAGE_ACCOUNT_KEY("blobStorageAccountKey")
- KUSTO_BLOB_STORAGE_SAS_URL("blobStorageSasUrl")
- Renamed KUSTO_MAX_RETRIES_ON_MOVR_EXTENTS to KUSTO_MAX_RETRIES_ON_MOVE_EXTENTS
Fixes
- Source shouldn't implement TableScan as we have PruneFilterScan
- Remove some redundant code around storage and put partition options inside read options
2.4_3.0.0
New Features
- Transient storage is now a structure that can contain multiple storage credentials. This is supported by the new option,
KUSTO_TRANSIENT_STORAGE
. - Add support for Materialized Views by using new SetNewIngestionTime feature in such cases
Breaking Changes
- The following were removed:
- KUSTO_BLOB_CONTAINER("blobContainer")
- KUSTO_BLOB_STORAGE_ACCOUNT_NAME("blobStorageAccountName")
- KUSTO_BLOB_STORAGE_ACCOUNT_KEY("blobStorageAccountKey")
- KUSTO_BLOB_STORAGE_SAS_URL("blobStorageSasUrl")
- Renamed KUSTO_MAX_RETRIES_ON_MOVR_EXTENTS to KUSTO_MAX_RETRIES_ON_MOVE_EXTENTS
Fixes
- Source shouldn't implement TableScan as we have PruneFilterScan
- Remove some redundant code around storage and put partition options inside read options
3.0_2.9.3
** Bug Fix **
- Remove retention policy if creation time specified
2.4_2.9.3
3.0_2.9.2
** Bug Fix **
- Move extents is now an async operation so that it doesn't timeout
v3.0_2.9.1
Bug Fix:
- Azure hadoop is now set to provided scope
- ClientRequestProperties option can be used on write operations (used for schema check operation, table creation and move extents)
- Transient errors check on extents move retry + specific handling of timeout until changed from SDK side
2.4_2.9.1
Bug Fix:
- Azure hadoop is now set to provided scope
- ClientRequestProperties option can be used on write operations (used for schema check operation, table creation and move extents)
- Transient errors check on extents move retry + specific handling of timeout until changed from SDK side