v1.0.2

Bugs fix:
Fix bug in ingestion, in the escaping of json strings inserted to dynamic columns

v1.0.1

Bugs fix:
Fix bug in ingestion, as the flush size was not retrieved right and temp table name was normalized twice

v1.0.0

BREAKING CHANGES:

FEATURES:

• Flush immediately if blob larger than 100 mb
• New option for the sink writer KUSTO_CLIENT_BATCHING_LIMIT - to set the flush size

FIXES:
IngestionProperties mapping and flushImmediately are now operating on the staging table

v1.0.0-Beta-06

Please refer to the prerelease v1.0.0-beta-05

1.0.0-BETA-05

BREAKING CHANGES:

User must specify SaveMode.Append as before we just logged the specified save mode and ignored, docs were updated accordingly

FEATURES:

Reading parquet.snappy format as spark utilize it better
Ingestion is done once file is ready and not when all files are ready

FIXES:
timeout bug - was waiting - 1 second for
authentication failed when application only had reading permissions due to creation of ingestClient without
ClientRequestProperties did not work properly

v1.0.0-beta-04

bump version (#78)

Azure Data Explorer connector for Spark, Beta-03

• Add heuristics to automatically decide whether to use lean (direct query) or scale (via transient blob storage) read mode. 'KUSTO_READ_MODE' option is no longer supported (there is a debug option for testing purposes)
• Remove dependency on Jackson-core library
• Deprecate 'KUSTO_BLOB_SET_FS_CONFIG' option. Instead, cache relevant configuration and set if needed

Spark Kusto Connector release Beta-02

For details, refer to CHANGELIST.md

1.0.0-Beta-01

Initial preview release for Kusto Spark connector