v0.1.11
This release brings in support for Spark 3.4.0 (the latest version of the 3.4.x series at the time of release) along with a new feature to provide a per-row flag indicating if the row matches the provided or inferred schema.
- Support for Spark 3.4
schemaMatchColumnName
option for indicating if each row matches the schema- Update of Spark versions to match releases available from Apache Spark, and the versions supported by supported Databricks Runtimes and Azure Synapse Analytics.
N.B. When using Databricks, please check the Spark version used by the runtime to ensure the correct version of the package is used.