Skip to content

v0.1.11

Compare
Choose a tag to compare
@dazfuller dazfuller released this 29 May 09:22
· 5 commits to main since this release
c2511ab

This release brings in support for Spark 3.4.0 (the latest version of the 3.4.x series at the time of release) along with a new feature to provide a per-row flag indicating if the row matches the provided or inferred schema.

  • Support for Spark 3.4
  • schemaMatchColumnName option for indicating if each row matches the schema
  • Update of Spark versions to match releases available from Apache Spark, and the versions supported by supported Databricks Runtimes and Azure Synapse Analytics.

N.B. When using Databricks, please check the Spark version used by the runtime to ensure the correct version of the package is used.