0.2.0

Apache Spark™ Connect Client for Swift language is a subproject of Apache Spark and aims to provide Swift implementation of Spark Connect. 0.2.0 is the second release of Apache Spark Connect for Swift client. This is still experimental.

Website

https://apache.github.io/spark-connect-swift/

Swift Package Index

https://swiftpackageindex.com/apache/spark-connect-swift

Documentation

https://swiftpackageindex.com/apache/spark-connect-swift/0.2.0/documentation/sparkconnect

Full Changelog

v0.1.0...0.2.0

Resolved Issues

• [SPARK-52030] Make all test suites serialized
• [SPARK-52048] Add Swift Web Server example repository link
• [SPARK-52058] Update README.md and integration test with Apache Spark 4.0.0 RC5
• [SPARK-52059] Fix DataFrame to use SparkSession's transportSecurity
• [SPARK-52061] Add getOption/isModifiable and set variants to RuntimeConf
• [SPARK-52063] Support newSession in SparkSession
• [SPARK-52064] Support first/take/toJSON in DataFrame
• [SPARK-52066] Support unpivot/melt/transpose in DataFrame
• [SPARK-52067] Add Examples directory
• [SPARK-52068] Add StreamingQuery actor
• [SPARK-52069] Support DataStreamReader and DataStreamWriter
• [SPARK-52070] Fix Swift 6.0 compilation error
• [SPARK-52071] Add stream example and revise Trigger names
• [SPARK-52072] Add option() variants to SparkSession.Builder and Data(Frame|Stream)Reader
• [SPARK-52073] Add pi example
• [SPARK-52074] Add Dockerfiles to all examples
• [SPARK-52075] Add Examples.md
• [SPARK-52083] Update Spark Connect-generated Swift source code with 4.0.0-rc5
• [SPARK-52084] Upgrade gRPC Swift to 2.2.0
• [SPARK-52085] Use release build in GitHub Action CI
• [SPARK-52089] Support StreamingQueryManager
• [SPARK-52091] Add function SQL test file and answer file
• [SPARK-52094] Support session_id parameter
• [SPARK-52094][FOLLOWUP] Fix the test case to respect SPARK_REMOTE env variable
• [SPARK-52097] Add Swift 6.0 GitHub Action CI
• [SPARK-52098] Support JDBC in DataFrameReader and Writer
• [SPARK-52119] Update README.md and integration test with Apache Spark 4.0.0 RC6
• [SPARK-52121] Enable GitHub Pages
• [SPARK-52123] Add Resources section
• [SPARK-52125] Create a daily linux integration test GitHub Action job
• [SPARK-52138] Upgrade gRPC Swift NIO Transport to 1.1.0
• [SPARK-52149] Add String.toExpression extension
• [SPARK-52150] Add Iceberg integration test GitHub Action job
• [SPARK-52151] DataFrameWriterV2.overwrite should handle condition
• [SPARK-52152] Fix Catalog.databaseExists to handle multi catalogs
• [SPARK-52155] Update .asf.yaml to show Spark Connect Swift website
• [SPARK-52162] Add DELETE/UPDATE and partitioned table tests
• [SPARK-52164] Support MergeIntoWriter
• [SPARK-52167] Support hint for DataFrame
• [SPARK-52168] Support to for DataFrame
• [SPARK-52172] Add checkpoint and localCheckpoint for DataFrame
• [SPARK-52182] Support withWatermark for DataFrame
• [SPARK-52183] Update SparkSQLRepl example to show up to 10k rows
• [SPARK-52196] Promote SparkSQLRepl code to Spark SQL REPL example
• [SPARK-52197] Upgrade gRPC Swift to 2.2.1