Apache Spark™ Connect Client for Swift language is a subproject of Apache Spark and aims to provide Swift implementation of Spark Connect. 0.3.0
is the third release of Apache Spark Connect for Swift client. This is still experimental.
Website
https://apache.github.io/spark-connect-swift/
Swift Package Index
https://swiftpackageindex.com/apache/spark-connect-swift
Documentation
https://swiftpackageindex.com/apache/spark-connect-swift/0.3.0/documentation/sparkconnect
Full Changelog
Resolved Issues
- [SPARK-52220] Update
README.md
and integration test with Apache Spark 4.0.0 RC7 - [SPARK-52247] Upgrade
gRPC Swift Protobuf
to 1.3.0 - [SPARK-52248] Use
exact
versions of dependency - [SPARK-52268] Add
variant
SQL test and answer file - [SPARK-52269] Add
cast
SQL test and answer file - [SPARK-52271] Upgrade Spark to 4.0.0 in CIs and docs
- [SPARK-52274] Update ArrowReader/Writer with GH-44910
- [SPARK-52277] Upgrade Docker tags to
4.0.0
instead of4.0.0-preview2
- [SPARK-52289] Enable
jsonToDdl
test in Linux environment - [SPARK-52293] Use
super-linter
for markdown files - [SPARK-52298] Publish
apache/spark-connect-swift:pi
docker image - [SPARK-52301] Support
Decimal
type - [SPARK-52302] Improve
stop
to useReleaseSessionRequest
- [SPARK-52317] Identify
InvalidTypeException
inSparkConnectClient
- [SPARK-52318] Refactor
SparkConnectError
to simplify case names - [SPARK-52319] Add
(Catalog|Schema|TableOrView)NotFound
toSparkConnectError
- [SPARK-52320] Add
ColumnNotFound/InvalidViewName/TableOrViewAlreadyExists
toSparkConnectError
- [SPARK-52321] Add
SessionClosed
,SqlConfNotFound
,ParseSyntaxError
toSparkConnectError
- [SPARK-52322] Add
publish_image
GitHub Action job - [SPARK-52340] Update
ArrowWriter(Helper)?
andProtoUtil
with GH-43170 - [SPARK-52341] Upgrade Spark to 3.5.6 from 3.5.5 in Spark 3 and Iceberg integration tests
- [SPARK-52343] Download Apache Spark distributions via ASF Mirrors site
- [SPARK-52359] Upgrade
gRPC Swift NIO Transport
to 1.2.2 - [SPARK-52360] Upgrade
gRPC Swift
to 2.2.2 - [SPARK-52361] Support
executeCommand
inSparkSession
- [SPARK-52369] Fix
Session ID
to be lowercased always - [SPARK-52370] Update Requirement section to point the official Apache Arrow Swift repository
- [SPARK-52371] Update
Example
projects to use the latestmain
branch always - [SPARK-52373] Add
CRC32
struct - [SPARK-52374] Publish
apache/spark-connect-swift:web
docker image - [SPARK-52376] Support
addArtifact(s)?
inSparkSession