[SPARK-51815] Add Row struct

[dongjoon-hyun]

What changes were proposed in this pull request?

This PR aims to add Row struct and use it.

Why are the changes needed?

To make DataFrame APIs return Row instead of [String?] in Swift.

- public func collect() async throws -> [[String?]] {
+ public func collect() async throws -> [Row] {

- public func head(_ n: Int32 = 1) async throws -> [[String?]] {
+ public func head(_ n: Int32 = 1) async throws -> [Row] {

Note that Row is added to support general type fields, but this PR replaces the existing API's [String?] signature into Row-based signature. The detailed one-to-one mapping among other types will be handled later.

Does this PR introduce any user-facing change?

Yes, but this is a change to the unreleased version.

How was this patch tested?

Pass the CIs.

Was this patch authored or co-authored using generative AI tooling?

No.

[dongjoon-hyun]

Could you review this Row when you have some time, @viirya ? As you pointed out previously in the following of the previous collect PR, Row was not added until now. And, this PR is the first implementation.

• [SPARK-51508] Support collect(): [[String?]] for DataFrame #17 (comment)

[viirya]

This is still stored the value as string? So we still cannot insert column values into Row in their types?

[dongjoon-hyun]

Yes~ This is a part-one implementation to introduce Row struct like the note in the PR description.

Note that Row is added to support general type fields, but this PR replaces the existing API's [String?] signature into Row-based signature. The detailed one-to-one mapping among other types will be handled later.

[viirya]

Got it. Thank you.

[viirya]

Hmm, why the the second elements of the two items ["Location","file:/opt/spark/work-dir/spark-warehouse"],["Owner","185"] are * now?

[dongjoon-hyun]

During the Catalog PR, the cleaning methods were added previously. While regenerating answer files Today, I used the cleaned strings because the cleaned one is better in the GitHub repo.

spark-connect-swift/Tests/SparkConnectTests/SQLTests.swift

Lines 36 to 50 in 21724f5

	private func cleanUp(_ str: String) -> String {
	return removeOwner(removeID(removeLocation(str)))
	}
	private func removeID(_ str: String) -> String {
	return str.replacing(regexPlanId, with: "plan_id=").replacing(regexID, with: "#")
	}
	private func removeLocation(_ str: String) -> String {
	return str.replacing(regexLocation, with: "*")
	}
	private func removeOwner(_ str: String) -> String {
	return str.replacing(regexOwner, with: "*")
	}

[viirya]

I see. Thank you.

[dongjoon-hyun]

Thank you! Merged to main.