Skip to content

ScalableDataFrame should support convenient writers and readers: read_csv, sdf.to_csv, etc #13

@adivekar-utexas

Description

@adivekar-utexas

Proposed behavior

Using Writer.of('csv').write(sdf, path='some_path.csv') feels less natural than sdf.to_csv('some_path.csv')

However, current dataframe writers support much more: parallel reading/writing etc. These should be passed as **kwargs to the to_csv call.

This change also needs to be careful about inflight changes: #12

Metadata

Metadata

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions