You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: website/blog/2022-12-14-databend-weekly-72.md
+17-23Lines changed: 17 additions & 23 deletions
Original file line number
Diff line number
Diff line change
@@ -88,22 +88,17 @@ Check out what we've done this week to make Databend even better for you.
88
88
89
89
Stay connected with the latest news about Databend.
90
90
91
-
#### Unifying Format Options and Removing `format_*` Settings
91
+
#### Breaking Change: Unified File Format Options
92
92
93
-
> ***Breaking Change*** We plan to unify the formatting options and remove `format_*` settings in the future.
94
-
> This means that we will **disable** the old format.
95
-
> Work is in progress and support for `FILE_FORMAT` has now been completed in streming load.
93
+
To simplify, we're rolling out a set of unified file format options as follows for the COPY INTO command, the Streaming Load API, and all the other cases where users need to describe their file formats:
96
94
97
-
##### Propose
98
-
99
-
In the new implementation, **only** use the snowflake style in any place (insert copy and "select from stage" later):
100
-
101
-
-`FILE_FORMAT = (type = 'CSV' some_option = '|')`
102
-
-`FILE_FORMAT = (format_name = 'MyCustomCSV')`
103
-
104
-
`FORMAT CSV` is retained for the ClickHouse handler.
MyCustomCSV is created using SQL like `CREATE FILE FORMAT`
99
+
- Please note that the current format options starting with `format_*` will be deprecated.
100
+
-`... FORMAT CSV ...` will still be accepted by the ClickHouse handler.
101
+
- Support for customized formats created by `CREATE FILE FORMAT ...` will be added in a future release: `... FILE_FORMAT = (format_name = 'MyCustomCSV') ....` .
107
102
108
103
**Learn More**
109
104
@@ -112,12 +107,11 @@ MyCustomCSV is created using SQL like `CREATE FILE FORMAT`
112
107
113
108
#### Open Sharing
114
109
115
-
Open Sharing is a cheap and secure datasharing protocol for databendquery on multi-cloud environments.
110
+
Open Sharing is a simple and secure data-sharing protocol designed for databend-query nodes running in a multi-cloud environment.
116
111
117
-
***Cheap**: Open Sharing allow data sharing via simple RESTful API sharing protocol, which is cheap and easy to understand.
118
-
***Secure**: Open Sharing protocol would verify allow incoming requesters identity and access permission and provide audit log.
119
-
***Multi-cloud**: Open Sharing is designed to work with different cloud platforms, including AWS, Azure, GCP, etc.
120
-
***Open source**: Open Sharing is an open source project
112
+
-**Simple & Free**: Open Sharing is open-source and basically a RESTful API implementation.
113
+
-**Secure**: Open Sharing verifies incoming requesters' identities and access permissions, and provides an audit log.
114
+
-**Multi-Cloud**: Open Sharing supports a variety of public cloud platforms, including AWS, Azure, GCP, etc.
121
115
122
116
**Learn More**
123
117
@@ -130,13 +124,13 @@ We're always open to cutting-edge technologies and innovative ideas. You're more
130
124
131
125
#### Refactoring Stage-Related Tests
132
126
133
-
We should use streaming upload to put files directly in the stage instead of in s3.
127
+
We're about to run stage-related tests again using the Streaming Load API to move files to a stage instead of an AWS command like this:
0 commit comments