Skip to content

bug: python created many MetaStoreProvider-created-19??? directories in the meta directory #18316

@l1t1

Description

@l1t1

Search before asking

  • I had searched in the issues and found no similar issues.

Version

1.2.768 linux

What's Wrong?

I run a file with python many times, it create many MetaStoreProvider-created-19??? directories

How to Reproduce?

create the /par/config2.toml.txt with below

[meta]
embedded_dir = "/par/"

# Storage config.
[storage]
# fs | s3 | azblob | obs | oss
type = "fs"
allow_insecure = true

[storage.fs]
data_path = "/par/"
allow_insecure = true

and q1.py with below

```python
import databend
databend.init_service( config = "/par/config2.toml.txt" )
from databend import SessionContext
ctx = SessionContext()
ctx.register_parquet("lineitem", "/par/fire/data/tables_pyarrow/scale-10.0/", pattern = "lineitem.parquet") #only once
df = ctx.sql("select count(*) from lineitem")
df.show()

then run python q1.py
BTW if I run it the file the second time
it reports
RuntimeError: DataFrame collect error: ViewAlreadyExists. Code: 2306, Text = 'lineitem' as view Already Exists.
I had to coment out the ctx.register_parquet line to run q1.py

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Metadata

Metadata

Assignees

No one assigned

    Labels

    C-bugCategory: something isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions