Panic on listing objects with huaweicloud

[mag1c1an1]

I am trying to list objects on hwcloud. But succeed on monio. Is there something wrong on my code?
This is my code.

pub fn s3_try_from_config() -> Result<S3> {
    let yaml_str = std::fs::read_to_string("config.yaml")?;
    let config: Config = serde_yaml::from_str(&yaml_str)?;
    println!("{:?}", config);
    Ok(S3::default()
        .endpoint(&config.endpoint)
        .access_key_id(&config.id)
        .secret_access_key(&config.key)
        .bucket(&config.bucket)
        .region(&config.region))
}

pub fn s3_try_from_env() -> Result<S3> {
    let endpoint = env::var("AWS_ENDPOINT")?;
    let id = env::var("AWS_ACCESS_KEY_ID")?;
    let key = env::var("AWS_SECRET_ACCESS_KEY")?;
    let bucket = env::var("AWS_BUCKET")?;
    let region = env::var("AWS_REGION").unwrap_or(String::from("auto"));
    println!("{} {} {} {} {} ", endpoint, id, key, bucket, region);
    Ok(S3::default()
        .endpoint(&endpoint)
        .access_key_id(&id)
        .secret_access_key(&key)
        .bucket(&bucket)
        .region(&region))
}

mod tests {
    use super::*;
    use opendal::{Operator, layers::LoggingLayer};
    use test_log::test;

    #[test(tokio::test)]
    async fn s3_test() {
        let op = Operator::new(s3_try_from_env().unwrap())
            .unwrap()
            .layer(LoggingLayer::default())
            .finish();
        let a = op.list("/").await.unwrap();
        for e in a {
            println!("{}", e.name());
        }
    }
}

panic backtrace：

thread 'app::tests::s3_test' panicked at /home/jiax/.cargo/registry/src/rsproxy.cn-e3de039b2554c837/opendal-0.53.3/src/raw/path.rs:68:5:
get rel path with root is invalid
stack backtrace:
   0: __rustc::rust_begin_unwind
             at /rustc/6b00bc3880198600130e1cf62b8f8a93494488cc/library/std/src/panicking.rs:697:5
   1: core::panicking::panic_fmt
             at /rustc/6b00bc3880198600130e1cf62b8f8a93494488cc/library/core/src/panicking.rs:75:14
   2: opendal::raw::path::build_rel_path
             at /home/jiax/.cargo/registry/src/rsproxy.cn-e3de039b2554c837/opendal-0.53.3/src/raw/path.rs:68:5
   3: <opendal::services::s3::lister::S3ListerV2 as opendal::raw::oio::list::page_list::PageList>::next_page::{{closure}}
             at /home/jiax/.cargo/registry/src/rsproxy.cn-e3de039b2554c837/opendal-0.53.3/src/services/s3/lister.rs:237:18
   4: <opendal::raw::oio::list::page_list::PageLister<L> as opendal::raw::oio::list::api::List>::next::{{closure}}
             at /home/jiax/.cargo/registry/src/rsproxy.cn-e3de039b2554c837/opendal-0.53.3/src/raw/oio/list/page_list.rs:100:49
   5: <opendal::raw::enum_utils::ThreeWays<ONE,TWO,THREE> as opendal::raw::oio::list::api::List>::next::{{closure}}
             at /home/jiax/.cargo/registry/src/rsproxy.cn-e3de039b2554c837/opendal-0.53.3/src/raw/enum_utils.rs:170:38
   6: <opendal::layers::error_context::ErrorContextWrapper<T> as opendal::raw::oio::list::api::List>::next::{{closure}}
             at /home/jiax/.cargo/registry/src/rsproxy.cn-e3de039b2554c837/opendal-0.53.3/src/layers/error_context.rs:422:14
   7: <opendal::raw::enum_utils::FourWays<ONE,TWO,THREE,FOUR> as opendal::raw::oio::list::api::List>::next::{{closure}}
             at /home/jiax/.cargo/registry/src/rsproxy.cn-e3de039b2554c837/opendal-0.53.3/src/raw/enum_utils.rs:233:38
   8: <opendal::layers::logging::LoggingLister<P,I> as opendal::raw::oio::list::api::List>::next::{{closure}}
             at /home/jiax/.cargo/registry/src/rsproxy.cn-e3de039b2554c837/opendal-0.53.3/src/layers/logging.rs:1152:37
   9: <core::pin::Pin<P> as core::future::future::Future>::poll
             at /home/jiax/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/src/rust/library/core/src/future/future.rs:124:9
  10: <opendal::types::list::Lister as futures_core::stream::Stream>::poll_next::{{closure}}
             at /home/jiax/.cargo/registry/src/rsproxy.cn-e3de039b2554c837/opendal-0.53.3/src/types/list.rs:70:45
  11: <opendal::types::list::Lister as futures_core::stream::Stream>::poll_next
             at /home/jiax/.cargo/registry/src/rsproxy.cn-e3de039b2554c837/opendal-0.53.3/src/types/list.rs:77:42
  12: <S as futures_core::stream::TryStream>::try_poll_next
             at /home/jiax/.cargo/registry/src/rsproxy.cn-e3de039b2554c837/futures-core-0.3.31/src/stream.rs:206:9
  13: <futures_util::stream::try_stream::try_collect::TryCollect<St,C> as core::future::future::Future>::poll
             at /home/jiax/.cargo/registry/src/rsproxy.cn-e3de039b2554c837/futures-util-0.3.31/src/stream/try_stream/try_collect.rs:46:26
  14: opendal::types::operator::operator::Operator::list_with::{{closure}}::{{closure}}
             at /home/jiax/.cargo/registry/src/rsproxy.cn-e3de039b2554c837/opendal-0.53.3/src/types/operator/operator.rs:1533:38
  15: opendal::types::operator::operator::Operator::list::{{closure}}
             at /home/jiax/.cargo/registry/src/rsproxy.cn-e3de039b2554c837/opendal-0.53.3/src/types/operator/operator.rs:1402:30
  16: rangeross::app::tests::s3_test::{{closure}}
             at ./src/app.rs:54:30
  17: <core::pin::Pin<P> as core::future::future::Future>::poll
             at /home/jiax/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/src/rust/library/core/src/future/future.rs:124:9
  18: <core::pin::Pin<P> as core::future::future::Future>::poll
             at /home/jiax/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/src/rust/library/core/src/future/future.rs:124:9
  19: tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}::{{closure}}::{{closure}}
             at /home/jiax/.cargo/registry/src/rsproxy.cn-e3de039b2554c837/tokio-1.46.1/src/runtime/scheduler/current_thread/mod.rs:742:54
  20: tokio::task::coop::with_budget
             at /home/jiax/.cargo/registry/src/rsproxy.cn-e3de039b2554c837/tokio-1.46.1/src/task/coop/mod.rs:167:5
  21: tokio::task::coop::budget
             at /home/jiax/.cargo/registry/src/rsproxy.cn-e3de039b2554c837/tokio-1.46.1/src/task/coop/mod.rs:133:5
  22: tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}::{{closure}}
             at /home/jiax/.cargo/registry/src/rsproxy.cn-e3de039b2554c837/tokio-1.46.1/src/runtime/scheduler/current_thread/mod.rs:742:25
  23: tokio::runtime::scheduler::current_thread::Context::enter
             at /home/jiax/.cargo/registry/src/rsproxy.cn-e3de039b2554c837/tokio-1.46.1/src/runtime/scheduler/current_thread/mod.rs:432:19
  24: tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}
             at /home/jiax/.cargo/registry/src/rsproxy.cn-e3de039b2554c837/tokio-1.46.1/src/runtime/scheduler/current_thread/mod.rs:741:36
  25: tokio::runtime::scheduler::current_thread::CoreGuard::enter::{{closure}}
             at /home/jiax/.cargo/registry/src/rsproxy.cn-e3de039b2554c837/tokio-1.46.1/src/runtime/scheduler/current_thread/mod.rs:829:68
  26: tokio::runtime::context::scoped::Scoped<T>::set
             at /home/jiax/.cargo/registry/src/rsproxy.cn-e3de039b2554c837/tokio-1.46.1/src/runtime/context/scoped.rs:40:9
  27: tokio::runtime::context::set_scheduler::{{closure}}
             at /home/jiax/.cargo/registry/src/rsproxy.cn-e3de039b2554c837/tokio-1.46.1/src/runtime/context.rs:176:26
  28: std::thread::local::LocalKey<T>::try_with
             at /home/jiax/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/src/rust/library/std/src/thread/local.rs:315:12
  29: std::thread::local::LocalKey<T>::with
             at /home/jiax/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/src/rust/library/std/src/thread/local.rs:279:15
  30: tokio::runtime::context::set_scheduler
             at /home/jiax/.cargo/registry/src/rsproxy.cn-e3de039b2554c837/tokio-1.46.1/src/runtime/context.rs:176:9
  31: tokio::runtime::scheduler::current_thread::CoreGuard::enter
             at /home/jiax/.cargo/registry/src/rsproxy.cn-e3de039b2554c837/tokio-1.46.1/src/runtime/scheduler/current_thread/mod.rs:829:27
  32: tokio::runtime::scheduler::current_thread::CoreGuard::block_on
             at /home/jiax/.cargo/registry/src/rsproxy.cn-e3de039b2554c837/tokio-1.46.1/src/runtime/scheduler/current_thread/mod.rs:729:19
  33: tokio::runtime::scheduler::current_thread::CurrentThread::block_on::{{closure}}
             at /home/jiax/.cargo/registry/src/rsproxy.cn-e3de039b2554c837/tokio-1.46.1/src/runtime/scheduler/current_thread/mod.rs:200:28
  34: tokio::runtime::context::runtime::enter_runtime
             at /home/jiax/.cargo/registry/src/rsproxy.cn-e3de039b2554c837/tokio-1.46.1/src/runtime/context/runtime.rs:65:16
  35: tokio::runtime::scheduler::current_thread::CurrentThread::block_on
             at /home/jiax/.cargo/registry/src/rsproxy.cn-e3de039b2554c837/tokio-1.46.1/src/runtime/scheduler/current_thread/mod.rs:188:9
  36: tokio::runtime::runtime::Runtime::block_on_inner
             at /home/jiax/.cargo/registry/src/rsproxy.cn-e3de039b2554c837/tokio-1.46.1/src/runtime/runtime.rs:356:47
  37: tokio::runtime::runtime::Runtime::block_on
             at /home/jiax/.cargo/registry/src/rsproxy.cn-e3de039b2554c837/tokio-1.46.1/src/runtime/runtime.rs:330:13
  38: rangeross::app::tests::s3_test
             at ./src/app.rs:49:24
  39: rangeross::app::tests::s3_test::{{closure}}
             at ./src/app.rs:49:23
  40: core::ops::function::FnOnce::call_once
             at /home/jiax/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/src/rust/library/core/src/ops/function.rs:250:5
  41: core::ops::function::FnOnce::call_once
             at /rustc/6b00bc3880198600130e1cf62b8f8a93494488cc/library/core/src/ops/function.rs:250:5

mc output:
mcli ls hwoss/dmetasoul-bucket
[2024-04-24 19:29:49 CST] 4.3GiB STANDARD Kylin-Server-V10-SP3-General-Release-2303-X86_64.iso
[2024-04-24 19:53:26 CST] 4.3GiB STANDARD Kylin-Server-V10-SP3-General-Release-2303-X86_64.vhd
[2024-04-25 12:33:41 CST] 9.9GiB STANDARD kylin-v10-sp3.vdi
......
log trace:

[dosubot[bot]]

Hi @mag1c1an1! I'm Dosu and I’m helping the opendal team.

This panic is likely caused by how OpenDAL handles the root path "/" for some S3-compatible services. There's a known issue where setting the root to "/" can cause path resolution errors, especially if the backend (like Huawei Cloud) interprets paths differently than MinIO. This has been seen before with other S3-compatible services and is related to how OpenDAL builds request paths internally, sometimes resulting in an invalid or empty path and triggering the "get rel path with root is invalid" panic see details.

Try changing your list call from op.list("/") to op.list("") (an empty string), or avoid specifying the root path if possible. This workaround has resolved similar issues for other users.

If the problem persists, enabling detailed logging in OpenDAL may help you capture the exact request/response and see what path is being sent to Huawei Cloud. If you can share the log trace or clarify how the root path is set in your config, I can help dig deeper.

To reply, just mention @dosu.

---

^{How did I do? Good | Irrelevant | Incorrect | Verbose | Hallucination | Report 🐛 | Other}   

[mag1c1an1]

Replacing with op.list("") panicked on same reason.