I cannot get a deployment to work outside of the demo template

[ntrp]

Hello, I am trying to get the simplest deploy example to work as a standalone program, not in the scope of the demo template.

I keep getting errors like this:

error[E0432]: unresolved import `hydro_template`                                                                                                                                                                                                                                                             
   --> (full path) /Users/ntrp/_pws/hydro-rs-demo/target/hydro_trybuild/hydro-template/src/bin/_process_0_0FA3FE05.rs:154:9                                                                                                                                                                                  
    |                                                                                                                                                                                                                                                                                                        
154 | pub use hydro_template::__staged;                                                                                                                                                                                                                                                                      
    |         ^^^^^^^^^^^^^^ use of unresolved module or unlinked crate `hydro_template`                                                                                                                                                                                                                     
    |                                                                                                                                                                                                                                                                                                        
    = help: if you wanted to use a crate named `hydro_template`, use `cargo add hydro_template` to add it to your `Cargo.toml`                                                                                                                                                                               
                                                                                                                                                                                                                                                                                                             
                                                                                                                                                                                                                                                                                                             
For more information about this error, try `rustc --explain E0432`.                                                                                                                                                                                                                                          
                                                                                                                                                                                                                                                                                                             
error: cannot determine resolution for the import                                                                                                                                                                                                                                                            
  --> (full path) /Users/ntrp/_pws/hydro-rs-demo/target/hydro_trybuild/hydro-template/src/bin/_process_0_0FA3FE05.rs:32:25                                                                                                                                                                                   
   |                                                                                                                                                                                                                                                                                                         
32 |                     use crate::__staged::__deps::*;                                                                                                                                                                                                                                                     
   |                         ^^^^^^^^^^^^^^^^^^^^^^^^^^                                                                                                                                                                                                                                                      
                                                                                                                                                                                                                                                                                                             
                                                                                                                                                                                                                                                                                                             
error: cannot determine resolution for the import                                                                                                                                                                                                                                                            
  --> (full path) /Users/ntrp/_pws/hydro-rs-demo/target/hydro_trybuild/hydro-template/src/bin/_process_0_0FA3FE05.rs:33:25                                                                                                                                                                                   
   |                                                                                                                                                                                                                                                                                                         
33 |                     use crate::__staged::*;                                                                                                                                                                                                                                                             
   |                         ^^^^^^^^^^^^^^^^^^                                                                               

I am pretty sure it is because of miss configuration in stageleft but I am not figuring out what is wrong..

Any hints or, even better, example of full standalone demos with deploy I can look at?

[shadaj]

Hi! Awesome to see that you're trying to launch some Hydro code. Could you share the contents of your build.rs and Cargo.toml? The reason we recommend the template everywhere is that it sets up some important build configuration, but you're free to replace the examples with your own program after generating.

[shadaj]

Also, do you have these lines in your lib.rs?

stageleft::stageleft_no_entry_crate!();

#[cfg(test)]
mod test_init {
    #[ctor::ctor]
    fn init() {
        hydro_lang::deploy::init_test();
    }
}

They are required to compile Hydro code.

[ntrp]

Ah ok, I am experimenting with the framework to build a server/worker application so I wanted to avoid using test as entry point. I did suspect this parts are crucial though, I'll probably stick with the dfir syntax for now.

I am trying to build a distributed load generator/iot simulator and apart the server/worker communication which can be handled with DFIR syntax I wanted to leverage the deployment machinery. Is there plan to make the deployment code available like a lib to possibly deploy standalone workers and not simply small work units with the send_bincode?

What I wanted to achieve is having a running server with UI where somebody can configure a load test and select how to distribute the load. Based on the config the server would spawn workers on other machines/gcp/azure/aws and execute the test by sending configuration to the workers.

[shadaj]

Ah, you can use the hydro_deploy crate along with hydro_deploy_integration to handle custom Rust deployments. Although documentation is quite sparse for those at the moment...

[ntrp]

Ok I'll have a look, it's not a top priority feature for now, thanks for the hint.

[ntrp]

I managed to use deploy crate but I am really struggling with setting up communication between the main process and the clients. With hydro_lang is I know I can use send_bindcode(q!(something)), with dfir I know I can use bind_udp_bytes or variants but I cannot figure out how to configure ports in case of RustCrate..

I have seen ports.port("data").connect::<ConnectedDirect>().into_source() inside the deploy examples but I cannot figure out how to configure the port on the main code and I get that the port does not exist.

My goal would be to build a simple cluster with a server and multiple worker crates that communicate using pipelines defined in hydro_lang but I can also switch to dfir syntax, just wanted to minimize complexity