Skip to content

waggle-sensor/wes-upload-agent

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

63 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Node Upload Agent

The upload agent is responsible for moving the data plugins have staged locally to beehive.

The high level architecture looks like:

  ┌─────────────────────────────────────────────────────────────┐
 ┌─────────────────────────────────────────────────────────────┐│
┌─────────────────────────────────────────────────────────────┐││
│ On each compute device                                      │││
│                                                             │││
│                      upload key (secret)                    │││
│                              V                              │││
│           mount  ┌───────────────────┐   rsync to beehive   │││
│ /uploads ------> │ Node Upload Agent │ ---------------------->
│                  └───────────────────┘                      │┘
└─────────────────────────────────────────────────────────────┘

Usage

This services expects the following things:

  1. A directory /uploads must be mounted with RW access. Items of the form /uploads/x/y will be moved to beehive.
  2. An ssh key located at /auth/ssh-key for the remote ssh server.

About

Agent which runs on the nodes to move training data to beehive.

Topics

Resources

Stars

Watchers

Forks

Packages

No packages published

Contributors 2

  •  
  •