This repository was archived by the owner on Sep 16, 2024. It is now read-only.
-
Notifications
You must be signed in to change notification settings - Fork 20
Loading data
rjrudin edited this page Mar 25, 2019
·
6 revisions
The 3.13.0 release provides a new command for loading data via the support provided in ml-javaclient-util. The intent of this is to provide a simple mechanism for loading data that should be part of any deployment. The support for loading files from disk is already used for loading modules and schemas, so this is just extending that support for loading arbitrary data.
This feature has the following default behavior:
- src/main/ml-data is the default path for finding files to load.
- Any file in any data path will be loaded with a URI relative to the data path that it belongs to; e.g. the file src/main/ml-data/my/data/test.json will be loaded with a URI of "/my/data/test.json".
- Collections and permissions can be specified via files in each directory.
- The files will be loaded via a DatabaseClient that uses the port defined by appConfig.getRestPort(). This can be overridden by specifying a database name to load files into, in which case appConfig.getAppServicesPort() will be used for making a connection.
The following properties are available for configuring this feature: