Environment Variables & Includes

Embulk makes use of Liquid for variables and templating. https://www.embulk.org/docs/built-in.html#using-variables

The config files do not make use of templating, only environment variables Variables can be exported in your profile. The following are configured for each db.

Variables

# cd setup
export CD_FETCHED="/canvas/data/files-fetched"
export CD_SYNCED="/canvas/data/files-synced"
export CD_UNPACKED="/canvas/data/files-unpacked"

# default timezone
export EMBULK_TZ="America/Los_Angeles"

# mssql
export EMBULK_MSSQL_DRIVER="/driver/path/to/mssql-jdbc-7.2.1.jre8.jar"
export EMBULK_NATIVE_DRIVER="ODBC Driver 17 for SQL Server"
export EMBULK_MSSQLH="host"
export EMBULK_MSSQLHP="1433"
export EMBULK_MSSQLU="user"
export EMBULK_MSSQLP="pass"
export EMBULK_MSSQLDB="database"

# mysql
export EMBULK_MYSQLH="host"
export EMBULK_MYSQLHP="3306"
export EMBULK_MYSQLU="user"
export EMBULK_MYSQLP="pass"
export EMBULK_MYSQLDB="database"

# oracle
export EMBULK_ORACLE_DRIVER="driver/path/to/ojdbc6.jar"
export EMBULK_ORACLEH="host"
export EMBULK_ORACLEHP="1521"
export EMBULK_ORACLEU="user"
export EMBULK_ORACLEP="pass"
export EMBULK_ORACLEDB="servicename"

# postgres
export EMBULK_POSTGRESH="host"
export EMBULK_POSTGRESHP="5432"
export EMBULK_POSTGRESU="user"
export EMBULK_POSTGRESP="pass"
export EMBULK_POSTGRESDB="database"

Includes

See https://www.embulk.org/docs/built-in.html#including-files