Skip to content

Make worker configuration be different on each node #329

@kokosing

Description

@kokosing

There are things in presto configuration which can be set differently on each node.

For example node.id in node.properties or node.internal-adress in config.properites.

The idea is to support template configuration where user could use some variables which will be resolved on target node. Let say we would have a defined set of variables like:

  • uuid - generates new uuid
  • current_node - a hostname (or ip address) used topology file for current node
  • coordinator - a hostname of coordinator node defined in topology file

then in configuration files user could have:

  • for config.properties:
http-server.http.port=28384
query.max-memory=50GB
query.max-memory-per-node=512MB
discovery.uri=http://${coordinator}:28384
coordinator=false
node.internal-address=${current_node}
  • for node.properties
node.id=${uuid}
catalog.config-dir=/etc/presto/catalog
node.data-dir=/var/lib/presto/data
node.environment=presto
node.launcher-log-file=/var/log/presto/launcher.log
node.server-log-file=/var/log/presto/server.log
plugin.dir=/usr/lib/presto/lib/plugin

@cawallin @rschlussel What do you think?

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions