Skip to content

Long initialization time #10

@rocketraman

Description

@rocketraman

The adapter takes a really long time to initialize the Kafka producers. Here is a log with DEBUG=1:

logspout.1.wgwrytv5dnt8@swarm-manager000001    | 2017/01/29 01:17:45 Starting Kafka producer for address: [kafka-1:9092], topic: logs.
logspout.1.wgwrytv5dnt8@swarm-manager000001    | # logspout v3.2-dev-custom by gliderlabs
logspout.1.wgwrytv5dnt8@swarm-manager000001    | # adapters: kafka
logspout.1.wgwrytv5dnt8@swarm-manager000001    | # options : debug:1 persist:/mnt/routes
logspout.1.wgwrytv5dnt8@swarm-manager000001    | 2017/01/29 01:18:16 Starting Kafka producer for address: [kafka-2:9092], topic: logs.
logspout.1.wgwrytv5dnt8@swarm-manager000001    | 2017/01/29 01:18:47 Starting Kafka producer for address: [kafka-3:9092], topic: logs.
logspout.1.wgwrytv5dnt8@swarm-manager000001    | 2017/01/29 01:19:18 pump.Run(): using inactivity timeout:  1m0s
logspout.1.wgwrytv5dnt8@swarm-manager000001    | # jobs    : http[logs,routes]:80 pump routes
logspout.1.wgwrytv5dnt8@swarm-manager000001    | # routes  :
logspout.1.wgwrytv5dnt8@swarm-manager000001    | #   ADAPTER    ADDRESS         CONTAINERS      SOURCES OPTIONS
logspout.1.wgwrytv5dnt8@swarm-manager000001    | #   kafka      kafka-2:9092                            map[topic:logs]
logspout.1.wgwrytv5dnt8@swarm-manager000001    | #   kafka      kafka-3:9092                            map[topic:logs]
logspout.1.wgwrytv5dnt8@swarm-manager000001    | #   kafka      kafka-1:9092                            map[topic:logs]
logspout.1.wgwrytv5dnt8@swarm-manager000001    | 2017/01/29 01:19:18 pump.pumpLogs(): 6b53ae08c445 ignored: environ ignore
logspout.1.wgwrytv5dnt8@swarm-manager000001    | 2017/01/29 01:19:18 pump.pumpLogs(): c05d779d98b6 ignored: log driver not supported
logspout.1.wgwrytv5dnt8@swarm-manager000001    | 2017/01/29 01:19:18 pump.pumpLogs(): 61a00f27b1aa started
logspout.1.wgwrytv5dnt8@swarm-manager000001    | 2017/01/29 01:19:18 pump.pumpLogs(): ca60c09c16b2 started
logspout.1.wgwrytv5dnt8@swarm-manager000001    | 2017/01/29 01:19:18 pump.pumpLogs(): 802b3872793f started
logspout.1.wgwrytv5dnt8@swarm-manager000001    | 2017/01/29 01:19:18 pump.pumpLogs(): 75b670376771 started
logspout.1.wgwrytv5dnt8@swarm-manager000001    | 2017/01/29 01:19:18 pump.pumpLogs(): cf81c5b84109 started

You can see it from the times it takes about 30s to start each producer, so for three producers, it takes over 1.5 minutes to start up.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions