seatunnel使用中遇到的各种问题#

local 模式内存溢出#

修改seatunnel config 目录下的jvm_client_option

1
# JVM Heap
2
-Xms256m
3
-Xmx1024m
4

5
# JVM Dump
6
-XX:+HeapDumpOnOutOfMemoryError
7
-XX:HeapDumpPath=/tmp/seatunnel/dump/zeta-client

local模式同时启动多个任务#

修改修改seatunnel config目录下面的hazelcast-client.yaml

1
hazelcast-client:
2
  cluster-name: seatunnel
3
  properties:
4
    hazelcast.logging.type: log4j2
5
  connection-strategy:
6
    connection-retry:
7
      cluster-connect-timeout-millis: 3000
8
  network:
9
    cluster-members:
10
      - localhost:5801
11
      - localhost:5802
12
      - localhost:5803

local模式多版本共存#

修改任意一个版本的hazelcast-client.yaml与hazelcast.yaml，并且确保 cluster-name 相同第一个端相同。

1
hazelcast-client:
2
  cluster-name: seatunnel_2.3.9
3
  properties:
4
    hazelcast.logging.type: log4j2
5
  connection-strategy:
6
    connection-retry:
7
      cluster-connect-timeout-millis: 3000
8
  network:
9
    cluster-members:
10
      - localhost:5802

1
hazelcast:
2
  cluster-name: seatunnel_2.3.9
3
  network:
4
    rest-api:
5
      enabled: true
6
      endpoint-groups:
7
        CLUSTER_WRITE:
8
          enabled: true
9
        DATA:
10
          enabled: true
11
    join:
12
      tcp-ip:
13
        enabled: true
14
        member-list:
15
          - localhost
16
    port:
17
      auto-increment: false
18
      port: 5802
19
  properties:
20
    hazelcast.invocation.max.retry.count: 20
21
    hazelcast.tcp.join.port.try.count: 30
22
    hazelcast.logging.type: log4j2
23
    hazelcast.operation.generic.thread.count: 50
24
    hazelcast.heartbeat.failuredetector.type: phi-accrual
25
    hazelcast.heartbeat.interval.seconds: 2
26
    hazelcast.max.no.heartbeat.seconds: 180
27
    hazelcast.heartbeat.phiaccrual.failuredetector.threshold: 10
28
    hazelcast.heartbeat.phiaccrual.failuredetector.sample.size: 200
29
    hazelcast.heartbeat.phiaccrual.failuredetector.min.std.dev.millis: 100