分布式调度框架。
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
 
eye-gu d87a0d831c
[Fix-14008][registry] Fix etcd memory leak due to leaseId (#14034)
1 year ago
..
dolphinscheduler-registry-all Add jdbc registry module (#13812) 2 years ago
dolphinscheduler-registry-api Add host/port in heartbeat (#14591) 1 year ago
dolphinscheduler-registry-plugins [Fix-14008][registry] Fix etcd memory leak due to leaseId (#14034) 1 year ago
README.md [Doc][Style] Fix doc format once for all (#12006) 2 years ago
pom.xml [Improvement][Style] Fix remaining style errors and wildcard imports (#12412) 2 years ago

README.md

Function

DS use registry to do the below three things:

  1. Store the metadata of master/worker so that it can get notify when nodes up and down.
  2. Store the metadata of worker to do load balance.
  3. Acquire a global lock when do failover.

So for DS, the registry need to notify the server when the server subscribe data have added/deleted/updated, support a way to create/release a global lock, delete the server's metadata when server down.

How to use

At present, we have implements three registry: Zookeeper(Default),Etcd,Mysql. If you want to use them, you should config it at resource/application.yaml. The configuration details can be viewed in the README of plugin under Module dolphinscheduler-registry-plugins

Module

dolphinscheduler-registry-all

This module is used for exporting the implemention of registry. If you want to add new registry,you should add the dependency in the pom.xml

dolphinscheduler-registry-api

This module contains the relevant interfaces involved in the use of the registry. The following are several important interfaces

  1. Registry Interface: If you want to implement your own registry, you just need to implement this interface
  2. ConnectionListener Interface: This interface is responsible for the connection status between the client and the registry, The connection state can be viewed in ConnectionState.java
  3. SubscribeListener Interface: This interface is responsible for monitoring the state changes of child nodes under the specified prefix. Event content can be viewed in event.java

dolphinscheduler-registry-plugins

This module contains all registry implementations in DS