29d42fd92d
[Feature-#3805][server-master] Task parameter transfer ( #5077 )
...
* fix out param format bug
Co-authored-by: wangxj <wangxj31>
3 years ago
5856a12855
[Improvement-4984][Worker] Refactor and Improve worker load balance ( #4996 )
...
* [Improvement][Remote] Improve unit tests
* [Improvement][Worker] Improve worker load balance
* [Improvement][Worker] Fix code smells
* [Improvement][Worker] Rename weight to hostWeight
3 years ago
1cd62b4a5e
[Improvement][Datax] Re-assign DATAX_HOME to /opt/soft/datax instead of /opt/soft/datax/bin/datax.py ( #5019 )
3 years ago
0ba120e8ab
Fix shell task ${setValue(key,value)} is not working ( #5067 )
...
Co-authored-by: dalekliuhan <dalekliuhan@didiglobal.com>
3 years ago
6bf5031f45
[FIX] fix MySQL datasource jdbc connect parameters ( #4851 )
...
* [FIX-CVE-2020-11974] fix MySQLDataSource Security
* remove useless code
* add ut
* A more reasonable way
* code style
* fix test error
* code style
* update exception msg
3 years ago
2d8c4ec86b
[Improvement][Worker-Task] Python Command ( #5036 )
...
* create the interpreter for python command
* Update README.md
Co-authored-by: zhouhong <zhouhong@zhangyue.com>
3 years ago
a3153b5e44
[Bug][Master] Fix First master fault tolerance when startup ( #5045 )
...
* [Fix-#5044] Fix First master fault tolerance when startup
* [Fix-#5044] Fix spell error
3 years ago
ae608e024a
[Fix-5037][Server] Fix that both the master and the worker is hanging after restarting and stopping ( #5038 )
...
* [Fix-5037][Server] Fix that both the master and the worker is hanging after restarting and stopping
* [Improvement][*] Replace commons.lang.StringUtils with common.utils.StringUtils
3 years ago
ea6b1de120
[Improvement][worker] Optimize KillYarnJob (4939) ( #4943 )
3 years ago
beb5adb985
[Feature][MR] Support mapreduce name ( #5029 )
3 years ago
28dfde7002
[Fix-4862][Server] Kill yarn application command won't be execute whe… ( #4936 )
...
* [Fix-4862][Server] Kill yarn application command won't be execute when kill error
3 years ago
fd4b59ad6c
[Improvement][Worker] Rename worker.weight to worker.host.weight ( #4997 ) ( #5014 )
3 years ago
e74932cfc2
[Feature-4960][Spark] Add name input for Spark and improve Spark & MR args ( #4959 )
...
* [Improvement][Spark] Improve spark args and add name input
* [Improvement][MR] Improve map reduce args
* [Improvement][Spark] Fix check style
* [Improvement][Spark] Fix check style for spark, flink and mr
3 years ago
89c9b51740
[Improvement]Add comments to ZKMasterClient.java( #5005 )
3 years ago
c3f43a1924
[Improvement-#4972] add kerberos init before yarn kill ( #4973 )
...
* [Improvement-#4972] add kerberos init before yarn kill
* [Improvement-#4972] fix code smell
* [Improvement-#4972] add ut
3 years ago
39a9c0c392
[Feature][jsonspilt]modify process instance for project home page ( #4991 )
...
* modify checkDAGRing and ProcessService method
* merge
* modify dagRing
* modify process instance for project home page
Co-authored-by: JinyLeeChina <297062848@qq.com>
3 years ago
86600d1328
AlertClientService null pointer exception in SqlTask. ( #4983 )
3 years ago
8c68e2c60b
[Fix][Worker] Fix worker cannot start and alertClientService NullPointerException ( #4956 )
...
* [Fix][Worker] Fix worker cannot start
* [Fix][Worker] Fix alertClientService NullPointerException
* [Fix][Worker] Improve ut coverage
* [Improvement][CI] Improve workflow ci
3 years ago
24fda3fbb1
[Feature][Flink] Support parallelism input ( #4937 )
...
* [Feature][Flink] Support parallelism input
* [Feature][Flink] Fix check style
* [Feature][Flink] Remove FLINK_DETACH
3 years ago
5bfe3fca67
[Fix][SqlTask] fix hive sqltask invalid connection parameters. ( #4917 )
...
* fix hive sqltask invalid connection parameters.
* add setConnParams test method.
* update base datasource test class code style.
* add BaseDataSourceTest in the pom xml.
* update hive conf list jdbc url stitching.
* update hive datasource test class.
3 years ago
ccd8aaebab
[Improvement][Server] Improve dependent task unit tests ( #4911 )
3 years ago
f6088f277e
Optimize code comments ( #4933 )
...
Co-authored-by: mengyun <mengyun@pinduoduo.com>
3 years ago
43ba29a2dd
[Improvement-4624] When the server exist in the dead server list of zk,need stop service byself ( #4626 )
...
* [Improvement-4624] When the server exist in the dead server list of zk,need stop service byself
* [Improvement-4624]fix check style and add MaterRegistryTest
* [Improvement-4624]fix check style and add ZookeeperRegistryCenterTest
* [Improvement-4624]fix check style and add ZookeeperRegistryCenterTest
* [Improvement-4624]add RegisterOperatorTest
* [Improvement-4624]update RegisterOperatorTest
* [Improvement-4624]resolve code smell
* [Improvement-4624]revert LICENSE-@form-create-element-ui
3 years ago
c200911733
[Improvement][Docker] Rename worker group to worker groups
3 years ago
929655fdbe
refactor task node
3 years ago
71752dcaea
Update ShellTaskTest.java
3 years ago
cfce4ae8a0
[Fix-#4840][worker] fix master fault tolerance when startup ( #4845 )
...
* [Fix-#4840][worker] fix master fault tolerance when startup
* [Fix-#4840][worker] move masterRegistry.unRegistry to zkMasterClient.close
3 years ago
149b0dab4d
[Improvement][Docker] Sync docker conf templates to the latest conf properties ( #4772 )
3 years ago
ffcb1c22e1
[Improvement-#3735] Make task delayed execution more efficient ( #4812 )
...
* [Improvement-3735] improve implementation of delay task execution
* [Improvement][worker] delay task compatible with dev branch and fix test
Co-authored-by: vanilla111 <1115690319@qq.com>
3 years ago
757c116b24
[BUG][TaskExecuteProcessor]setTaskCache is first preTaskCache
3 years ago
9154d9b7b5
Update AbstractCommandExecutor.java
3 years ago
62e961e3f1
[Feature][JsonSplit]refactor remove the json in process instance and definition ( #4828 )
...
* #4417 [JsonSplit] refactor process definition json
* [#4177 ] refactor json split. remove json in process definition and process instance
* [#4177 ] refactor json split. copy process definition need set task code 0L.
* code style
* code style
* code style
* code style
* update
* update
3 years ago
f2e41c298f
[Checkstyle][TaskPriorityQueueConsumer]import check
3 years ago
b352c52f33
[Improvement][master] Replace sleep&task with poll in TaskPriorityQueueConsumer#4137
3 years ago
4aac23481e
[Fix-4757][worker] fix worker failover host error ( #4799 )
...
* resolve code conflicts
* resolve code conflicts
* resolve code conflicts
* update WorkerGroupServiceImpl code style.
* update worker group service test host data.
* add ZookeeperNodeHandlerTest class
* change WorkerZkNode to Host class.
* add generate host string method.
3 years ago
874ca07e6e
[Feature-3805][mater-worker-ui]fix function of passing variables between tasks bug ( #4811 )
...
* global initParam and set Param
* fix dataFormat error
* fix deal outParams bug
* fix code style
* fix code style
* fix code style
* fix code style
* fix code style
* fix code style
* fix code style
* add test
* fix code style (variable name)
* fix reset globalParams bug
* fix format bug
* fix SonarCloud Code Analysis
* add test
* fix code style
* fix code style
* modify test
* fix test Coverage
* fix code style
* 4 test
* add test pom
* add header
Co-authored-by: wangxj <wangxj31>
3 years ago
8879d8ff60
[Improvement][*] Define version with revision globally and update version to 1.3.6-SNAPSHOT ( #4773 )
...
* [Improvement][*] Update version to 1.4.0-SNAPSHOT
* [Improvement][*] Update tab to space under checkstyle
* [Improvement][*] Define version with revision globally
* [Improvement][*] Update version to 1.3.6-SNAPSHOT
3 years ago
8ec345c35b
[Improvement][TaskExecuteProcessor]Delete redundant code in method of setTaskCache
3 years ago
dc55b5ba6f
[Improvement-3369][api] Introduce monitor, processinstance and queue service interface for clear code ( #4765 )
...
* [Improvement-3369][api] Introduce monitor, processinstance and queue service interface for clear code
3 years ago
8ebddc1f5b
[Fix-3298][K8s] Fix wrong host of task instance in k8s ( #4786 )
3 years ago
dc7a0a0f0e
Update AbstractCommandExecutor.java
3 years ago
90e197a4c5
add return result
3 years ago
53598fdd18
[Fix-3298][K8s] Fix task log disappear after recreating or upgrading helm release ( #4755 )
...
* [Improvement][K8s] Alter column host varchar(15) to varchar(135) for long host
* [Improvement][K8s] Improve getHost and getAddr in NetUtils
* [Improvement][K8s] Replace getHost with getAddr
3 years ago
7a6b905597
[Fix-#4716][mater,worker] The task execution path should be calculated by the worker, not the master ( #4717 )
...
* [fix][api,mater,worker] 修复master 计算实际执行路径，worker上报实际执行路径
* remove unused import
3 years ago
0c26e10f3f
[Fix-4738][Mail] Fix send mail failed instead of execute sql error ( #4739 )
3 years ago
743975cc5f
[Fix-4727]Update worker.properties misspell error #4730
...
modify work.weight to worker.weight
3 years ago
559efac58d
[Feature-#3805][server-worker]global params of worker ( #4679 )
...
* return shell output to master node
* return sql output to master node
* fix bug
* fix bug
* fix bug
* fix bug
* fix bug
* fix bug
* fix bug
* fix bug
* fix bug
* fix bug
* fix bug
* fix bug
* fix bug
* fix bug
* fix bug
* fix bug
* fix bug
* fix bug
* fix bug
* fix bug
* fix bug
* fix bug
* fix bug
3 years ago
87ff13fc86
[Feature-#3805][server-master] global params of master ( #4678 )
...
* global initParam and set Param
* fix dataFormat error
* fix deal outParams bug
* fix code style
* fix code style
* fix code style
* fix code style
* fix code style
* fix code style
* fix code style
* add test
* fix code style (variable name)
* fix reset globalParams bug
Co-authored-by: wangxj <wangxj31>
3 years ago
a5443f1173
[fix-4128][worker] Dolphin executes the command using sudo to specify the -u parameter ( #4217 )
...
* update sudo cmd.
* update sudo cmd.
* update OSUtils code style.
* add OSUtils test method.
3 years ago
7c07900ea6
[Improvement][install] alert-server properties make adjustments in the Install script ( #4709 )
...
* imp alert-server alert.properties install config.
* add alert plugin dir param in the install_config.conf
3 years ago
wangxj3
Shiwen Cheng
mrproliu
Kirs
游侠
guohaozhang
wenjun
dddyszy
JinyLeeChina
zhuangchong
lgcareer
lenboo
小清
wuxiaofei
bao liang
zapjone
fanwq