qiaozhanwei
d74f6e71e4
[Fix-3616][Server] when worker akc/response master exception , async retry ( #3776 )
...
* [Fix-3616][Server] when worker akc/response master exception , async retry
* [Fix-3616][Server] when worker akc/response master exception , async retry
* [Fix-3616][Server] when worker akc/response master exception , async retry
* [Fix-3616][Server] when worker akc/response master exception , async retry
* [Fix-3616][Server] when worker akc/response master exception , async retry
* [Fix-3616][Server] when worker akc/response master exception , async retry
* [Fix-3616][Server] when worker akc/response master exception , async retry
* [Fix-3616][Server] when worker akc/response master exception , async retry
* [Fix-3616][Server] when worker akc/response master exception , async retry
* [Fix-3616][Server] when worker akc/response master exception , async retry
* [Fix-3616][Server] when worker akc/response master exception , async retry
Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>
4 years ago
zhuangchong
36d5349610
[fix-3745][server] server get tasktype NPE exception ( #3746 )
4 years ago
qiaozhanwei
29f1123d1d
[Fix-3616][Server] when worker akc/response master exception , async retry ( #3748 )
4 years ago
zhuangchong
fad2852768
[Improvement][server] WATERDROP task plug-in optimization in switch case code cleaning. ( #3652 )
...
* WATERDROP switch case code checkstyle.
* add TaskManagerTest.
* TaskManagerTest checkstyle.
* TaskManagerTest checkstyle.
* TaskManagerTest add pom maven-surefire
* TaskManagerTest update.
4 years ago
felix.wang
4ed3638750
[Bug][server] fix 3629 pull request ( #3706 )
...
* fix 3629 pr
* fix e2e build
4 years ago
Zhou Zheng
8e4037c385
Update MasterExecThread.java
4 years ago
Hsu Pu
68bc58892b
[Improvement][server] Refactor code for getTaskLogPath to reduce NPE log during UT ( #3629 )
...
* init
* update
* update
* update
* fix
* fix
* enable test
* fix
* fix
4 years ago
赤月
69201ac346
[Improvement][ALL] Remove some un-used code and code review #3639 ( #3640 )
...
* [Improvement][ALL] Remove some un-used code and code review #3639
* [Improvement][ALL] Remove some un-used code and code review #3639
* [Improvement][ALL] Remove some un-used code and code review #3639
* [Improvement][ALL] Remove some un-used code and code review
* [Improvement][ALL] Remove some un-used code and code review
* [Improvement][ALL] Remove some un-used code and code review
4 years ago
Zhou Zheng
d2a43b0c25
fix bug about CONDITION-task
...
1. condition shoudn't be in error list
2. condition need more checks when rusume_from_forced_success
4 years ago
zhuangchong
efee53bec9
[Improvement][server] server model ProcessUtils.java code cleaning. ( #3382 )
...
* server model ProcessUtils.java code cleaning.
* add checkstyle,server model ProcessUtils.java code cleaning.
* ProcessUtils.java checkstyle.
* update.
* update.
Co-authored-by: unknown <zhuangchong-phq@sinosig.com>
4 years ago
felix.wang
2ba529a96c
[Improvement][alert] Optimize alarm information ( #3559 )
...
* #3299 Json string parsing problem caused by non-standard json format.
* #3299 Json string parsing problem caused by non-standard json format.
* #3299 Json string parsing problem caused by non-standard json format. fix code style
* #3299 Json string parsing problem caused by non-standard json format. fix code style
* Optimize alarm information
* fix code style
* add license
* fix code smell
* Update dolphinscheduler-alert/src/main/java/org/apache/dolphinscheduler/alert/utils/EnterpriseWeChatUtils.java
Co-authored-by: Yichao Yang <1048262223@qq.com>
* fix code smell
* fix code smell
* 修改ut 和replace问题。
* 修改ut
Co-authored-by: wangjianda <Felix@thinkingdata.com>
Co-authored-by: Yichao Yang <1048262223@qq.com>
4 years ago
Yichao Yang
8fea8f913c
[Test][server] Add the master server test case ( #3574 )
4 years ago
Zhou Zheng
6e5145f7c4
fix some code smell problems
...
1. use Collections.isEmpt() instead of size() > 0
2. make if statements more readable
4 years ago
Zhou Zheng
31cd1f6cb2
adapt to code style
4 years ago
felix.wang
2f01025802
[Fix-3299][dao&server] Fix 3299,when Json string parsing problem caused by non-standard json format. ( #3552 )
...
* #3299 Json string parsing problem caused by non-standard json format.
* #3299 Json string parsing problem caused by non-standard json format.
* #3299 Json string parsing problem caused by non-standard json format. fix code style
* #3299 Json string parsing problem caused by non-standard json format. fix code style
Co-authored-by: wangjianda <Felix@thinkingdata.com>
4 years ago
JinyLeeChina
d30bc7bcf3
'3549' ( #3550 )
4 years ago
CalvinKirs
a1ce54b8e6
[Improvement][server] Fix some sonar analyzed bugs ( #3415 )
...
* [FIX_BUG][*]fix sonar bugs
fix assert error(assertions always pass)
* fix assert error(assertions always pass)
insert data should judging the success status
* fix assert error(assertions always pass)
* use AtomicReference<Object> to replace unsafe volatile Object
* use AtomicReference<Object> to replace unsafe volatile Object
* lazy initialization holder class Singleton...
* reformat code
judge database operations
* reformat code
judge database operations
* revert
* use ThreadLocalRandom to build random numbers
* reform code
* fix dao test error
* judge database operations
4 years ago
vanilla111
a4ee351a3a
delay execution of tasks and improve some designs ( #3427 )
4 years ago
XiaotaoYi
0b7b6d4e2a
[bug-3480][server]fix ds muti-level directory in zk, which lead to fa… ( #3532 )
...
* [bug-3480][server]fix ds muti-level directory in zk, which lead to fail to assign work
* miss whitespace for if statement
4 years ago
XiaotaoYi
5fdc43cdca
fix ds muti-level directory in zk, which lead to fail to assign work
4 years ago
bao liang
5756d6b029
fix bug: Fix master task dependency check bug ( #3473 )
...
Co-authored-by: lenboo <baoliang@analysys.com.cn>
4 years ago
zixi0825
a7a1156ff1
fix zk path error ( #3470 )
4 years ago
CalvinKirs
d6a32ac652
[Feature#3234][cluster]enhanced load balancing ( #3235 )
...
* [Future#3234][cluster]enhanced load balancing
weight-based load balancing algorithm
this close # 3234
* remove useless parameter
* code smell
* load balancing according to work group
* add smooth weight round robin
* remove unused constants
* perfect unit test
* code smell
* code smell
* add work weight config
* fix config error
* add weight docs to readme.md
4 years ago
Zhou Zheng
079768fdaa
revert
4 years ago
Zhou Zheng
90a060128f
修改与新增commandType相关的代码
...
1. dataAnalysis
2. alertManager
3. businessTimeUtils的schedule选择
4 years ago
zixi0825
40a21816ab
[Fix] [Server] Fix the spell error and add log in SqlTask ( #3243 )
...
* fix the spell and modify logger print format
4 years ago
Zhou Zheng
48afb2e2f8
增加强制成功对运行中process的影响
...
1. 失败任务强制成功后会继续submit后续结点
2. 失败重试的节点强制成功后会继续submit后面结点,并且停止retry
3. 对于失败的sub-process如果其中的结点强制成功了,在parent-process中不会有任何影响,只能等到结束后“从强制成功处继续执行”。
4 years ago
Zhou Zheng
93653768c8
支持sub-process和condition的TFS
4 years ago
Zhou Zheng
23277bf160
Revert "[bugfix] issue #3324"
...
This reverts commit fa0bb5e546
.
4 years ago
lenboo
f936b07fdf
fix bug: Fix master task dependency check bug
4 years ago
lgcareer
a3793be7da
[Fix-3390][server]Running hive sql task need find the hdfs path correctly ( #3396 )
...
* [Fix-3390][api]Running hive sql task need find the hdfs path correctly
* [Fix-3390][api]Running hive sql task need find the hdfs path correctly
* update soft version
4 years ago
CalvinKirs
6ecc95a338
[FIX_BUG][*] fix some bugs from sonar analysis ( #3322 )
...
* [FIX_BUG][*] fix some bugs from sonar analysis
* remove invalid single test
* code smell
* remove exception catches that never happen
* delete invalid exception catch
* remove excess locks
* fix e2e test error
* recovery related exception removal
4 years ago
lgcareer
3744167d52
[Fix-3364]Running the spark task fail because the can't find the jar ( #3378 )
4 years ago
lenboo
cdd76d6b11
refactor depend result
4 years ago
lenboo
0e885cd0ee
remove unused import
4 years ago
lenboo
ed78aea2f8
fix bug: there exists some problems in checking task dependency
4 years ago
xsbai
87eb7c8211
adds waterdrop plugin ( #3073 )
...
* add plugin waterdrop
* add plugin waterdrop
* add plugin waterdrop
* fix deploy mode error
* Update en_US.js
fix conflict
* Update en_US.js
fix conflict
* Update en_US.js
Add missing commas
* Update zh_CN.js
Add missing commas
* Update waterdrop.vue
Fix the no resource hint
* Update zh_CN.js
Add 'Please select the waterdrop resources'
* Update en_US.js
Add 'Please select the waterdrop resources'
* Update waterdrop.vue
fix bug when click the waterdrop node again, it still show the `client` mode in deploy mode
Co-authored-by: dailidong <dailidong66@gmail.com>
4 years ago
zixi0825
5fe31546ba
[Fix][all] fix spell error ( #3289 )
...
* fix spell error
* test unit test
Co-authored-by: sunchaohe <sunzhaohe@linklogis.com>
4 years ago
zixi0825
78856fb08e
remove the duplicate function in MasterExecThread ( #3329 )
...
Co-authored-by: sunchaohe <sunzhaohe@linklogis.com>
4 years ago
xingchun-chen
57eee5695a
Merge pull request #3331 from lenboo/dev-complement
...
[FIX-1336] [master] serial complement data can have multiple process instances
4 years ago
lenboo
82295eea52
fix bug#1336 set start/end time before complement the next process
4 years ago
bao liang
1b98db9240
fix bug#1336 serial complement data can have multiple process instances ( #3317 )
...
Co-authored-by: lenboo <baoliang@analysys.com.cn>
4 years ago
Zhou Zheng
fa0bb5e546
[bugfix] issue #3324
4 years ago
bao liang
624f0aeab9
fix bug#1336 serial complement data can have multiple process instances ( #3317 )
...
Co-authored-by: lenboo <baoliang@analysys.com.cn>
4 years ago
lenboo
39182568b2
fix bug#1336 serial complement data can have multiple process instances
4 years ago
Yichao Yang
0577dc9780
[Test-3288][server] Fix github ci unit test oom ( #3305 )
...
* [Improvement] Test github action oom
* Optimize the test case performance
* Remove the unused import
4 years ago
lgcareer
f854c5f794
[Feature-2815]cherry pick commit from dev for one worker can belong different worker groups ( #3277 )
...
* [Feature-2815]cherry pick commit from dev for one worker can belong to different worker groups
* fix 2975:download resource need find the tenant code of resource owner
* change NetUtils to OSUtils because NetUtils didn't exist in the 1.3.2-release branch
Co-authored-by: Yichao Yang <1048262223@qq.com>
4 years ago
LEI SHENG
6f2667bf1a
[Fix-3240][worker] Cannot find a (Map) Key deserializer for type ( #3245 )
...
* fix the bug #2923 (Hive JDBC connection parameter ignored) , the hive jdbc connection url ;
* fix the bug index out of bound and add some test case
* add the Licensed
* fix the checkstyle and import StringBuilder
* put HiveDataSourceTest.java to root pom maven-surefire-plugin to avoiding the sonar 0.0% Coverage.
* Update HiveDataSource.java
* fix the bug #3240 [worker] Cannot find a (Map) Key deserializer for type
* [DS-3245][fix] change toString use JsonString
- change the method of UdfFunc.toString use JsonString
This closes #3245
* [DS-3245][fix] change toString use JsonString
- fix the junit test for full
This closes #3245
* [DS-3245][fix] change toString use JsonString
- fix the sonarcloud merge error, Swap these 2 arguments so they are in the correct order: expected value, actual value.
This closes #3245
* [DS-3245][fix] move the Class UdfFuncDeserializer to UdfFunc.java
move the class UdfFuncDeserializer.java to UdfFunc.java
This closes #3245
* [DS-3245][fix] move the Class UdfFuncDeserializer to UdfFunc.java
add blank line
This closes #3245
* [DS-3245][fix] add the unit test of UdfFunc
add the unit test of UdfFunc.java
This closes #3245
* [DS-3245][fix] add the unit test of UdfFunc
remove the UdfFuncTest.java from maven-surefire-plugin list
This closes #3245
* [DS-3245][fix] add the unit test of UdfFunc
add the UdfFuncTest to the root pom maven-surefire-plugin
This closes #3245
Co-authored-by: dailidong <dailidong66@gmail.com>
4 years ago
amenglu
178d8f829a
Update MasterSchedulerService.java ( #3226 )
4 years ago
Yichao Yang
b4af3fd176
[Feature-2815][server] One worker can belong to different workergroups ( #2934 )
...
* [Feature-2815][server] One worker can belong to different workergroups
* Feature: Add test cases
* Update MonitorService.java
* Update MonitorService.java
Co-authored-by: dailidong <dailidong66@gmail.com>
4 years ago