Wenjun Ruan
9448806af0
[DSIP-61][Master] Refactor thread pool and state event orchestration in master ( #16327 )
3 months ago
xiangzihao
d9244ca22f
[DSIP-57][Audit] Revert PR 14981 code ( #16370 )
4 months ago
xiangzihao
761323f3e1
[DSIP-53] Suggest add process lineage parsing for dependent task ( #16288 )
...
* add dsip 53
5 months ago
Wenjun Ruan
8f6df8d840
[DSIP-54][Master] Use ClusterManager to manage the cluster in master ( #16263 )
5 months ago
xiangzihao
e8566818b0
[DSIP-50][UDF Manage] Remove unused udf manage function ( #16212 )
...
* Remove unused udf manage function
5 months ago
Wenjun Ruan
ec6a3e0727
[DSIP-46] Unify the logic task params data structure between front-end and back-end ( #16193 )
5 months ago
Wenjun Ruan
b34fe46044
Fix task cannot use workflow's environment ( #16199 )
5 months ago
Wenjun Ruan
5df4b1cbc3
Fix condition task will cause workflow instance failed ( #16152 )
5 months ago
sleo
26f2aadb06
Rename variable QUEUE_MAX_SIZE to QUEUE_INITIAL_SIZE ( #16040 )
6 months ago
小可耐
0fc2fe971a
[DSIP-39][parameter] Improvement startup parameters/global parameters/project parameters data type ( #15967 )
...
* [Improvement][parameter] New data types and type filtering
* [Improvement][parameter] Improvement startup parameters/global parameters data type
* fix api interfaces compatible
* add project parameter data type default value
* [Improvement][parameter] New data types and type filtering
* [Improvement][parameter] Improvement startup parameters/global parameters data type
* fix api interfaces compatible
* add project parameter data type default value
* improvement project code
* remove useless imports
* remove method onClearSearchTaskType
* add parameter doc
* optimisation logic
* code conflict resolution
* code conflict resolution
* [Improvement][Monitor] Show master && worker Busy Or Normal Status and Show Commands table list (#15978 )
* update
* test
* add monitor enhance ui
* update
* update
* update doc
* fix spotless
* update
* update
* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/controller/DataAnalysisController.java
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/controller/DataAnalysisController.java
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
* Update dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/mapper/ErrorCommandMapper.java
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
* Update dolphinscheduler-dao/src/main/resources/org/apache/dolphinscheduler/dao/mapper/ErrorCommandMapper.xml
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
* Update dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/mapper/CommandMapper.java
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
* Update dolphinscheduler-dao/src/main/resources/org/apache/dolphinscheduler/dao/mapper/ErrorCommandMapper.xml
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
* update
* fix spotless
* update
---------
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
* [Improvement][Monitor] Add UT for montor (#15998 )
* formatting Code
6 months ago
Gee
4f4a13da02
[Fix-15992][server] maintain slot index by iterate MasterPriorityQueue orderly ( #15993 )
6 months ago
Wenjun Ruan
647cbae400
[DSIP-32][Master] Add command fetcher strategy for master fetch command ( #15900 )
7 months ago
Wenjun Ruan
e9d85914d7
Fix queryByTypeAndJobId might error due to multiple result ( #15883 )
7 months ago
Wenjun Ruan
285c5a8eb5
[DSIP-28] Donnot scan whole bean under classpath ( #15874 )
7 months ago
Wenjun Ruan
76d059810a
Forbidden forcess success a task instance in a running workflow instance ( #15855 )
7 months ago
Wenjun Ruan
27d0563fe4
Bind processId to constructor CodeGenerator ( #15848 )
7 months ago
旺阳
226345512e
[DSIP-26][Audit log] Audit log improvement design ( #15554 )
7 months ago
旺阳
5050a8e1e6
[Improve] Fix typo on ProcessServiceImpl ( #15817 )
8 months ago
Rick Cheng
b652967c53
[Improvement-15719] Remove the useless methods in ProcessUtils ( #15720 )
8 months ago
Frank-Liao
e97f6a41ed
Check whether the key exists when "start param to overwrite global param" ( #15676 ) ( #15677 )
...
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
9 months ago
Wenjun Ruan
1b32e28cc8
Set the workflow instance ready state to running in failover ( #15572 )
10 months ago
Wenjun Ruan
43a06525a2
Fix Recover WorkflowInstance will casue workflow Instance state is success but task insatnce is killed/paused ( #15574 )
10 months ago
Jay Chung
01eb8f834f
fix: start param for wf not work ( #15544 )
...
* fix: start param for wf not work
fix : #15280
* fix test
10 months ago
Wenjun Ruan
4d15932ede
Fix createFile with permission will not work ( #15556 )
10 months ago
Wenjun Ruan
89742332a8
Fix TaskGroupQueue will never be wakeup due to wakeup failed at one time ( #15528 )
10 months ago
Wenjun Ruan
44c356db4d
TaskGroupPriority only compare When TaskGroup is same ( #15486 )
10 months ago
Wenjun Ruan
0b873e6870
[HotFix] Fix createTaskInstanceWorkingDirectory failed if the old path exist ( #15377 )
11 months ago
Gallardot
a405abec9e
[Bug][Master]serial_wait strategy workflow unable to wake up ( #15270 )
...
* fix: serial_wait strategy workflow unable to wake up
Signed-off-by: Gallardot <gallardot@apache.org>
* fix: serial_wait strategy workflow unable to wake up
Signed-off-by: Gallardot <gallardot@apache.org>
---------
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: fuchanghai <changhaifu@apache.org>
11 months ago
Wenjun Ruan
5b6b0ceb31
Fix resource file usage(Delete Resource/ResourceUser which is deprecated) ( #15355 )
11 months ago
Wenjun Ruan
43f5f24529
Add dolphinscheduler-extract-common module ( #15266 )
12 months ago
Wenjun Ruan
9c7ad6df0a
[Improvement] Clean up Scheduler logic ( #15198 )
...
* Clean up Scheduler logic
* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ProcessDefinitionServiceImpl.java
Co-authored-by: 旺阳 <wang@lqwang.net>
---------
Co-authored-by: 旺阳 <wang@lqwang.net>
1 year ago
旺阳
5afd94136c
[Fix][Data Quality] Change t_ds_dq_rule_input_entry field name fix PostgreSQL not support value issue ( #14992 )
...
* change data quality field name
* fix-dao
* fix-dao
* fix-dao
* fix-dao
* update
* test
* update
* update
1 year ago
Wei Xiaonan
c0ed68121d
[Feature-14832][Listener]Implementation of Listener Mechanism ( #14981 )
...
* first commit
* 1. sql: sync ddl
2. front-end: change to ternary expression
3. back-end: correct license header in ListenerEvent.java
* test case
* frontend: remove unnecessary console
* fix unit test
* remove log depends on user-provided value
* fix dolphinscheduler_postgresql.sql
* sync database schema
* fix unit test
* fix unit test
* fix some NIT.
* extract GLOBAL_ALERT_GROUP_ID into variable
* fix ddl bug
* add column task_type in t_ds_fav_task in upgrade/3.2.0_schema
* add unit test
1 year ago
Chenshuai
4b5eb1a2bb
[Improvement-14894][dolphinscheduler-alert] alert message contains the operator ( #14910 )
...
* feat: add operator in alert info
* fix: optimize get user info directly
* fix: also optimize get user info directly
* fix: code style
* fix: code style
* fix: update test case
* fix: code check style
---------
Co-authored-by: Jim Chen <chenshuai19950725@gmail.com>
Co-authored-by: David Zollo <dailidong66@gmail.com>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
Co-authored-by: xiangzihao <460888207@qq.com>
1 year ago
Chenshuai
6dcc26f52e
feat: add task priority in alert info ( #14919 )
...
Co-authored-by: Jim Chen <chenshuai19950725@gmail.com>
Co-authored-by: Aaron Wang <wangweirao16@gmail.com>
1 year ago
Aaron Wang
73e846d03e
[Improvement-14884][Master] Add overload state in master heartbeat to trigger slot change ( #14887 )
1 year ago
Jay Chung
3fa69d2db8
[Bug][Worker] Fix sql/shell task doesn't replace parameter ( #14876 )
...
Fix parameter assign error, fix #14869 which including
* shell task param not work, botch local and global
* others task chain assign not work
1 year ago
Wenjun Ruan
d223d654cc
Add rpc benchmark test ( #14797 )
1 year ago
Wenjun Ruan
55cc77226f
[RPC] Refactor the remote module. ( #14776 )
...
* Add dolphinscheduler-extract-base
* Add dolphinscheduler-extract-master
* Add dolphinscheduler-extract-worker
* Add dolphinscheduler-extract-alert
1 year ago
Aaron Wang
a491e3a849
fix: null app-info-path cause NPE ( #14752 )
1 year ago
Wenjun Ruan
db62ce0e47
Fix serial mode will cause NPE in Workflow bootstrap ( #14703 )
1 year ago
fuchanghai
b391b74df4
[fix-#14537] the branch that needs to be executed overlaps with another branch, it may not be able to complete the normal execution ( #14563 )
1 year ago
KingsleyY
4a80e3a021
[DS-14566][master] fix serial_wait command_param does not replace global_params ( #14606 )
...
This closes #14566
Co-authored-by: yangxin3 <yangxin3@newhope.cn>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
Co-authored-by: xiangzihao <460888207@qq.com>
1 year ago
Wenjun Ruan
e6d94632b9
Add WorkflowExecuteContext ( #14544 )
1 year ago
Rick Cheng
3de0b5a38c
[Feature-14339][Parameter] Add parameter combining of project-level parameters ( #14452 )
1 year ago
Jay Chung
221df4a278
revert: Datasource need test binding to create prod ( #14381 )
...
We should keep our step as less as possible, for now, we have to
test datasource and binding it to the prod datasource, I think it will
make our users do not thing to use datasource, so I do like to revert
it and keep step as less as possible
related to https://github.com/apache/dolphinscheduler/pull/11670
1 year ago
Rick Cheng
b49b91c45d
[Improvement-14331][common] Remove the duplicate ParameterUtils ( #14332 )
1 year ago
Wenjun Ruan
aa2d9a7f05
Add baseDao ( #14316 )
1 year ago
JieguangZhou
e7cdc7c136
[Feature][Task Plugin] Add Dynamic task to generate dynamic worklfows with list parameters ( #14127 )
...
* add dynamic task plugin
* fix ui
* update code
* add DOC
* ADD UT
* fix doc
* fix sanity check
* add upgrade ddl
* fix sql
1 year ago
Wenjun Ruan
d810c487fd
Fix taskGroupQueue doesn't removed from inQueue where wakeup failed ( #14200 )
...
* Fix taskGroupQueue doesn't removed from inQueue where wakeup failed
* Fix avaliable taskGroup is 0 the TaskGroupQueue doesn't out queue
2 years ago