Frank-Liao
e97f6a41ed
Check whether the key exists when "start param to overwrite global param" ( #15676 ) ( #15677 )
...
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
3 months ago
Wenjun Ruan
1b32e28cc8
Set the workflow instance ready state to running in failover ( #15572 )
4 months ago
Wenjun Ruan
43a06525a2
Fix Recover WorkflowInstance will casue workflow Instance state is success but task insatnce is killed/paused ( #15574 )
4 months ago
Jay Chung
01eb8f834f
fix: start param for wf not work ( #15544 )
...
* fix: start param for wf not work
fix : #15280
* fix test
4 months ago
Wenjun Ruan
89742332a8
Fix TaskGroupQueue will never be wakeup due to wakeup failed at one time ( #15528 )
4 months ago
Gallardot
a405abec9e
[Bug][Master]serial_wait strategy workflow unable to wake up ( #15270 )
...
* fix: serial_wait strategy workflow unable to wake up
Signed-off-by: Gallardot <gallardot@apache.org>
* fix: serial_wait strategy workflow unable to wake up
Signed-off-by: Gallardot <gallardot@apache.org>
---------
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: fuchanghai <changhaifu@apache.org>
5 months ago
Wenjun Ruan
5b6b0ceb31
Fix resource file usage(Delete Resource/ResourceUser which is deprecated) ( #15355 )
6 months ago
Wenjun Ruan
43f5f24529
Add dolphinscheduler-extract-common module ( #15266 )
6 months ago
Wenjun Ruan
9c7ad6df0a
[Improvement] Clean up Scheduler logic ( #15198 )
...
* Clean up Scheduler logic
* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ProcessDefinitionServiceImpl.java
Co-authored-by: 旺阳 <wang@lqwang.net>
---------
Co-authored-by: 旺阳 <wang@lqwang.net>
7 months ago
Wenjun Ruan
d223d654cc
Add rpc benchmark test ( #14797 )
10 months ago
Wenjun Ruan
55cc77226f
[RPC] Refactor the remote module. ( #14776 )
...
* Add dolphinscheduler-extract-base
* Add dolphinscheduler-extract-master
* Add dolphinscheduler-extract-worker
* Add dolphinscheduler-extract-alert
10 months ago
Wenjun Ruan
db62ce0e47
Fix serial mode will cause NPE in Workflow bootstrap ( #14703 )
11 months ago
KingsleyY
4a80e3a021
[DS-14566][master] fix serial_wait command_param does not replace global_params ( #14606 )
...
This closes #14566
Co-authored-by: yangxin3 <yangxin3@newhope.cn>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
Co-authored-by: xiangzihao <460888207@qq.com>
11 months ago
Wenjun Ruan
e6d94632b9
Add WorkflowExecuteContext ( #14544 )
11 months ago
Jay Chung
221df4a278
revert: Datasource need test binding to create prod ( #14381 )
...
We should keep our step as less as possible, for now, we have to
test datasource and binding it to the prod datasource, I think it will
make our users do not thing to use datasource, so I do like to revert
it and keep step as less as possible
related to https://github.com/apache/dolphinscheduler/pull/11670
12 months ago
Wenjun Ruan
aa2d9a7f05
Add baseDao ( #14316 )
1 year ago
JieguangZhou
e7cdc7c136
[Feature][Task Plugin] Add Dynamic task to generate dynamic worklfows with list parameters ( #14127 )
...
* add dynamic task plugin
* fix ui
* update code
* add DOC
* ADD UT
* fix doc
* fix sanity check
* add upgrade ddl
* fix sql
1 year ago
Wenjun Ruan
d810c487fd
Fix taskGroupQueue doesn't removed from inQueue where wakeup failed ( #14200 )
...
* Fix taskGroupQueue doesn't removed from inQueue where wakeup failed
* Fix avaliable taskGroup is 0 the TaskGroupQueue doesn't out queue
1 year ago
Drake Youngkun Min
801216bd35
RECOVER_TOLERANCE_FAULT_PROCESS CommandType needs the start parameters ( #13958 )
1 year ago
Wenjun Ruan
cf91544b99
Refactor logic task ( #13948 )
1 year ago
Aaron Wang
45586f71d5
[BUG][Resource Center] Task can not select main JAR ( #13536 )
1 year ago
Kerwin
79cb707b57
[Improvement-13932][API] Tenant parameters and Worker group parameters are put together in the task startup parameters ( #13935 )
...
* [Improvement][API] Tenant parameters and Worker group parameters are put together in the task startup parameters
1 year ago
caishunfeng
9d9ae9ad54
[improvement] support self-dependent ( #13818 )
1 year ago
Wenjun Ruan
68660ec96b
Refactor remote command ( #13809 )
...
* Refactor remote command
* Rename Command to Message
1 year ago
Wenjun Ruan
d1b6e6f02c
Take over task instance in master failover ( #13798 )
1 year ago
Aaron Wang
8895921d87
[Improvement-13651] Remove useless resources_task ( #13721 )
1 year ago
seedscoder
8d12dc0702
[Improvement-13491] Use lombok @Slf4j annotation to generate logger ( #13509 )
1 year ago
Wenjun Ruan
6300a9b8de
Fix serial wait will go into block when there is no task need to submit ( #13486 )
1 year ago
Wenjun Ruan
12dd60fa46
Fix task wake up failed will block the event ( #13466 )
1 year ago
qianli2022
8be32d4145
[Feature][Api] When use api to run a process we want get processInstanceId ( #13184 )
...
* add sql
* add mapper
* add dao
* add excutor
Co-authored-by: qianl4 <qianl4@cicso.com>
1 year ago
Wenjun Ruan
01f4fb26f0
Change remove task instance log to async request ( #13399 )
1 year ago
Wenjun Ruan
98dfd64444
Clear the task group data when delete a project/workflowInstance ( #13383 )
1 year ago
Wenjun Ruan
8a479927f3
Add projectCode in t_ds_process_instance and t_ds_task_instance to remove join ( #13284 )
1 year ago
Wenjun Ruan
52134277a3
Fix task group cannot release when kill task ( #13314 )
1 year ago
Wenjun Ruan
14ec4a2398
Remove dao module in worker ( #13242 )
2 years ago
JieguangZhou
66e20271ad
[Feature][Master] Add task caching mechanism to improve the running speed of repetitive tasks ( #13194 )
...
* Supports task instance cache operation
* add task plugin cache
* use SHA-256 to generate key
* Update dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_mysql.sql
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
* Update dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_postgresql.sql
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
* Optimizing database Scripts
* Optimize clear cache operation
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
2 years ago
JieguangZhou
e4b9b67255
Allow execute task in workflow instance ( #13103 )
2 years ago
Wenjun Ruan
f5801a0e1c
Fix task group might be rob by multiple task ( #13115 )
2 years ago
Yann Ann
6ef74073cc
[Improve-13001]migrate commons-collections -> commons-collections4 ( #13002 )
2 years ago
Wenjun Ruan
8a152aebc7
Fix task log file might not be clear ( #13102 )
2 years ago
Wenjun Ruan
fed1e85fb8
Fix the invalidate task instance never be deleted ( #13091 )
2 years ago
XCL
00b18ed422
[Improve]Remove the code logger.isDebugEnabled() #5918 #10542 ( #12738 )
...
Co-authored-by: chunlai.xu <chunlai.xu@zhaopin.com.cn>
2 years ago
Yann Ann
ed209bdf82
[Refactor] Migrate all workergroup-related interface functions from ProcessServiceImpl ( #12493 )
...
* Migrate all workergroup-related interface functions from ProcessServiceImpl
2 years ago
HanayoZz
489e7fe4e2
[Feature-10495][Resource Center] Resource Center Refactor ( #12076 )
...
* resource center refactor - S3 services connection
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2 years ago
Yann Ann
04aa125ba2
[Refactor]migrate some task dao functions from ProcessServiceImpl to dao modules. ( #12505 )
...
* migrate some task DAO to dao modules.
* Update dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/repository/impl/ProcessInstanceMapDaoImpl.java
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2 years ago
rickchengx
233bbdb09e
[Fix-12451][k8s] Read the kubeconfig from cluster conf ( #12452 )
2 years ago
caishunfeng
dedff70f90
[Improvement] Merge spi.utils into common.utils ( #12502 )
...
* improve JSONUtil
* merge spi.utils into common.utils
* split constants && remove some copy utils method
* remove StringUtils
2 years ago
Yann Ann
b936b882bb
[Refactor] Migrate all command-related interface functions from ProcessServiceImpl ( #12474 )
...
* migrate all command-related interface functions to CommonService
2 years ago
fuchanghai
f0a34cddec
[improvement-#12416] Use CollectionUtils.isEmpty judge the collection isEmpty to avoid NPE ( #12449 )
2 years ago
Yann Ann
0eef2e3e10
[Improvement][Style] Fix code style of ProcessScheduleTask and ProcessServiceImpl ( #12447 )
2 years ago