e7cdc7c136
[Feature][Task Plugin] Add Dynamic task to generate dynamic worklfows with list parameters ( #14127 )
...
* add dynamic task plugin
* fix ui
* update code
* add DOC
* ADD UT
* fix doc
* fix sanity check
* add upgrade ddl
* fix sql
2 years ago
d587b5f03d
[Bug][Master][Fixes 14216]workflow state keep READY_STOP when sub_process state … ( #14221 )
...
* [Bug] [Master] workflow state keep READY_STOP when sub_process state STOP
Fixes #14216
* [Bug] [Master] workflow state keep READY_STOP when sub_process state STOP
Fixes mvn spotless:apply#14216
* Update testFile.txt.crc
* Update testFile.txt.crc
* Delete testFile.txt.crc
2 years ago
5e9f1de075
Remove state check for dependent/subProcess in StateWheelExecuteThread ( #14242 )
2 years ago
d810c487fd
Fix taskGroupQueue doesn't removed from inQueue where wakeup failed ( #14200 )
...
* Fix taskGroupQueue doesn't removed from inQueue where wakeup failed
* Fix avaliable taskGroup is 0 the TaskGroupQueue doesn't out queue
2 years ago
deca0a7ea1
Fix master memory leak due to MasterTaskExecuteRunnableDoesn't be removed ( #14162 )
...
* Fix master memory leak due to MasterTaskExecuteRunnableDoesn't be removed
* Update dolphinscheduler-master/src/main/java/org/apache/dolphinscheduler/server/master/runner/execute/MasterTaskExecuteRunnable.java
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2 years ago
05df0269f6
Fix task exception might not exist in task instance log ( #14085 )
2 years ago
8315279620
[Feature-#14148][Task] Added status check interval and dependent failure policy parameters for dependent task nodes ( #14150 )
...
* Added a dependent task failure policy in the dependent task node
2 years ago
c6512edc3a
revert [fix-#13956] [Master]taskId is null cause NPE #13980 ( #14142 )
2 years ago
503d54aff9
Fix dependent task nodes in workflow instances cannot display data ( #14141 )
2 years ago
cf91544b99
Refactor logic task ( #13948 )
2 years ago
d617620b00
[improve-#13956] taskId is null ( #13980 )
...
Co-authored-by: fuchanghai <‘2875334588@qq.com’>
2 years ago
1c836bf011
[Fix-13950][master] fix the key of master node failover ( #13952 )
...
Co-authored-by: eye <eye.gu@aloudata.com>
2 years ago
f78ef9ec08
[Fix-13815][master] Fix dependent task incorrect timeout alerts ( #13822 )
2 years ago
7835ddfdb7
[Fix-13780][api] Fix the problem of process instance DAG can't show dependent task ( #13823 )
2 years ago
45586f71d5
[BUG][Resource Center] Task can not select main JAR ( #13536 )
2 years ago
79cb707b57
[Improvement-13932][API] Tenant parameters and Worker group parameters are put together in the task startup parameters ( #13935 )
...
* [Improvement][API] Tenant parameters and Worker group parameters are put together in the task startup parameters
2 years ago
61a689aa5a
Use percentage to represent memory/cpu usage ( #13896 )
2 years ago
7ee66f2d02
[Feature-13429][Remote Logging] Add support for writing task logs to Google Cloud Storage ( #13777 )
2 years ago
41a8ba9aab
Support alert server HA ( #13865 )
...
* Support alert server cluster
* Remove WORKER_ALERT_LISTEN_HOST in statefulset-dolphinscheduler-worker.yaml
2 years ago
aec1366732
[Improvement]Update spelling mistake for the name of WorkflowSubmitStatue ( #13850 )
...
* Correct the spelling of an enum
2 years ago
9b269b3c53
Use common response for sync request ( #13847 )
2 years ago
d64004abea
Update WorkflowExecuteRunnable.java ( #13155 )
2 years ago
9df89cf0cf
Use bootstrap user as the default tenant ( #13825 )
2 years ago
fba59981d4
[Fix-13657][Master]NPE caused by the execution of workflow with startNode and forbidden task ( #13668 )
...
Co-authored-by: HomminLee <lihongmin@ysstech.com>
2 years ago
9d9ae9ad54
[improvement] support self-dependent ( #13818 )
2 years ago
68660ec96b
Refactor remote command ( #13809 )
...
* Refactor remote command
* Rename Command to Message
2 years ago
d1b6e6f02c
Take over task instance in master failover ( #13798 )
2 years ago
d91bdeff37
Fix retry task instance will loss varpool ( #13791 )
2 years ago
1f365819a6
Ignore unknown VM options in start.sh ( #13719 )
2 years ago
394805b2c7
[Feature][Metrics] Tag workflow related metrics with process definition code (workflow id) ( #13640 )
...
* Tag workflow related metrics with process definition code (workflow id)
* Clean up related metrics when deleting workflow definition
* Add license headers
* Update related UT cases
* Add an example in grafana-demo
* Add related docs
2 years ago
c9066e8de9
Use MDC to filter task instance log ( #13673 )
...
* Use MDC to collect task instance log
* Use MDCAutoClosableContext to remove the MDC key
2 years ago
7bf3e3cdd6
[improve-#13201] update pid during running ( #13206 )
2 years ago
047fa2f65e
[Feature-13511] Submit Spark task directly on Kubernetes ( #13550 )
2 years ago
701d67c831
[improve-#13045] after a submit failure, stop the processInstance to avoid an endless loop ( #13051 )
...
* [improve-#13045] add max submit number of workflow
* [fix-13405] remove max times
* Update dolphinscheduler-master/src/main/resources/application.yaml
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
---------
Co-authored-by: fuchanghai <‘2875334588@qq.com’>
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
2 years ago
e8b20def54
Fix task instance will generate multiple times when retry interval is 0/s ( #13571 )
2 years ago
2bd65fb2df
[Feature][Remote Logging] Add support for writing task logs to OSS ( #13332 )
2 years ago
8d12dc0702
[Improvement-13491] Use lombok @Slf4j annotation to generate logger ( #13509 )
2 years ago
12dd60fa46
Fix task wake up failed will block the event ( #13466 )
2 years ago
385d781ebc
Fix minor spelling and punctuation errors ( #13452 )
2 years ago
ce34e21960
Task instance failure when worker group doesn't exist ( #13448 )
2 years ago
8be32d4145
[Feature][Api] When use api to run a process we want get processInstanceId ( #13184 )
...
* add sql
* add mapper
* add dao
* add excutor
Co-authored-by: qianl4 <qianl4@cicso.com>
2 years ago
3b980cb06a
[fix][worker][bug] master/worker crash when registry recover from SUSPENDED to RECONNECTED ( #13328 )
2 years ago
ccad56e88e
[Improvement][Master] Validate same content of input file when using task cache ( #13298 )
...
* support file content checksum
* fix inject null storageOperate bug
2 years ago
8a479927f3
Add projectCode in t_ds_process_instance and t_ds_task_instance to remove join ( #13284 )
2 years ago
52134277a3
Fix task group cannot release when kill task ( #13314 )
2 years ago
2e95a020ab
fix dag.getPreviousNodes miss upstream node ( #13255 )
2 years ago
14ec4a2398
Remove dao module in worker ( #13242 )
2 years ago
5fe25c995f
Fix spelling ( #13237 )
2 years ago
d13cd55281
fix spell error and move comment to correct describe location ( #13233 )
2 years ago
66e20271ad
[Feature][Master] Add task caching mechanism to improve the running speed of repetitive tasks ( #13194 )
...
* Supports task instance cache operation
* add task plugin cache
* use SHA-256 to generate key
* Update dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_mysql.sql
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
* Update dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_postgresql.sql
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
* Optimizing database Scripts
* Optimize clear cache operation
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
2 years ago
JieguangZhou
HQFGit
Wenjun Ruan
Kerwin
fuchanghai
eye-gu
ralphgj
Aaron Wang
Rick Cheng
SYSU-Coder
ititdog
HomminLee
caishunfeng
Eric Gao
seedscoder
qianli2022
hokie-chan
John Bampton
ZhongJinHacker