d6175f3bbf
Exclude DataSourceAutoConfiguration in worker server ( #15169 )
1 year ago
5afd94136c
[Fix][Data Quality] Change t_ds_dq_rule_input_entry field name fix PostgreSQL not support value issue ( #14992 )
...
* change data quality field name
* fix-dao
* fix-dao
* fix-dao
* fix-dao
* update
* test
* update
* update
1 year ago
2622685784
[Bug] Fix endless loop ( #15092 )
...
* [fix-#13045] fix endless loop
---------
Co-authored-by: fuchanghai <‘2875334588@qq.com’>
1 year ago
d675d32771
Fix confusing constant string for unit convertor ( #15126 )
1 year ago
c0ed68121d
[Feature-14832][Listener]Implementation of Listener Mechanism ( #14981 )
...
* first commit
* 1. sql: sync ddl
2. front-end: change to ternary expression
3. back-end: correct license header in ListenerEvent.java
* test case
* frontend: remove unnecessary console
* fix unit test
* remove log depends on user-provided value
* fix dolphinscheduler_postgresql.sql
* sync database schema
* fix unit test
* fix unit test
* fix some NIT.
* extract GLOBAL_ALERT_GROUP_ID into variable
* fix ddl bug
* add column task_type in t_ds_fav_task in upgrade/3.2.0_schema
* add unit test
1 year ago
a5284e4024
Remove mapper usage in tools ( #15073 )
1 year ago
688f84452d
[Feature-14678][Master][UI]Dependent task parameter passing ( #14702 )
...
* feat: dependent task parameter passing
* style: code format
* refactor: remove inappropriate log
* refactor: Modify unreasonable code structure
* refactor: Modify unreasonable code structure
* refactor: Solve conflicts caused by merge
---------
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
Co-authored-by: BaoLiang <29528966+lenboo@users.noreply.github.com>
1 year ago
c59b2d5b8c
remove sub workflow finish notify ( #15057 )
...
Co-authored-by: xiangzihao <460888207@qq.com>
1 year ago
33084d281f
Add dolphinscheduler-dao-plugin module ( #15019 )
1 year ago
d683553324
[Improvement][Master] Calculate the remainTime then we set the delay execution. ( #15012 )
...
* [#15007 ][fix][worker-server] fix bug task delay execution
* [#15007 ][fix][worker-server] fix bug task delay execution
mvn spotless:apply
* [#15007 ][fix][worker-server] fix bug task delay execution
worker fix task delay logic
---------
Co-authored-by: 旺阳 <wang@lqwang.net>
1 year ago
629fced9ef
Fix task log appender will not be closed immediate after throwing exception ( #14989 )
1 year ago
73e846d03e
[Improvement-14884][Master] Add overload state in master heartbeat to trigger slot change ( #14887 )
1 year ago
76bbcbeb30
[Improvement][Master] Split the task dependency mode of the dependent node into workflow dependent and task dependent ( #14824 )
...
* [Improvement][Master] Split the task dependency mode of the dependent node into workflow dependent and task dependent. (#11970 )
* [Improvement][Master] Split the task dependency mode of the dependent node into workflow dependent and task dependent. (#11970 )
- delete useless output
* [Improvement][Master] Split the task dependency mode of the dependent node into workflow dependent and task dependent. (#11970 )
- add log
- run spotless check
---------
Co-authored-by: 旺阳 <qingwli@cisco.com>
Co-authored-by: JinYong Li <42576980+JinyLeeChina@users.noreply.github.com>
1 year ago
7ae4fb3787
[Fix-14149][master] task finished so not dispatch ( #14161 )
1 year ago
33525a17c3
[Fix-14828][master] check task id not null to avoid NPE ( #14829 )
...
Co-authored-by: eye <eye.gu@aloudata.com>
Co-authored-by: Aaron Wang <wangweirao16@gmail.com>
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
1 year ago
742f0c3e60
Add workflowInstanceHost and taskInstanceHost in ITaskInstanceExecutionEvent ( #14827 )
1 year ago
d223d654cc
Add rpc benchmark test ( #14797 )
1 year ago
9c2838ccc9
fix the status of logical task is not be correctly changed when task is finished. ( #14820 ) ( #14822 )
1 year ago
ac04288e2b
fix the full log path of logical task is not be set when task is dispatched ( #14819 ) ( #14821 )
1 year ago
55cc77226f
[RPC] Refactor the remote module. ( #14776 )
...
* Add dolphinscheduler-extract-base
* Add dolphinscheduler-extract-master
* Add dolphinscheduler-extract-worker
* Add dolphinscheduler-extract-alert
1 year ago
59998f4c75
[Improvement] add dispatch fail times when compare ( #14761 )
...
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
1 year ago
8e64026e93
fix fault tolerant enviroment missing ( #14735 )
1 year ago
7c37a7f9fe
[Fix-14714][master] package task instance before put into cache ( #14718 )
...
Co-authored-by: eye <eye.gu@aloudata.com>
Co-authored-by: xiangzihao <460888207@qq.com>
1 year ago
db62ce0e47
Fix serial mode will cause NPE in Workflow bootstrap ( #14703 )
1 year ago
9963bfc612
[Workflow] Print WorkflowInstance detail/ TaskInstance detail when finished ( #14677 )
...
* [Workflow] Print WorkflowInstance detail/ TaskInstance detail when finished
* [Workflow] minor fix
* [Workflow] add ut
* [Workflow] add header
---------
Co-authored-by: tengting.xu <xtt@dipeak.com>
1 year ago
4a80e3a021
[DS-14566][master] fix serial_wait command_param does not replace global_params ( #14606 )
...
This closes #14566
Co-authored-by: yangxin3 <yangxin3@newhope.cn>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
Co-authored-by: xiangzihao <460888207@qq.com>
1 year ago
ca760aabd4
[Fix-14512][BOM] kubernetes-client version conflict ( #14561 )
1 year ago
cbd354d134
Add host/port in heartbeat ( #14591 )
1 year ago
af2986eca1
[Feature-14545][Master][UI]Cross workflow parameter passing ( #14552 )
...
* feat: cross-workflow parameter passing
* refactor: remove useless parameters
* refactor: remove useless code
* refactor: code format
* docs: update docs
* docs: docs format
* more effective information
Co-authored-by: xiangzihao <zihaoxiang@apache.org>
* more effective information
Co-authored-by: xiangzihao <zihaoxiang@apache.org>
* fix: wrong writing of log code
* fix: perfect error log
---------
Co-authored-by: xiangzihao <zihaoxiang@apache.org>
Co-authored-by: xiangzihao <460888207@qq.com>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
1 year ago
399d0d0ce9
Add log for NetUtils ( #14578 )
1 year ago
e6d94632b9
Add WorkflowExecuteContext ( #14544 )
1 year ago
c812bf9d49
[Bug] [Mater] Not got latest task intance by task code ( #14529 )
...
* add task code->instance map
---------
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
1 year ago
0246327083
Polish config, expose rpc config in application.yml ( #14501 )
1 year ago
406aeaf659
Use jvm_args_env.sh to set JVM args ( #14487 )
1 year ago
0d2ea3e27b
Fix worker failover service comment ( #14494 )
1 year ago
0b69236b04
[Feature-14251][Task] Support yarn queue definition in yarn task ( #14310 )
2 years ago
d38d504332
[Fix] Fix running task instance throught api gots failed ( #14433 )
...
* update logic
* split method
2 years ago
64e5741063
[Bug-14378][Master] Trigger task execution in workflow instance page cause workflow instance keep running status ( #14389 )
2 years ago
5cbe170e43
[Bug] [Master] Fix complementListDate will throw IndexOutOfBoundsException ( #14361 )
2 years ago
b49b91c45d
[Improvement-14331][common] Remove the duplicate ParameterUtils ( #14332 )
2 years ago
1c0dfbb044
[Improvement][Etcd] Support SSL In Etcd And Enhance Etcd In Helm ( #13924 )
2 years ago
465e7ae6ee
[Bug] [Master] Workflow keep running when task has no id ( #14315 )
...
* change completeTaskMap to completeTaskSet
* Update dolphinscheduler-master/src/main/java/org/apache/dolphinscheduler/server/master/runner/WorkflowExecuteRunnable.java
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
* change method name
* fix ut
* fix spotless
---------
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
2 years ago
a55612e4f7
Fix switch task use boolean type error ( #14326 )
2 years ago
75f4fa2881
Fix the complement function does not generate the next running instances in parallel mode ( #14335 )
2 years ago
aa2d9a7f05
Add baseDao ( #14316 )
2 years ago
e7cdc7c136
[Feature][Task Plugin] Add Dynamic task to generate dynamic worklfows with list parameters ( #14127 )
...
* add dynamic task plugin
* fix ui
* update code
* add DOC
* ADD UT
* fix doc
* fix sanity check
* add upgrade ddl
* fix sql
2 years ago
d587b5f03d
[Bug][Master][Fixes 14216]workflow state keep READY_STOP when sub_process state … ( #14221 )
...
* [Bug] [Master] workflow state keep READY_STOP when sub_process state STOP
Fixes #14216
* [Bug] [Master] workflow state keep READY_STOP when sub_process state STOP
Fixes mvn spotless:apply#14216
* Update testFile.txt.crc
* Update testFile.txt.crc
* Delete testFile.txt.crc
2 years ago
5e9f1de075
Remove state check for dependent/subProcess in StateWheelExecuteThread ( #14242 )
2 years ago
d810c487fd
Fix taskGroupQueue doesn't removed from inQueue where wakeup failed ( #14200 )
...
* Fix taskGroupQueue doesn't removed from inQueue where wakeup failed
* Fix avaliable taskGroup is 0 the TaskGroupQueue doesn't out queue
2 years ago
deca0a7ea1
Fix master memory leak due to MasterTaskExecuteRunnableDoesn't be removed ( #14162 )
...
* Fix master memory leak due to MasterTaskExecuteRunnableDoesn't be removed
* Update dolphinscheduler-master/src/main/java/org/apache/dolphinscheduler/server/master/runner/execute/MasterTaskExecuteRunnable.java
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2 years ago
Wenjun Ruan
旺阳
fuchanghai
Eric Gao
Wei Xiaonan
Orange Summer
caishunfeng
dbac
Aaron Wang
sgw
eye-gu
JieguangZhou
Tengting Xu
KingsleyY
旺阳
kami
Rick Cheng
Kerwin
HQFGit