647cbae400
[DSIP-32][Master] Add command fetcher strategy for master fetch command ( #15900 )
7 months ago
e9d85914d7
Fix queryByTypeAndJobId might error due to multiple result ( #15883 )
7 months ago
285c5a8eb5
[DSIP-28] Donnot scan whole bean under classpath ( #15874 )
7 months ago
b652967c53
[Improvement-15719] Remove the useless methods in ProcessUtils ( #15720 )
8 months ago
e97f6a41ed
Check whether the key exists when "start param to overwrite global param" ( #15676 ) ( #15677 )
...
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
9 months ago
01eb8f834f
fix: start param for wf not work ( #15544 )
...
* fix: start param for wf not work
fix : #15280
* fix test
10 months ago
89742332a8
Fix TaskGroupQueue will never be wakeup due to wakeup failed at one time ( #15528 )
10 months ago
44c356db4d
TaskGroupPriority only compare When TaskGroup is same ( #15486 )
10 months ago
5b6b0ceb31
Fix resource file usage(Delete Resource/ResourceUser which is deprecated) ( #15355 )
11 months ago
9c7ad6df0a
[Improvement] Clean up Scheduler logic ( #15198 )
...
* Clean up Scheduler logic
* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ProcessDefinitionServiceImpl.java
Co-authored-by: 旺阳 <wang@lqwang.net>
---------
Co-authored-by: 旺阳 <wang@lqwang.net>
1 year ago
5afd94136c
[Fix][Data Quality] Change t_ds_dq_rule_input_entry field name fix PostgreSQL not support value issue ( #14992 )
...
* change data quality field name
* fix-dao
* fix-dao
* fix-dao
* fix-dao
* update
* test
* update
* update
1 year ago
c0ed68121d
[Feature-14832][Listener]Implementation of Listener Mechanism ( #14981 )
...
* first commit
* 1. sql: sync ddl
2. front-end: change to ternary expression
3. back-end: correct license header in ListenerEvent.java
* test case
* frontend: remove unnecessary console
* fix unit test
* remove log depends on user-provided value
* fix dolphinscheduler_postgresql.sql
* sync database schema
* fix unit test
* fix unit test
* fix some NIT.
* extract GLOBAL_ALERT_GROUP_ID into variable
* fix ddl bug
* add column task_type in t_ds_fav_task in upgrade/3.2.0_schema
* add unit test
1 year ago
4b5eb1a2bb
[Improvement-14894][dolphinscheduler-alert] alert message contains the operator ( #14910 )
...
* feat: add operator in alert info
* fix: optimize get user info directly
* fix: also optimize get user info directly
* fix: code style
* fix: code style
* fix: update test case
* fix: code check style
---------
Co-authored-by: Jim Chen <chenshuai19950725@gmail.com>
Co-authored-by: David Zollo <dailidong66@gmail.com>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
Co-authored-by: xiangzihao <460888207@qq.com>
1 year ago
3fa69d2db8
[Bug][Worker] Fix sql/shell task doesn't replace parameter ( #14876 )
...
Fix parameter assign error, fix #14869 which including
* shell task param not work, botch local and global
* others task chain assign not work
1 year ago
55cc77226f
[RPC] Refactor the remote module. ( #14776 )
...
* Add dolphinscheduler-extract-base
* Add dolphinscheduler-extract-master
* Add dolphinscheduler-extract-worker
* Add dolphinscheduler-extract-alert
1 year ago
b391b74df4
[fix-#14537] the branch that needs to be executed overlaps with another branch, it may not be able to complete the normal execution ( #14563 )
1 year ago
e6d94632b9
Add WorkflowExecuteContext ( #14544 )
1 year ago
3de0b5a38c
[Feature-14339][Parameter] Add parameter combining of project-level parameters ( #14452 )
1 year ago
221df4a278
revert: Datasource need test binding to create prod ( #14381 )
...
We should keep our step as less as possible, for now, we have to
test datasource and binding it to the prod datasource, I think it will
make our users do not thing to use datasource, so I do like to revert
it and keep step as less as possible
related to https://github.com/apache/dolphinscheduler/pull/11670
1 year ago
aa2d9a7f05
Add baseDao ( #14316 )
1 year ago
af7da0630e
[Feature] Add project name/workflow definition name/instance id/task name to the built-in variables ( #14099 )
...
* [Feature] Add project name/workflow definition name/instance id/task name to the built-in variables
2 years ago
801216bd35
RECOVER_TOLERANCE_FAULT_PROCESS CommandType needs the start parameters ( #13958 )
2 years ago
45586f71d5
[BUG][Resource Center] Task can not select main JAR ( #13536 )
2 years ago
61637cc0a3
[Bug] [Cron] Parse corn expression error ( #13841 )
...
* fix-cron
* update catch exception
2 years ago
41a8ba9aab
Support alert server HA ( #13865 )
...
* Support alert server cluster
* Remove WORKER_ALERT_LISTEN_HOST in statefulset-dolphinscheduler-worker.yaml
2 years ago
85605bbef9
[Improvement-13653][Remote Logging] Support api-server to get task log from remote target ( #13654 )
2 years ago
9d9ae9ad54
[improvement] support self-dependent ( #13818 )
2 years ago
68660ec96b
Refactor remote command ( #13809 )
...
* Refactor remote command
* Rename Command to Message
2 years ago
8895921d87
[Improvement-13651] Remove useless resources_task ( #13721 )
2 years ago
c9066e8de9
Use MDC to filter task instance log ( #13673 )
...
* Use MDC to collect task instance log
* Use MDCAutoClosableContext to remove the MDC key
2 years ago
8be32d4145
[Feature][Api] When use api to run a process we want get processInstanceId ( #13184 )
...
* add sql
* add mapper
* add dao
* add excutor
Co-authored-by: qianl4 <qianl4@cicso.com>
2 years ago
01f4fb26f0
Change remove task instance log to async request ( #13399 )
2 years ago
8a479927f3
Add projectCode in t_ds_process_instance and t_ds_task_instance to remove join ( #13284 )
2 years ago
8503ee0eed
[Improvement][Worker] Startup parameter should have the highest priority ( #13274 )
2 years ago
de70421a1e
Remove the log path check ( #13280 )
2 years ago
14ec4a2398
Remove dao module in worker ( #13242 )
2 years ago
66e20271ad
[Feature][Master] Add task caching mechanism to improve the running speed of repetitive tasks ( #13194 )
...
* Supports task instance cache operation
* add task plugin cache
* use SHA-256 to generate key
* Update dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_mysql.sql
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
* Update dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_postgresql.sql
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
* Optimizing database Scripts
* Optimize clear cache operation
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
2 years ago
8a152aebc7
Fix task log file might not be clear ( #13102 )
2 years ago
38b876733c
[Feature-10498] Mask the password in the log of sqoop task ( #11589 )
2 years ago
d99ba29b66
Fix master cluster may loop command unbalanced ( #12891 )
...
(cherry picked from commit 3b2b86661be76b7c1404a910c865d78b7936313d)
2 years ago
489e7fe4e2
[Feature-10495][Resource Center] Resource Center Refactor ( #12076 )
...
* resource center refactor - S3 services connection
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2 years ago
04aa125ba2
[Refactor]migrate some task dao functions from ProcessServiceImpl to dao modules. ( #12505 )
...
* migrate some task DAO to dao modules.
* Update dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/repository/impl/ProcessInstanceMapDaoImpl.java
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2 years ago
dedff70f90
[Improvement] Merge spi.utils into common.utils ( #12502 )
...
* improve JSONUtil
* merge spi.utils into common.utils
* split constants && remove some copy utils method
* remove StringUtils
2 years ago
b936b882bb
[Refactor] Migrate all command-related interface functions from ProcessServiceImpl ( #12474 )
...
* migrate all command-related interface functions to CommonService
2 years ago
d46e4659d9
[Improvement][Style] Fix remaining style errors and wildcard imports ( #12412 )
...
* Fix remaining style errors and wildcard imports
* Upgrade spotless to the latest stable version, exclude .github folder from spotless check and fix dead link
* Fix spotless matching scope of markdown files
2 years ago
b357781df2
[Migrate][Test] Migrate junit4 -> junit5 test cases in common, service, and spi modules ( #12363 )
2 years ago
22103f975e
[improvement] Migrate all UT cases from jUnit4 to jUnit5 in dao module ( #12328 )
...
* [improvement] Migrate all UT cases from jUnit4 to jUnit5 in dao module
Co-authored-by: Jackie <‘2875334588@qq.com’>
2 years ago
db1d319159
Reorganize some classes in common module, remove duplicate classes ( #12321 )
2 years ago
05099bd8f7
[Improvement-12296][Test] Close static mock ( #12300 )
2 years ago
9ab79e064c
[Improvement][Test] Fully remove the usage of powermock from the whole project ( #12244 )
...
* Fully remove the usage of powermock from the whole project
* Upgrade org.reflections to 0.10.12
2 years ago
Wenjun Ruan
Rick Cheng
Frank-Liao
Jay Chung
旺阳
Wei Xiaonan
Chenshuai
fuchanghai
haibingtown
Drake Youngkun Min
Aaron Wang
旺阳
Rick Cheng
caishunfeng
qianli2022
JieguangZhou
HanayoZz
Yann Ann
Eric Gao
kezhenxu94