85605bbef9
[Improvement-13653][Remote Logging] Support api-server to get task log from remote target ( #13654 )
2 years ago
9d9ae9ad54
[improvement] support self-dependent ( #13818 )
2 years ago
68660ec96b
Refactor remote command ( #13809 )
...
* Refactor remote command
* Rename Command to Message
2 years ago
d1b6e6f02c
Take over task instance in master failover ( #13798 )
2 years ago
8895921d87
[Improvement-13651] Remove useless resources_task ( #13721 )
2 years ago
c9066e8de9
Use MDC to filter task instance log ( #13673 )
...
* Use MDC to collect task instance log
* Use MDCAutoClosableContext to remove the MDC key
2 years ago
047fa2f65e
[Feature-13511] Submit Spark task directly on Kubernetes ( #13550 )
2 years ago
8d12dc0702
[Improvement-13491] Use lombok @Slf4j annotation to generate logger ( #13509 )
2 years ago
6300a9b8de
Fix serial wait will go into block when there is no task need to submit ( #13486 )
2 years ago
12dd60fa46
Fix task wake up failed will block the event ( #13466 )
2 years ago
8be32d4145
[Feature][Api] When use api to run a process we want get processInstanceId ( #13184 )
...
* add sql
* add mapper
* add dao
* add excutor
Co-authored-by: qianl4 <qianl4@cicso.com>
2 years ago
01f4fb26f0
Change remove task instance log to async request ( #13399 )
2 years ago
98dfd64444
Clear the task group data when delete a project/workflowInstance ( #13383 )
2 years ago
8a479927f3
Add projectCode in t_ds_process_instance and t_ds_task_instance to remove join ( #13284 )
2 years ago
52134277a3
Fix task group cannot release when kill task ( #13314 )
2 years ago
8503ee0eed
[Improvement][Worker] Startup parameter should have the highest priority ( #13274 )
2 years ago
fd3afd84ad
Remove alert when delete workflow instance ( #13281 )
2 years ago
de70421a1e
Remove the log path check ( #13280 )
2 years ago
14ec4a2398
Remove dao module in worker ( #13242 )
2 years ago
66e20271ad
[Feature][Master] Add task caching mechanism to improve the running speed of repetitive tasks ( #13194 )
...
* Supports task instance cache operation
* add task plugin cache
* use SHA-256 to generate key
* Update dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_mysql.sql
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
* Update dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_postgresql.sql
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
* Optimizing database Scripts
* Optimize clear cache operation
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
2 years ago
e4b9b67255
Allow execute task in workflow instance ( #13103 )
2 years ago
838a0df783
Remove logic task plugin module ( #13171 )
2 years ago
f5801a0e1c
Fix task group might be rob by multiple task ( #13115 )
2 years ago
6ef74073cc
[Improve-13001]migrate commons-collections -> commons-collections4 ( #13002 )
2 years ago
8a152aebc7
Fix task log file might not be clear ( #13102 )
2 years ago
fed1e85fb8
Fix the invalidate task instance never be deleted ( #13091 )
2 years ago
38b876733c
[Feature-10498] Mask the password in the log of sqoop task ( #11589 )
2 years ago
c916c60853
fix NPE while retry task ( #12903 )
2 years ago
d99ba29b66
Fix master cluster may loop command unbalanced ( #12891 )
...
(cherry picked from commit 3b2b86661be76b7c1404a910c865d78b7936313d)
2 years ago
00b18ed422
[Improve]Remove the code logger.isDebugEnabled() #5918 #10542 ( #12738 )
...
Co-authored-by: chunlai.xu <chunlai.xu@zhaopin.com.cn>
2 years ago
08335b1032
[Improvement][Task] Improved way to collect yarn job's appIds ( #12197 )
...
* Provide aop way as an optional way to collect yarn job's applicationId, and import new module `dolphinscheduler-aop` to place the aop code.
* Add user property `appId.collect` for user to decide how to collect applicationId.
* Add new environment configuration for each type of yarn tasks to support aop in `dolphinscheduler_env.sh`
* Update docs to declare how to use aop way.
* Update `LogUtils` to support fetch applicationId in different ways based on the user property.
Co-authored-by: gabrywu <gabrywu@apache.com>
2 years ago
ed209bdf82
[Refactor] Migrate all workergroup-related interface functions from ProcessServiceImpl ( #12493 )
...
* Migrate all workergroup-related interface functions from ProcessServiceImpl
2 years ago
489e7fe4e2
[Feature-10495][Resource Center] Resource Center Refactor ( #12076 )
...
* resource center refactor - S3 services connection
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2 years ago
04aa125ba2
[Refactor]migrate some task dao functions from ProcessServiceImpl to dao modules. ( #12505 )
...
* migrate some task DAO to dao modules.
* Update dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/repository/impl/ProcessInstanceMapDaoImpl.java
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2 years ago
233bbdb09e
[Fix-12451][k8s] Read the kubeconfig from cluster conf ( #12452 )
2 years ago
a0d37fc7ae
Set tenantDir permission ( #12486 )
2 years ago
dedff70f90
[Improvement] Merge spi.utils into common.utils ( #12502 )
...
* improve JSONUtil
* merge spi.utils into common.utils
* split constants && remove some copy utils method
* remove StringUtils
2 years ago
b936b882bb
[Refactor] Migrate all command-related interface functions from ProcessServiceImpl ( #12474 )
...
* migrate all command-related interface functions to CommonService
2 years ago
f0a34cddec
[improvement-#12416] Use CollectionUtils.isEmpty judge the collection isEmpty to avoid NPE ( #12449 )
2 years ago
0eef2e3e10
[Improvement][Style] Fix code style of ProcessScheduleTask and ProcessServiceImpl ( #12447 )
2 years ago
d46e4659d9
[Improvement][Style] Fix remaining style errors and wildcard imports ( #12412 )
...
* Fix remaining style errors and wildcard imports
* Upgrade spotless to the latest stable version, exclude .github folder from spotless check and fix dead link
* Fix spotless matching scope of markdown files
2 years ago
97edc7d652
[Fix-12356][k8s] fix the null exception when submitting k8s task plugin ( #12358 )
2 years ago
a8e23008ac
Fix timing scheduling trigger master service report to get command parameter null pointer exception ( #12419 )
2 years ago
934d6d21eb
[Bug] [Service] Use MapUtils to judge globalParamsMap is empty. ( #12384 )
2 years ago
2f37da0dbc
[Improvement][Test] Block the usage of powermock and move mockito dependencies from sub-modules to root pom ( #12311 )
...
* move mockito dependencies from sub-modules to root pom
* Add check in CI to block the usage of powermock
2 years ago
b357781df2
[Migrate][Test] Migrate junit4 -> junit5 test cases in common, service, and spi modules ( #12363 )
2 years ago
22103f975e
[improvement] Migrate all UT cases from jUnit4 to jUnit5 in dao module ( #12328 )
...
* [improvement] Migrate all UT cases from jUnit4 to jUnit5 in dao module
Co-authored-by: Jackie <‘2875334588@qq.com’>
2 years ago
db1d319159
Reorganize some classes in common module, remove duplicate classes ( #12321 )
2 years ago
0e1c8d8153
[Feature][API] New restful API task and task relation ( #12116 )
2 years ago
05099bd8f7
[Improvement-12296][Test] Close static mock ( #12300 )
2 years ago
Rick Cheng
caishunfeng
Wenjun Ruan
Aaron Wang
seedscoder
qianli2022
JieguangZhou
Yann Ann
Kerwin
XCL
HanayoZz
fuchanghai
Eric Gao
houshitao
kezhenxu94
Jiajie Zhong