Kerwin
b446b260f4
Modify shell env to bash ( #12742 )
2 years ago
Kerwin
9126e1d1fc
[3.1.1-prepare][Test] test ut ( #12729 )
2 years ago
Wenjun Ruan
a8113f05ee
cherry-pick Change command file permission to 755
2 years ago
Wenjun Ruan
215c571c8d
Fix flink sql cannot run due to missing main jar ( #12705 )
2 years ago
Kerwin
2c93dc6041
cherry-pick ( #12608 )
...
[improvement-#12416] Use CollectionUtils.isEmpty judge the collection isEmpty to avoid NPE
#12449
Co-authored-by: fuchanghai <33984497+fuchanghai@users.noreply.github.com>
2 years ago
Kerwin
94ef02e9de
cherry-pick [Improvement] Merge spi.utils into common.utils ( #12607 )
...
#12502
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2 years ago
kezhenxu94
eb7b48596c
cherry-pick Reorganize some classes in common module, remove duplicate classes
...
#12321
2 years ago
zhuangchong
7ca4438682
Resolve AbstractTask code conflicts
2 years ago
Kerwin
f3277277f0
cherry-pick Refactor LogServiceClient Singleton to avoid repeat creation of NettyClient #11777 ( #12542 )
...
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
2 years ago
Kerwin
344293102d
[3.1.1-prepare][cherry-pick][Improvement] Add remote task model #11767 ( #12541 )
2 years ago
insist777
3a14fd07b3
[Fix][Task] Fix dependent task can not predicate the status of the corresponding task correctly ( #12253 )
...
* [Fix][Task] dependent task can not predicate the status of the corresponding task correctly
2 years ago
Kerwin
d2e56af838
[Bug] [spark-sql] In spark-sql, select both SPARK1 and SPARK2 versions and execute ${SPARK_HOME2}/bin/spark-sql ( #11721 ) ( #12420 )
...
select different versions of spark-sql to execute different versions of spark-sql
Co-authored-by: limaiwang <limaiwang@163.com>
2 years ago
Kerwin
f0ad67f992
cherry-pick source is not available in sh ( #12413 )
...
Co-authored-by: simsicon <simsicon@gmail.com>
2 years ago
rickchengx
5cfe6a96b4
[Improvement-12372][k8s] Update the deprecated k8s api ( #12373 )
2 years ago
FlechazoW
39c1144fab
[Improvement][Task Plugin] Modify the comment of 'deployMode'. ( #12163 )
2 years ago
zhuangchong
b4f59af9d9
Remove the DataxTaskTest class because there is no junit5 package.
2 years ago
Kerwin
b559d033d3
fix datax NPE issue ( #12388 ) ( #12407 )
2 years ago
Kerwin
771dd67b2e
cherry-pick [Improvement-12391][API] Workflow definitions that contain logical task nodes support the copy function
2 years ago
caishunfeng
7e39396a76
[maven-release-plugin] prepare for next development iteration
2 years ago
caishunfeng
ae33ba5947
[maven-release-plugin] prepare release 3.1.0
2 years ago
JieguangZhou
f871a4a41f
fix python home conflict ( #12112 )
...
(cherry picked from commit 6eb1eb722a
)
2 years ago
Eric Gao
e7b12bf205
[Cherry-Pick][3.1.0-prepare] Cherry-Pick OssOperator for Resource Center to 3.1.0 ( #12094 )
...
* Cherry OssOperator for Resource Center to 3.1.0
* Fix doc dead link
2 years ago
JieguangZhou
a2b3659fe9
[improve] Optimize MLFlow task plugin for easy of use ( #12071 )
...
optimize code
(cherry picked from commit cf522e2f
)
2 years ago
rickchengx
806ad1d98c
[Improvement-11291][sql] Improvement the log output while executing multiple sql statements ( #11292 )
2 years ago
W.XING
9ad6a049c5
Add chunjun in dolphinscheduler-task-all/pom.xml ( #11375 )
2 years ago
kezhenxu94
fcc75ef1c6
Bump up dependencies to fix cves ( #11765 )
2 years ago
Kengo Seki
52b79b017e
[Improvement] Replace commons-lang 2 function invocations with commons-lang3 ( #11810 )
...
* [Improvement] Replace commons-lang 2 function invocations with commons-lang3
2 years ago
JieguangZhou
dde6f63c31
[Feature][PyDolphinScheduler] Support DVC task in pyds #11922 ( #11941 )
...
* add dvc task in pyds
* add BaseDVC class
(cherry picked from commit bbc228e93f
)
2 years ago
caishunfeng
8d1c2d3eeb
cherry-pick [Bug] Fix procedure task param pass #11919 ( #11926 )
2 years ago
fuchanghai
f8b9aad239
[feature-#11689] change replaceAll to replace in method of tryExecuteSqlResolveColumnNames ( #11696 )
2 years ago
caishunfeng
f95cdd350a
reduce task dependencies ( #11731 )
2 years ago
Wenjun Ruan
03e1e6fe45
[Bug] [Worker] Optimize the getAppId method to avoid worker OOM when kill task ( #11701 )
...
* Fix kill job may cause worker oom
2 years ago
Eric Gao
4a37345436
[Feature][Task Plugin] Support hive cli task plugin ( #11651 )
...
* Add hive cli task plugin
* Add docs for hive-cli task plugin
* Fix hive-cli task related front-end nits and checkstyle
* Fix exception handling logic
2 years ago
Wenjun Ruan
1b120e3a59
Refactor worker execute task process ( #11540 )
...
* Refactor worker execute task process
2 years ago
Wenjun Ruan
b96d69701a
[Improvement-#11613] Add spi priority factory ( #11614 )
...
* Add spi priority factory
* Add doc
* Add override log
* Use lombok
* Add comment
2 years ago
Wenjun Ruan
a41c6824fc
Add dependent task instance log ( #11541 )
...
* Add dependent task instance log
* Optimize log
* Fix dependent task initialize failed will throw exception
2 years ago
kezhenxu94
13e4720aa2
Upgrade spring boot and swagger ( #11574 )
2 years ago
fuchanghai
d8d5d392a7
[feature-11408] add hive option ( #11493 )
2 years ago
JieguangZhou
a974ba74ab
[Feature] New task plugin Pytorch ( #11498 )
...
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2 years ago
FangYin Cheng
11d74fd7e8
[test-11432][HttpTask] Add unit tests to http task ( #11453 )
...
* [test][HttpTask] Add unit tests to http task
* [test][HttpTask] fix http task test code format problem
* [test][HttpTask] fix http task test code replace http code to constants
2 years ago
lugela
e5d06c40a5
[Feature-10182][task-datax] ( #11387 )
...
In the process of realizing datax synchronization, use custom json for better connection to enable kerberos-authenticated clusters, such as using plug-ins such as hdfs and hbase
2 years ago
kezhenxu94
f6ef628030
Support reading application properties from kubernetes config map ( #11402 )
2 years ago
Eric Gao
896fef6c98
[Feature][Style] Enable spotless to manage imports ( #11458 )
2 years ago
Kerwin
b79bad19e5
[Fix-11051][Task]Fix the process exitValue exception when the process times out and th… ( #11099 )
2 years ago
Wenjun Ruan
5fa3e7b1ed
Add pause to task instance status ( #11390 )
2 years ago
Stalary
6345a13cdc
[Fix-10392][SqlTask]: Fix list param error when use sql task ( #11285 )
...
* FIX: fix list param in.
* FIX: code bug
* FIX: fix one value
* FIX: header
* FIX: ci
* FIX: fix ci
* MOD: for review
* MOD: for review
2 years ago
caishunfeng
0464123c2b
[Feature-11223] support stream task ( #11350 )
...
* add task execute type
* update task definition list paging
* update task instance list paging
* stream task start
* [Feature][UI] Some changes to execute task.
* Set the connection edge to dashed line.
* Add FLINK_STREAM task.
* add stream task
* flink savepoint and cancel
* fix query bug
* add stream task definition
* add task instance for stream task
* delete stream task definition state
* update api for stream task definition edit
* modify search for stream task instance
* add language
* delete task type search for stream task definition
* change task type search for stream task instance
* add jump button
* add savepoint
* add down log for stream task instance
* ui test
* stream task start
* run DAG
* [Fix][UI] Fix the stream task edgs not to be dashed when filling back.
* [Feature][UI] Remove some fields for FLINK_STREAM.
* add start modal
* add dryRun column for stream task instance
* fix duration
* fix pon
* fix build error
* Add success tip
* add auto sync for stream task instance
* remove forgien key for task instance
* license header
* UT fix
* modify locales
* recover common config
* fix UT
* add doc
Co-authored-by: Amy <amywang0104@163.com>
Co-authored-by: devosend <devosend@gmail.com>
2 years ago
Assert
b3919d30e7
[Improvement-11394][Task Plugin] Remove Passed Parameter --queue in Seatunnel Task Plugin ( #11395 )
2 years ago
Assert
03582f2e70
[Fix-11376][task plugin]Seatunnel Task cannot save successfully when … ( #11377 )
2 years ago
Wenjun Ruan
8774415197
Split ExecutionStatus to WorkflowExecutionStatus and TaskExecutionStatus ( #11340 )
2 years ago