6eb1eb722a
fix python home conflict ( #12112 )
2 years ago
9b3b4e22b4
[Bug-#12057][task-plugin] fix when the sql query result is empty, the email fails to send the attachment, and an exception will be reported ( #12059 )
...
* [Bug-#12057][task-plugin] fix when the sql query result is empty, the email fails to send the attachment, and an exception will be reported
Co-authored-by: 冯剑 Jian <jian.feng@jiduauto.com>
2 years ago
08a4c7981f
[improve] Remove the spark version of spark task ( #11860 )
2 years ago
cf522e2fc0
[improve] Optimize MLFlow task plugin for easy of use ( #12071 )
...
optimize code
2 years ago
66958b91d7
[Feature][Resource Center] Add support for Alibaba Cloud OSS as storage of resource center ( #11708 )
...
* Add support for Alibaba Cloud OSS as storage of resource center
* Add dependency licenses
* Refactor code, add unit tests and related docs
2 years ago
e1b55db72a
[Improvement][Test] Give an example on replacing Powermock with Mockito ( #11588 )
...
* Give an example on replacing powermock with mockito
* Remove redundant comments
* Refactoring related UTs for better readability.
2 years ago
b3bbf69b2e
[Improvement-11291][sql] Improvement the log output while executing multiple sql statements ( #11292 )
2 years ago
bbc228e93f
[Feature][PyDolphinScheduler] Support DVC task in pyds #11922 ( #11941 )
...
* add dvc task in pyds
* add BaseDVC class
2 years ago
5b384f3fab
[Feature-11473][Task]Support test task ( #11670 )
...
* [improve] support test tasks
* [improve] support test tasks
* [improve] support test tasks
* [improve] support test tasks
* [improve] support test tasks
* Update TaskExecuteThread.java
* try solve e2e q
* try solve e2e q
* try solve e2e q
* try solve e2e q
* try solve e2e q
* try solve e2e q
* try solve e2e q
* try solve e2e q
* try solve e2e q
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* Update DataSource.java
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* Update messages_zh_CN.properties
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* Update messages.properties
* Update messages_en_US.properties
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
2 years ago
511149f644
[fix-10938]: use dot to replace source and make the default env work in shell ( #11625 )
...
* [fix-10938]: use the dot to replace source and make the default env work in the sh
Co-authored-by: Kerwin <37063904+zhuangchong@users.noreply.github.com>
2 years ago
d3a77c68e6
Make LogServiceClient Singleton ( #11777 )
2 years ago
0deafba12c
fix procedure task param pass ( #11919 )
2 years ago
25b78a8003
[Bug] [spark-sql] In spark-sql, select both SPARK1 and SPARK2 versions and execute ${SPARK_HOME2}/bin/spark-sql ( #11721 )
...
select different versions of spark-sql to execute different versions of spark-sql
2 years ago
147e0ae8d7
Remove duplicate Spring version management ( #11899 )
2 years ago
1164cb776d
Add chunjun in dolphinscheduler-task-all/pom.xml ( #11375 )
2 years ago
5d9331f4ee
[Feature-10683][Task Plugin] Add Java Task Plugin. ( #10689 )
2 years ago
e101a5cb2c
[fix-#11815] fix ck column names contain special characters ( #11818 )
...
Co-authored-by: fuchanghai <changhai.fu@marketingforce.com>
2 years ago
2e61c76c22
[Improvement] Add remote task model ( #11767 )
2 years ago
efedc9a53c
Bump up dependencies to fix cves ( #11765 )
2 years ago
444c7e6eb7
[Improvement] Replace commons-lang 2 function invocations with commons-lang3 ( #11810 )
...
* [Improvement] Replace commons-lang 2 function invocations with commons-lang3
2 years ago
f8b9aad239
[feature-#11689] change replaceAll to replace in method of tryExecuteSqlResolveColumnNames ( #11696 )
2 years ago
f95cdd350a
reduce task dependencies ( #11731 )
2 years ago
03e1e6fe45
[Bug] [Worker] Optimize the getAppId method to avoid worker OOM when kill task ( #11701 )
...
* Fix kill job may cause worker oom
2 years ago
4a37345436
[Feature][Task Plugin] Support hive cli task plugin ( #11651 )
...
* Add hive cli task plugin
* Add docs for hive-cli task plugin
* Fix hive-cli task related front-end nits and checkstyle
* Fix exception handling logic
2 years ago
1b120e3a59
Refactor worker execute task process ( #11540 )
...
* Refactor worker execute task process
2 years ago
b96d69701a
[Improvement-#11613] Add spi priority factory ( #11614 )
...
* Add spi priority factory
* Add doc
* Add override log
* Use lombok
* Add comment
2 years ago
a41c6824fc
Add dependent task instance log ( #11541 )
...
* Add dependent task instance log
* Optimize log
* Fix dependent task initialize failed will throw exception
2 years ago
13e4720aa2
Upgrade spring boot and swagger ( #11574 )
2 years ago
d8d5d392a7
[feature-11408] add hive option ( #11493 )
2 years ago
a974ba74ab
[Feature] New task plugin Pytorch ( #11498 )
...
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2 years ago
11d74fd7e8
[test-11432][HttpTask] Add unit tests to http task ( #11453 )
...
* [test][HttpTask] Add unit tests to http task
* [test][HttpTask] fix http task test code format problem
* [test][HttpTask] fix http task test code replace http code to constants
2 years ago
e5d06c40a5
[Feature-10182][task-datax] ( #11387 )
...
In the process of realizing datax synchronization, use custom json for better connection to enable kerberos-authenticated clusters, such as using plug-ins such as hdfs and hbase
2 years ago
f6ef628030
Support reading application properties from kubernetes config map ( #11402 )
2 years ago
896fef6c98
[Feature][Style] Enable spotless to manage imports ( #11458 )
2 years ago
b79bad19e5
[Fix-11051][Task]Fix the process exitValue exception when the process times out and th… ( #11099 )
2 years ago
5fa3e7b1ed
Add pause to task instance status ( #11390 )
2 years ago
6345a13cdc
[Fix-10392][SqlTask]: Fix list param error when use sql task ( #11285 )
...
* FIX: fix list param in.
* FIX: code bug
* FIX: fix one value
* FIX: header
* FIX: ci
* FIX: fix ci
* MOD: for review
* MOD: for review
2 years ago
0464123c2b
[Feature-11223] support stream task ( #11350 )
...
* add task execute type
* update task definition list paging
* update task instance list paging
* stream task start
* [Feature][UI] Some changes to execute task.
* Set the connection edge to dashed line.
* Add FLINK_STREAM task.
* add stream task
* flink savepoint and cancel
* fix query bug
* add stream task definition
* add task instance for stream task
* delete stream task definition state
* update api for stream task definition edit
* modify search for stream task instance
* add language
* delete task type search for stream task definition
* change task type search for stream task instance
* add jump button
* add savepoint
* add down log for stream task instance
* ui test
* stream task start
* run DAG
* [Fix][UI] Fix the stream task edgs not to be dashed when filling back.
* [Feature][UI] Remove some fields for FLINK_STREAM.
* add start modal
* add dryRun column for stream task instance
* fix duration
* fix pon
* fix build error
* Add success tip
* add auto sync for stream task instance
* remove forgien key for task instance
* license header
* UT fix
* modify locales
* recover common config
* fix UT
* add doc
Co-authored-by: Amy <amywang0104@163.com>
Co-authored-by: devosend <devosend@gmail.com>
2 years ago
b3919d30e7
[Improvement-11394][Task Plugin] Remove Passed Parameter --queue in Seatunnel Task Plugin ( #11395 )
2 years ago
03582f2e70
[Fix-11376][task plugin]Seatunnel Task cannot save successfully when … ( #11377 )
2 years ago
8774415197
Split ExecutionStatus to WorkflowExecutionStatus and TaskExecutionStatus ( #11340 )
2 years ago
6a02870926
[Feature][style] Add spotless maven plugin for automatic style fix. ( #11272 )
...
* [Feature][style] Add spotless maven plugin for automatic style fix (#10963 )
* Fix spotless ratchet configuration
* Remove license-check and decrease line length threshold value
* Update related docs
* Remove checkstyle and add pre-commit hook
* Test updated pre-commit hook
* Replace checkstyle with spotless in CI
* Remove reviewdog
2 years ago
9a53c6ac34
fix work oom when task logs's size is very large ( #11224 )
2 years ago
bfff3a7c5d
fix error ( #11206 )
2 years ago
513f336015
[Feature] Add new task type chunjun ( #10937 )
2 years ago
818648df7d
[Bug-11071] fix local params ( #11184 )
...
* fix local params
* add CI case
2 years ago
052ceaacd0
Add is success in loop task status ( #11169 )
2 years ago
cdfe115247
[Feature-10837][Task Plugin] Sqoop Task Add --split-by Parameter ( #10960 )
...
* [Feature-10837][Task Plugin] Sqoop Task Add --split-by Parameter
* checkstyle
2 years ago
c7789bf049
Add base loop task execotor and http template parser ( #11137 )
...
* Add base loop task execotor and http template parser
* Add JsonPathUtils
2 years ago
af7b359333
[Feature][Task Plugin] Add SageMaker Pipeline task plugin for MLOps scenario ( #10826 ) ( #10935 )
...
* add sagemaker pipeline task plugin
[DOC] add Sagemaker task plugin document
change license and fix dependencies
* [fix] Optimize the code
* Update dolphinscheduler-task-plugin/dolphinscheduler-task-sagemaker/src/main/java/org/apache/dolphinscheduler/plugin/task/sagemaker/SagemakerParameters.java
Optimization parameter judgment
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
* [fix] nips
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2 years ago
JieguangZhou
冯剑
rickchengx
Eric Gao
insist777
itzhang89
Wenjun Ruan
caishunfeng
limaiwang
kezhenxu94
W.XING
juzimao
fuchanghai
Kengo Seki
FangYin Cheng
lugela
Kerwin
Stalary
Assert
microeastcowboy
xuhhui