3bc88e32c7
Rename dolphinscheduler-aop to dolphinscheduler-yarn-aop ( #16095 )
5 months ago
e9d85914d7
Fix queryByTypeAndJobId might error due to multiple result ( #15883 )
6 months ago
99a2461785
[Improvement] change js engine ( #15747 )
...
* change js engine
* add dependent jar
7 months ago
bf2cdc5300
Use Druid to split sql ( #15367 )
10 months ago
d144f48ed7
[Feature-15248][dolphinscheduler-alert-plugins] add alert plugin aliyun-voice ( #15248 )
...
* add alert aliyun-voice
* VoiceParam replace these with lombok @Data
* security.ts add alarm_instance params
* optimize alert aliyun vocie code
* Merge Code
* rollback pnpm-lock.yaml to branch :origin/dev version
* add the doc about the new plugin
* add com.aliyun.dyvmsapi20170525 version 2.14
* completed
* run mvn spotless:apply
* Code optimization
* Change to @Data
* Code specification optimization
* add com.aliyund.yvmsapi20170525.jar license
* modify com.aliyund.yvmsapi20170525.jar license
* modify com.aliyund.yvmsapi20170525.jar license
* add aliyun-vocie licenses
* add aliyun-voice link to docsdev.js
* modify vocie module to aliyunVoice
* add lisense
---------
Co-authored-by: xujiaqiang <“xujiaqiangwz@163.com”>
Co-authored-by: 旺阳 <wang@lqwang.net>
Co-authored-by: David Zollo <dailidong66@gmail.com>
11 months ago
33084d281f
Add dolphinscheduler-dao-plugin module ( #15019 )
1 year ago
55cc77226f
[RPC] Refactor the remote module. ( #14776 )
...
* Add dolphinscheduler-extract-base
* Add dolphinscheduler-extract-master
* Add dolphinscheduler-extract-worker
* Add dolphinscheduler-extract-alert
1 year ago
25480ae9e7
[Feature][Resource Center] Add support for Huawei Cloud OBS ( #14643 )
...
* [Feature][Resource Center] Add support for Huawei Cloud OBS as storage of resource center
* add license and add doc
* add 3-party dependency license
* Update LICENSE
* fix
* Update pom.xml
* fix
* fix
---------
Co-authored-by: sunkang <sunkang@hjfruit.com>
Co-authored-by: xiangzihao <460888207@qq.com>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
1 year ago
ca760aabd4
[Fix-14512][BOM] kubernetes-client version conflict ( #14561 )
1 year ago
b72077011b
[Fix-13987][bom] set 3.17.2 version protobuf-java ( #13998 )
...
Co-authored-by: eye <eye.gu@aloudata.com>
1 year ago
4fa0ab4d7e
[feature][Resource] Add support for Azure Blob Storage in the resource center ( #14082 )
1 year ago
ed8ae9c0ee
[Improvement-14286][BOM] Bump clickhouse-jdbc from 0.3.2-patch11 to 0.4.6 ( #14287 )
1 year ago
fdb8fde776
[NOTICE]Update the NOTICE year ( #14272 )
...
Co-authored-by: lgcareer <lgcareer@apache.org>
1 year ago
18d176c5f4
feat: Introduce new datasource vertica ( #14232 )
...
Co-authored-by: Zinway Liu <zinway.liu@ucloud.cn>
1 year ago
f1e78627fc
[feature][plugin] Add snowflake datasource in datasource plugin ( #13729 )
...
---------
Co-authored-by: weitong <weitong@cisco.com>
2 years ago
77e58ce245
[Feature] Add SSO login by Casdoor ( #8706 )
2 years ago
db6c061c8b
[Feature][plugin] Add databend datasource in datasource plugin ( #13866 )
...
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
2 years ago
c0126b7f30
[Feature][plugin] Support Kyuubi datasource ( #13642 )
...
---------
Co-authored-by: weitong <weitong@cisco.com>
Co-authored-by: Rick Cheng <38122586+rickchengx@users.noreply.github.com>
2 years ago
119f08d2ba
[Bug-13882][Worker] Upgrade kubernetes-client version to 6.0.0 ( #13891 )
2 years ago
273a5e78eb
[FEATURE][Task Plugin]Add remote-shell task plugin ( #13801 )
2 years ago
2dceb6b8ca
[Feature-13428][Resource Center] Add support for Google Cloud Storage in the resource center ( #13562 )
2 years ago
78ba71bdbd
[Feature][task]add azure datafactory task type ( #13417 )
...
* init data factory
* add task-type-config.yaml
* add data factory ui
* submit doc
* submit license
---------
Co-authored-by: devosend <devosend@gmail.com>
2 years ago
bcf03ad4d1
[Feature-9467] add DAMENG DataSource ( #12860 )
...
* [Feature-9467][DataSource] add DAMENG （达梦） data source
* [Feature-9467] add DM datasource doc (Issue #9467 )
* [Feature-9467] add DM IDataBaseOptionKeys
* [Feature-9467] add DM DataSource: DmDataSourceChannelFactoryTest remove testGetDmConnection method
* [Feature-9467] modification package dm to dameng;
* [Feature-9467] add Dameng DmJdbcDriver18 License
* [Feature-9467] add DM DataSource: remove DruidDataSourceClient
Co-authored-by: lenian <yuenian@mananacare.com>
2 years ago
f0dd4f081f
[Feature][task-plugins-12820] azure azure-sql datasource plugins ( #13209 )
...
* submit azure sql code
* change mssql-jdbc version
* merge changes to delete other
* merge changes to delete other
* add dependencies
2 years ago
6ef74073cc
[Improve-13001]migrate commons-collections -> commons-collections4 ( #13002 )
2 years ago
b40c63f02d
[Feature][DataSource]Add trino datasource plugin ( #12911 )
2 years ago
43d69ae157
Upgrade clickhouse jdbc driver ( #12639 )
2 years ago
1f23d29698
[Improvement-12029][dolphinscheduler-api] Upgrade the snakeyaml version to avoid vulnerabilities ( #12726 )
2 years ago
1347a8f94c
[chore] Separate Python API into another repository ( #12779 )
...
Currently, our Python API code is a module in apache/dolphinscheduler codebase,
each time users change Python API code, they need to run all requests CI check
for dolphinscheduler and Python API, But if the user does only change Python
code, it could be merged if Python API CI pass and do not dependent on others CI.
Besides, we release Python API as the same version of dolphinscheduler. It is
easy for user to match Python API version. But when Python API does not change
any code, but dolphinscheduler release a bugfix version, Python API has to
release the new version to match dolphinscheduler. This happened when we
released Python API 2.0.6 and 2.0.7. 2.0.6 and 2.0.7 is bugfix version, and
Python API does not change any code, so the PyPI package is the same.
Separate Python API also makes our code more sense, we will have more
distinguished code in dolphinscheduler and Python API new repository.
Have separate issue tracker and changelog for information to users.
ref PR in other repository: apache/dolphinscheduler-sdk-python#1
see more detail in mail thread: https://lists.apache.org/thread/4z7l5l54c4d81smjlk1n8nq380p9f0oo
2 years ago
a47b4d0672
[Feature][Task] Transfer files between tasks ( #12552 )
...
* add data transfer between tasks
* add delete DATA_TRANSFER API
* convert Result to DeleteDataTransferResponse
* add api UT
* fix final
* fix doc
2 years ago
08335b1032
[Improvement][Task] Improved way to collect yarn job's appIds ( #12197 )
...
* Provide aop way as an optional way to collect yarn job's applicationId, and import new module `dolphinscheduler-aop` to place the aop code.
* Add user property `appId.collect` for user to decide how to collect applicationId.
* Add new environment configuration for each type of yarn tasks to support aop in `dolphinscheduler_env.sh`
* Update docs to declare how to use aop way.
* Update `LogUtils` to support fetch applicationId in different ways based on the user property.
Co-authored-by: gabrywu <gabrywu@apache.com>
2 years ago
77e29b59b2
[Improvement] add springdoc-openapi-ui ( #12379 )
...
Co-authored-by: fuchanghai <‘2875334588@qq.com’>
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
2 years ago
c7435a51ac
[Feature][task-plugins] aws datasync task plugins ( #11865 )
...
* submit datasync task
* add aws software package license
2 years ago
40090d459e
[Improvement] remove log-server and server module ( #12206 )
...
* remove log-server module
* remove dolphinscheduler-server module
2 years ago
308f632fcc
[Feature][TASK-PLUGIN] AWS Database Migration Service (DMS) ( #11868 )
...
* add aws dms
2 years ago
cf5a8894e2
[BUG][BE-12113]fix htrace dependency conflicts ( #12126 )
...
* fix htrace dependency conflicts
* replace htrace-core with hbase-noop-htrace
2 years ago
66958b91d7
[Feature][Resource Center] Add support for Alibaba Cloud OSS as storage of resource center ( #11708 )
...
* Add support for Alibaba Cloud OSS as storage of resource center
* Add dependency licenses
* Refactor code, add unit tests and related docs
2 years ago
8cddb10773
[Feat][UI] Update package. ( #12046 )
...
* [Feat][UI] Update package.
* [Feat][UI] Update package.
2 years ago
147e0ae8d7
Remove duplicate Spring version management ( #11899 )
2 years ago
105773f54d
Remove htrace dependencies ( #11881 )
...
* Remove htrace dependencies
* Update pom.xml
2 years ago
3664d85143
[Improve] Upgrade Hadoop to 3.2.4 ( #11832 )
2 years ago
efedc9a53c
Bump up dependencies to fix cves ( #11765 )
2 years ago
2eb8b9f7f0
[Feature][Registry] Support etcd as registry ( #10981 )
2 years ago
554562bfa9
[fix-#11691] Add lz4-java in clickhouse datasource. ( #11697 )
2 years ago
277f137358
Add Kubernetes configmap reload to all components ( #11730 )
2 years ago
13e4720aa2
Upgrade spring boot and swagger ( #11574 )
2 years ago
f6ef628030
Support reading application properties from kubernetes config map ( #11402 )
2 years ago
91a944f967
fix nodeSize is not a function bug ( #11200 )
2 years ago
c7789bf049
Add base loop task execotor and http template parser ( #11137 )
...
* Add base loop task execotor and http template parser
* Add JsonPathUtils
2 years ago
af7b359333
[Feature][Task Plugin] Add SageMaker Pipeline task plugin for MLOps scenario ( #10826 ) ( #10935 )
...
* add sagemaker pipeline task plugin
[DOC] add Sagemaker task plugin document
change license and fix dependencies
* [fix] Optimize the code
* Update dolphinscheduler-task-plugin/dolphinscheduler-task-sagemaker/src/main/java/org/apache/dolphinscheduler/plugin/task/sagemaker/SagemakerParameters.java
Optimization parameter judgment
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
* [fix] nips
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2 years ago
Wenjun Ruan
caishunfeng
xujiaqiang
Edison Catto
Aaron Wang
eye-gu
Rick Cheng
lgcareer
Zinway
He Zhao
Bingchang Chen
Jeremy
JieguangZhou
Rick Cheng
Tq
lenian
Yann Ann
insist777
simsicon
seedscoder
Jay Chung
fuchanghai
Eric Gao
songjianet
kezhenxu94
Kengo Seki
wjf
Devosend