78ba71bdbd
[Feature][task]add azure datafactory task type ( #13417 )
...
* init data factory
* add task-type-config.yaml
* add data factory ui
* submit doc
* submit license
---------
Co-authored-by: devosend <devosend@gmail.com>
2 years ago
3a6e10397f
[feature][api-datasource]add redshift auth mode to get connection by access key ( #13379 )
...
* submit redshift auth mode
* add front end
* add doc and fix frontend
Co-authored-by: devosend <devosend@gmail.com>
2 years ago
3f16776cd7
[improvement][install.sh] fix the install Error "Command not found rmr" & su… ( #13163 )
...
* [BUG][install.sh] fix the install Error "Command not found rmr" & support ZooKeeper (3.4.6+)
* [BUG][install.sh] fix the install Error "Command not found rmr" & support ZooKeeper (3.4.6+)
* [BUG][install.sh] fix the install Error "Command not found rmr" & support ZooKeeper (3.4.6+)
* [docs] add documentation for building with different ZK versions
* support both 3.4 and 3.8
* [docs] add documentation for building with different ZK versions
* support both 3.4 and 3.8
* [improvement][install.sh] fix the install Error "Command not found rmr" & support ZooKeeper (3.4.6+)
* update known-dependencies.txt
* [improvement][install.sh] fix the install Error "Command not found rmr"
* support ZooKeeper (3.4.6+) by activating zk-3.4 profile
* make zk-3.8 as default option in pom.xml
* update defalut ZK version in docs
* update known-dependencies.txt
Co-authored-by: wangxx <wangxx@kcwl.com>
2 years ago
bcf03ad4d1
[Feature-9467] add DAMENG DataSource ( #12860 )
...
* [Feature-9467][DataSource] add DAMENG （达梦） data source
* [Feature-9467] add DM datasource doc (Issue #9467 )
* [Feature-9467] add DM IDataBaseOptionKeys
* [Feature-9467] add DM DataSource: DmDataSourceChannelFactoryTest remove testGetDmConnection method
* [Feature-9467] modification package dm to dameng;
* [Feature-9467] add Dameng DmJdbcDriver18 License
* [Feature-9467] add DM DataSource: remove DruidDataSourceClient
Co-authored-by: lenian <yuenian@mananacare.com>
2 years ago
f0dd4f081f
[Feature][task-plugins-12820] azure azure-sql datasource plugins ( #13209 )
...
* submit azure sql code
* change mssql-jdbc version
* merge changes to delete other
* merge changes to delete other
* add dependencies
2 years ago
6ef74073cc
[Improve-13001]migrate commons-collections -> commons-collections4 ( #13002 )
2 years ago
b40c63f02d
[Feature][DataSource]Add trino datasource plugin ( #12911 )
2 years ago
43d69ae157
Upgrade clickhouse jdbc driver ( #12639 )
2 years ago
1f23d29698
[Improvement-12029][dolphinscheduler-api] Upgrade the snakeyaml version to avoid vulnerabilities ( #12726 )
2 years ago
a47b4d0672
[Feature][Task] Transfer files between tasks ( #12552 )
...
* add data transfer between tasks
* add delete DATA_TRANSFER API
* convert Result to DeleteDataTransferResponse
* add api UT
* fix final
* fix doc
2 years ago
08335b1032
[Improvement][Task] Improved way to collect yarn job's appIds ( #12197 )
...
* Provide aop way as an optional way to collect yarn job's applicationId, and import new module `dolphinscheduler-aop` to place the aop code.
* Add user property `appId.collect` for user to decide how to collect applicationId.
* Add new environment configuration for each type of yarn tasks to support aop in `dolphinscheduler_env.sh`
* Update docs to declare how to use aop way.
* Update `LogUtils` to support fetch applicationId in different ways based on the user property.
Co-authored-by: gabrywu <gabrywu@apache.com>
2 years ago
77e29b59b2
[Improvement] add springdoc-openapi-ui ( #12379 )
...
Co-authored-by: fuchanghai <‘2875334588@qq.com’>
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
2 years ago
2f37da0dbc
[Improvement][Test] Block the usage of powermock and move mockito dependencies from sub-modules to root pom ( #12311 )
...
* move mockito dependencies from sub-modules to root pom
* Add check in CI to block the usage of powermock
2 years ago
9ab79e064c
[Improvement][Test] Fully remove the usage of powermock from the whole project ( #12244 )
...
* Fully remove the usage of powermock from the whole project
* Upgrade org.reflections to 0.10.12
2 years ago
7bf49a7179
delete useless exclusions ( #12273 )
...
delete software.amazon.awssdk datasync useless dependency exclusions
2 years ago
c7435a51ac
[Feature][task-plugins] aws datasync task plugins ( #11865 )
...
* submit datasync task
* add aws software package license
2 years ago
308f632fcc
[Feature][TASK-PLUGIN] AWS Database Migration Service (DMS) ( #11868 )
...
* add aws dms
2 years ago
cf5a8894e2
[BUG][BE-12113]fix htrace dependency conflicts ( #12126 )
...
* fix htrace dependency conflicts
* replace htrace-core with hbase-noop-htrace
2 years ago
66958b91d7
[Feature][Resource Center] Add support for Alibaba Cloud OSS as storage of resource center ( #11708 )
...
* Add support for Alibaba Cloud OSS as storage of resource center
* Add dependency licenses
* Refactor code, add unit tests and related docs
2 years ago
a44817fc46
[Doc][Style] Fix doc format once for all ( #12006 )
2 years ago
147e0ae8d7
Remove duplicate Spring version management ( #11899 )
2 years ago
105773f54d
Remove htrace dependencies ( #11881 )
...
* Remove htrace dependencies
* Update pom.xml
2 years ago
3664d85143
[Improve] Upgrade Hadoop to 3.2.4 ( #11832 )
2 years ago
2e61c76c22
[Improvement] Add remote task model ( #11767 )
2 years ago
efedc9a53c
Bump up dependencies to fix cves ( #11765 )
2 years ago
2eb8b9f7f0
[Feature][Registry] Support etcd as registry ( #10981 )
2 years ago
554562bfa9
[fix-#11691] Add lz4-java in clickhouse datasource. ( #11697 )
2 years ago
17a9dd25fa
Fix vulnerability in LDAP login ( #11586 )
2 years ago
13e4720aa2
Upgrade spring boot and swagger ( #11574 )
2 years ago
f6ef628030
Support reading application properties from kubernetes config map ( #11402 )
2 years ago
7ff34c3947
[Feature-7024] Add waiting strategy to support master/worker can recover from registry lost ( #11368 )
...
* Add waiting strategy to support master/worker can recover from registry lost
* throw exception when zookeeper registry start failed due to interrupted
2 years ago
c7789bf049
Add base loop task execotor and http template parser ( #11137 )
...
* Add base loop task execotor and http template parser
* Add JsonPathUtils
2 years ago
5b429d29b8
add oracle dependency ( #11095 )
2 years ago
5e9c7dad23
Add dolphinscheduler-bom to manage the dependency version ( #11025 )
2 years ago
Tq
v-wx-v
lenian
Yann Ann
insist777
simsicon
seedscoder
JieguangZhou
Aaron Wang
fuchanghai
Eric Gao
kezhenxu94
Kengo Seki
caishunfeng
wjf
Wenjun Ruan
xiangzihao