DolphinScheduler

Commit Graph

Author	SHA1	Message	Date
JieguangZhou	273a5e78eb	[FEATURE][Task Plugin]Add remote-shell task plugin (#13801 )	2 years ago
Rick Cheng	2dceb6b8ca	[Feature-13428][Resource Center] Add support for Google Cloud Storage in the resource center (#13562 )	2 years ago
Tq	78ba71bdbd	[Feature][task]add azure datafactory task type (#13417 ) * init data factory * add task-type-config.yaml * add data factory ui * submit doc * submit license --------- Co-authored-by: devosend <devosend@gmail.com>	2 years ago
lenian	bcf03ad4d1	[Feature-9467] add DAMENG DataSource (#12860 ) * [Feature-9467][DataSource] add DAMENG （达梦） data source * [Feature-9467] add DM datasource doc (Issue #9467) * [Feature-9467] add DM IDataBaseOptionKeys * [Feature-9467] add DM DataSource: DmDataSourceChannelFactoryTest remove testGetDmConnection method * [Feature-9467] modification package dm to dameng; * [Feature-9467] add Dameng DmJdbcDriver18 License * [Feature-9467] add DM DataSource: remove DruidDataSourceClient Co-authored-by: lenian <yuenian@mananacare.com>	2 years ago
Tq	f0dd4f081f	[Feature][task-plugins-12820] azure azure-sql datasource plugins (#13209 ) * submit azure sql code * change mssql-jdbc version * merge changes to delete other * merge changes to delete other * add dependencies	2 years ago
Yann Ann	6ef74073cc	[Improve-13001]migrate commons-collections -> commons-collections4 (#13002 )	2 years ago
insist777	b40c63f02d	[Feature][DataSource]Add trino datasource plugin (#12911 )	2 years ago
simsicon	43d69ae157	Upgrade clickhouse jdbc driver (#12639 )	2 years ago
seedscoder	1f23d29698	[Improvement-12029][dolphinscheduler-api] Upgrade the snakeyaml version to avoid vulnerabilities (#12726 )	2 years ago
Jay Chung	1347a8f94c	[chore] Separate Python API into another repository (#12779 ) Currently, our Python API code is a module in apache/dolphinscheduler codebase, each time users change Python API code, they need to run all requests CI check for dolphinscheduler and Python API, But if the user does only change Python code, it could be merged if Python API CI pass and do not dependent on others CI. Besides, we release Python API as the same version of dolphinscheduler. It is easy for user to match Python API version. But when Python API does not change any code, but dolphinscheduler release a bugfix version, Python API has to release the new version to match dolphinscheduler. This happened when we released Python API 2.0.6 and 2.0.7. 2.0.6 and 2.0.7 is bugfix version, and Python API does not change any code, so the PyPI package is the same. Separate Python API also makes our code more sense, we will have more distinguished code in dolphinscheduler and Python API new repository. Have separate issue tracker and changelog for information to users. ref PR in other repository: apache/dolphinscheduler-sdk-python#1 see more detail in mail thread: https://lists.apache.org/thread/4z7l5l54c4d81smjlk1n8nq380p9f0oo	2 years ago
JieguangZhou	a47b4d0672	[Feature][Task] Transfer files between tasks (#12552 ) * add data transfer between tasks * add delete DATA_TRANSFER API * convert Result to DeleteDataTransferResponse * add api UT * fix final * fix doc	2 years ago
Aaron Wang	08335b1032	[Improvement][Task] Improved way to collect yarn job's appIds (#12197 ) * Provide aop way as an optional way to collect yarn job's applicationId, and import new module `dolphinscheduler-aop` to place the aop code. * Add user property `appId.collect` for user to decide how to collect applicationId. * Add new environment configuration for each type of yarn tasks to support aop in `dolphinscheduler_env.sh` * Update docs to declare how to use aop way. * Update `LogUtils` to support fetch applicationId in different ways based on the user property. Co-authored-by: gabrywu <gabrywu@apache.com>	2 years ago
fuchanghai	77e29b59b2	[Improvement] add springdoc-openapi-ui (#12379 ) Co-authored-by: fuchanghai <‘2875334588@qq.com’> Co-authored-by: Wenjun Ruan <wenjun@apache.org>	2 years ago
Tq	c7435a51ac	[Feature][task-plugins] aws datasync task plugins (#11865 ) * submit datasync task * add aws software package license	2 years ago
caishunfeng	40090d459e	[Improvement] remove log-server and server module (#12206 ) * remove log-server module * remove dolphinscheduler-server module	2 years ago
JieguangZhou	308f632fcc	[Feature][TASK-PLUGIN] AWS Database Migration Service (DMS) (#11868 ) * add aws dms	2 years ago
Tq	cf5a8894e2	[BUG][BE-12113]fix htrace dependency conflicts (#12126 ) * fix htrace dependency conflicts * replace htrace-core with hbase-noop-htrace	2 years ago
Eric Gao	66958b91d7	[Feature][Resource Center] Add support for Alibaba Cloud OSS as storage of resource center (#11708 ) * Add support for Alibaba Cloud OSS as storage of resource center * Add dependency licenses * Refactor code, add unit tests and related docs	2 years ago
songjianet	8cddb10773	[Feat][UI] Update package. (#12046 ) * [Feat][UI] Update package. * [Feat][UI] Update package.	2 years ago
kezhenxu94	147e0ae8d7	Remove duplicate Spring version management (#11899 )	2 years ago
kezhenxu94	105773f54d	Remove htrace dependencies (#11881 ) * Remove htrace dependencies * Update pom.xml	2 years ago
Kengo Seki	3664d85143	[Improve] Upgrade Hadoop to 3.2.4 (#11832 )	2 years ago
kezhenxu94	efedc9a53c	Bump up dependencies to fix cves (#11765 )	2 years ago
wjf	2eb8b9f7f0	[Feature][Registry] Support etcd as registry (#10981 )	2 years ago
fuchanghai	554562bfa9	[fix-#11691] Add lz4-java in clickhouse datasource. (#11697 )	2 years ago
kezhenxu94	277f137358	Add Kubernetes configmap reload to all components (#11730 )	2 years ago
kezhenxu94	13e4720aa2	Upgrade spring boot and swagger (#11574 )	2 years ago
kezhenxu94	f6ef628030	Support reading application properties from kubernetes config map (#11402 )	2 years ago
Devosend	91a944f967	fix nodeSize is not a function bug (#11200 )	2 years ago
Wenjun Ruan	c7789bf049	Add base loop task execotor and http template parser (#11137 ) * Add base loop task execotor and http template parser * Add JsonPathUtils	2 years ago
JieguangZhou	af7b359333	[Feature][Task Plugin] Add SageMaker Pipeline task plugin for MLOps scenario (#10826 ) (#10935 ) * add sagemaker pipeline task plugin [DOC] add Sagemaker task plugin document change license and fix dependencies * [fix] Optimize the code * Update dolphinscheduler-task-plugin/dolphinscheduler-task-sagemaker/src/main/java/org/apache/dolphinscheduler/plugin/task/sagemaker/SagemakerParameters.java Optimization parameter judgment Co-authored-by: caishunfeng <caishunfeng2021@gmail.com> * [fix] nips Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>	2 years ago
Chris Ho	0cf31232de	[Feature][dependencies] Bump spring-core from 5.3.12 to 5.3.19 (#10857 )	2 years ago
songjianet	41698011b3	[Docs] Updated license. (#10838 )	2 years ago
songjianet	36bba3fcdf	[Docs] Upgrade license. (#10365 )	3 years ago
PJ Fanning	d044e0479d	issue-10356: upgrade logback to fix cve (#10357 )	3 years ago
PJ Fanning	b6350280e6	issues-10354: upgrade commons-io to fix CVE (#10355 )	3 years ago
kezhenxu94	d80cf21456	Clean up unused dependencies and packaging issues (#9944 )	3 years ago
songjianet	cbf0010b83	[Docs] Upgrade license. (#9967 )	3 years ago
songjianet	7a7807e520	[Feature] Remove old ui. (#9909 ) * [Feature] Remove old ui. * [Docs] Add license file for screenfull.	3 years ago
songjianet	083050a107	[Docs][UI Next][V1.0.0-Beta] Add @types-lodash license. (#9883 )	3 years ago
Kerwin	4f2b9ac886	[Improve][common] code clean in the common module (#9435 )	3 years ago
Tq	14144e8d2e	[Bug][dep] Bump httpclient version to 4.5.13 (#9631 )	3 years ago
PJ Fanning	f45fe85703	upgrade commons-compress to 1.21 (#9540 )	3 years ago
PJ Fanning	7fecb92fc2	use secure version of postgresql (#9573 ) * use secure version of postgresql * Update known-dependencies.txt	3 years ago
songjianet	3ea942dbf8	[Docs] Add license file for screenfull. (#9581 )	3 years ago
Eric Gao	a5bbf7852d	[Feature][Task-Plugin]Add zeppelin task-plugin to support Apache Zeppelin (#9327 )	3 years ago
Kerwin	4221ee2433	Add python module dependency in the dist module (#9506 )	3 years ago
Jiajie Zhong	3d78859fe5	[python] Recover python release properties (#9444 ) This patch recovers the properties `python.sign.skip=false` when the combined profile `release,python` is used. also close: #9433	3 years ago
Eric Gao	fd6b43bc81	[Dev] Switch version in pom.xml to dev-SNAPSHOT (#9223 ) (#9299 )	3 years ago
Jiajie Zhong	3457cee960	[python] Migrate pythonGatewayServer into api server (#9372 ) Currently the size of our distribute package is up to 800MB, this patch is migrate python gateway server into api server The distribute package size before and after this patch is: ```sh # before 796M apache-dolphinscheduler-2.0.4-SNAPSHOT-bin.tar.gz # after 647M apache-dolphinscheduler-2.0.4-SNAPSHOT-bin.tar.gz ```	3 years ago

1 2 3 4

188 Commits (273a5e78eb7056ee0159e1bd30a9675bb0026a21)