DolphinScheduler

Commit Graph

Author	SHA1	Message	Date
gaoyan	82b501aa8e	[Feature-16269][dinky-task]Supports dinky tasks to accept Prepare Params passed within a task or from a previous task (#15947 ) * fix dinky unresolve params * Supplement the Dinky documentation	4 months ago
Orange Summer	688f84452d	[Feature-14678][Master][UI]Dependent task parameter passing (#14702 ) * feat: dependent task parameter passing * style: code format * refactor: remove inappropriate log * refactor: Modify unreasonable code structure * refactor: Modify unreasonable code structure * refactor: Solve conflicts caused by merge --------- Co-authored-by: Rick Cheng <rickchengx@gmail.com> Co-authored-by: BaoLiang <29528966+lenboo@users.noreply.github.com>	1 year ago
sgw	76bbcbeb30	[Improvement][Master] Split the task dependency mode of the dependent node into workflow dependent and task dependent (#14824 ) * [Improvement][Master] Split the task dependency mode of the dependent node into workflow dependent and task dependent. (#11970) * [Improvement][Master] Split the task dependency mode of the dependent node into workflow dependent and task dependent. (#11970) - delete useless output * [Improvement][Master] Split the task dependency mode of the dependent node into workflow dependent and task dependent. (#11970) - add log - run spotless check --------- Co-authored-by: 旺阳 <qingwli@cisco.com> Co-authored-by: JinYong Li <42576980+JinyLeeChina@users.noreply.github.com>	1 year ago
JieguangZhou	e7cdc7c136	[Feature][Task Plugin] Add Dynamic task to generate dynamic worklfows with list parameters (#14127 ) * add dynamic task plugin * fix ui * update code * add DOC * ADD UT * fix doc * fix sanity check * add upgrade ddl * fix sql	1 year ago
aiwenmo	76f33bea2b	[doc] Change DinkyTask picture to english (#14061 )	2 years ago
JieguangZhou	273a5e78eb	[FEATURE][Task Plugin]Add remote-shell task plugin (#13801 )	2 years ago
Tq	78ba71bdbd	[Feature][task]add azure datafactory task type (#13417 ) * init data factory * add task-type-config.yaml * add data factory ui * submit doc * submit license --------- Co-authored-by: devosend <devosend@gmail.com>	2 years ago
Assert	2dbc79693e	[feature][task plugin] Add new task plugin for apache linkis (#12693 )	2 years ago
baihongbin	0373e06615	[Feature-8030][docs] Add sqoop task doc (#12855 ) * [Feature-8030][docs] Add sqoop task doc * Update docs/docs/zh/guide/task/sqoop.md Co-authored-by: Eric Gao <ericgao.apache@gmail.com> * Update docs/docs/en/guide/task/sqoop.md Co-authored-by: Eric Gao <ericgao.apache@gmail.com> * [Feature-8030][docs] Add sqoop task doc Co-authored-by: Eric Gao <ericgao.apache@gmail.com>	2 years ago
JieguangZhou	229c554912	[feature][task] Add Kubeflow task plugin for MLOps scenario (#12843 )	2 years ago
Tq	9bba4b105c	[fix][doc] Fix sql-hive and hive-cli doc (#12765 )	2 years ago
Tq	c7435a51ac	[Feature][task-plugins] aws datasync task plugins (#11865 ) * submit datasync task * add aws software package license	2 years ago
JieguangZhou	308f632fcc	[Feature][TASK-PLUGIN] AWS Database Migration Service (DMS) (#11868 ) * add aws dms	2 years ago
JieguangZhou	cf522e2fc0	[improve] Optimize MLFlow task plugin for easy of use (#12071 ) optimize code	2 years ago
juzimao	5d9331f4ee	[Feature-10683][Task Plugin] Add Java Task Plugin. (#10689 )	2 years ago
Eric Gao	4a37345436	[Feature][Task Plugin] Support hive cli task plugin (#11651 ) * Add hive cli task plugin * Add docs for hive-cli task plugin * Fix hive-cli task related front-end nits and checkstyle * Fix exception handling logic	2 years ago
JieguangZhou	a974ba74ab	[Feature] New task plugin Pytorch (#11498 ) Co-authored-by: Eric Gao <ericgao.apache@gmail.com>	2 years ago
xuhhui	513f336015	[Feature] Add new task type chunjun (#10937 )	2 years ago
JieguangZhou	af7b359333	[Feature][Task Plugin] Add SageMaker Pipeline task plugin for MLOps scenario (#10826 ) (#10935 ) * add sagemaker pipeline task plugin [DOC] add Sagemaker task plugin document change license and fix dependencies * [fix] Optimize the code * Update dolphinscheduler-task-plugin/dolphinscheduler-task-sagemaker/src/main/java/org/apache/dolphinscheduler/plugin/task/sagemaker/SagemakerParameters.java Optimization parameter judgment Co-authored-by: caishunfeng <caishunfeng2021@gmail.com> * [fix] nips Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>	2 years ago
ZhaoGuodong	8eaf5a2309	[Feature-10219][EMR] EMR supports use <add-Steps> to add steps to an existing cluster (#10657 ) * Add the ProgramType parameter to distinguish task types * EmrAddStepsTask supports Add-Steps * UI supports Add-Steps * EmrTask modify the name of the class to EmrJobFlowTask * add ERM Task abstract base class AbstractEmrTask * add testcase for EmrAddStepsTask * Modifying help Documents	2 years ago
Kerwin	bd1be6cf36	[Task] Added Apache SeaTunnel 2.x task node (#10480 )	2 years ago
aiwenmo	5b0347e8da	[Task] Add Dinky task to better support the development and execution of FlinkSQL (#10640 )	2 years ago
Stalary	a45fc5b032	[doc] Add doc for pre-sql and post-sql (#10685 )	2 years ago
JieguangZhou	36e20cdfc8	[Feature][Task Plugin] Add DVC task plugin for MLops scenario (#10372 ) (#10407 )	2 years ago
JieguangZhou	3258438f6e	[Feature] [MLOps] support mlflow deploy with docker compose (#10217 ) * [Feature] [MLOps] support mlflow deploy with docker compose fix doc Update docs/docs/en/guide/task/mlflow.md fix doc Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com> revert cancel modification fix ENV name and docker compose command * fix doc image link * fix testModelsDeployDockerCompose * add docker compose container health check and fix mlflow bug * update docker compose healthcheck timeout	2 years ago
chuxing	7e39e0d48d	[doc] Add switch task demo (#10247 ) Co-authored-by: QuakeWang <45645138+QuakeWang@users.noreply.github.com>	2 years ago
HuangWei	c5961aed25	[feat][task] Add OpenMLDB task plugin (#10198 )	2 years ago
JieguangZhou	54ab2651bd	[Feature][MLops] Add MLflow Projects (custom project) component (#10175 ) * Add MLflow Projects (custom project) component * fix something * update document * update document * Supplementary test cases	2 years ago
JieguangZhou	e11373b963	[Feature][MLops] Support MLflow Models to deploy model service (MLflow models serve and Docker) (#10150 ) * Add backend of MLflow Moldes component * Add front end of MLflow Moldes component * [DOC] update mlflow document * revert unnecessary * fix doc image url * Update docs/docs/en/guide/task/mlflow.md Discard the lr abbreviation Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com> Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>	2 years ago
JieguangZhou	9ab3bebc90	[Feature][Task Plugin] Add mlflow task plugin for MLops scenario. (#10036 ) * [Feature][Task Plugin] Add mlflow task plugin (#9725) * [Feature][Task Plugin] Add mlflow task plugin UI (#9725) * [Feature][Task Plugin] fix license header (#9725) * [Feature][Task Plugin] fix license header (#9725) * [Feature][Task Plugin] revert unnecessary * [Feature][Task Plugin] add auto ml to mlflow task plugin * [DOC] add mlflow document * [DOC] fix mlflow docs imgs * [DOC] fix dead link localhost:5000 * [DOC] fix dead link localhost:5000 * [DOC] remove dead link localhost:5000 * Update docs/docs/en/guide/task/mlflow.md * Update docs/docs/zh/guide/task/mlflow.md * [DOC] format ui code * [DOC] remove dead link localhost:5000 * [Feature][Task Plugin] revert unnecessary * fix some nits * Move the personal repository to the public repository. * Run the command directly instead of saving the file * fix paramsMap initialize * revert unnecessary Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>	2 years ago
He Zhao	5bb1eb04fc	[Feature][plugin] Add k8s task in task plugin (#9425 ) * [Feature][plugin] Add k8s task in task plugin * [Feature][plugin] fix dos and code problems * [Feature][plugin] refactor some code based on sonar * [Feature][UI] front-end for k8s task plugin * [Feature][plugin] delete some front files * [Feature][plugin] update document * Update docs/docs/zh/guide/task/k8s.md * Update docs/docs/en/guide/task/k8s.md * Update docs/docs/en/guide/task/k8s.md * Update docs/docs/en/guide/task/k8s.md * [Feature][UI] front-end change from review comments * [Feature][UI] replace get namespace list api * [Feature][plugin] change file name * Add kubernetes to zh task list Co-authored-by: hezhao2 <hezhao2@cisco.com> Co-authored-by: William Tong <weitong@cisco.com> Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>	2 years ago
xiangzihao	225cb332d1	[Fix-10049] Conditions Task branch flow failed (#10077 )	2 years ago
Eric Gao	80369363c9	[feat][task plugin] Add Jupyter task plugin (#9872 ) Co-authored-by: Amy0104 <97265214+Amy0104@users.noreply.github.com>	3 years ago
QuakeWang	0fe75482a2	[doc] Add example and notice about task type Dependent (#10001 ) Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>	3 years ago
QuakeWang	12a4b01268	[Doc] Add example and notice about task type Conditions (#9945 )	3 years ago
Dannila	2d36449444	[Feature- 9837][plugin/ui] support FlinkSQL Task (#9840 ) * flink_sql * '[refactor]flinksql' * '[refactor]flinksql' * '[refactor]flinksql' * '[refactor]flinksql' * '[refactor]flinksql' * '[refactor]flinksql' * '[refactor]flinksql' * '[refactor]flinksql' * '[refactor]flinksql' * '[refactor]flinksql' * '[refactor]flinksql' * '[refactor]flinksql' * [refactor] flinksql * '[refactor]flinksql' * [refactor] dolphinscheduler flinksql * [refactor] flink sql * [refactor] flink sql * [refactor] flink sql * [refactor] flink sql * [refactor] flink sql * [refactor] flink sql * [refactor] flink sql * [refactor] flink sql * [refactor] flink sql * [refactor] flink sql * [refactor] flink sql * [refactor] flink sql * [refactor] flink sql * [refactor] flink sql * [refactor] flink sql * [refactor] flink sql * [refactor] flink sql * [refactor] flink sql * [refactor] flink sql * [refactor] flink sql * Update docs/docs/en/guide/task/flink.md * Update docs/docs/zh/guide/task/flink.md * prettier front-end code Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com> Co-authored-by: devosend <devosend@gmail.com>	3 years ago
QuakeWang	691e8ab538	[Feature][doc] Refactor and separate the Resource Center Document (#9658 ) Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>	3 years ago
Eric Gao	1f7884609a	[Feature][Doc] Add docs for zeppelin task plugin (#9866 )	3 years ago
sq-q	b1bb69c959	[Improve][docs] Add spark sql docs to task spark (#9851 )	3 years ago
zixi0825	337696e258	[Docs][DataQuality]: Add DataQuality Docs (#9512 ) Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>	3 years ago
Eric Gao	eb21b6cc52	[Feature][Doc] Switch shell task instruction screenshots to latest (#9434 )	3 years ago
Jiajie Zhong	9f84dbbda0	[doc] Migrate dev doc from website repository (#9291 ) * [doc] Migrate dev doc from website repository * Correct release language * Fix license issue * Add all images from website * Delete unused images * Add CI * Fix ci * fix ci * Remove no need file * Add latest commit from website * correct img_utils.py script * Remove unused imgs	3 years ago

42 Commits (aabda868daabe938e4894f1886d56def9401651c)