Tq
c7435a51ac
[Feature][task-plugins] aws datasync task plugins ( #11865 )
...
* submit datasync task
* add aws software package license
2 years ago
JieguangZhou
308f632fcc
[Feature][TASK-PLUGIN] AWS Database Migration Service (DMS) ( #11868 )
...
* add aws dms
2 years ago
Eric Gao
064224696f
[Doc][Improvement] Add instructions for process execution type and data complement ( #12121 )
...
* Add instructions for process execution type and data complement
* Fix and polish the docs
2 years ago
JieguangZhou
cf522e2fc0
[improve] Optimize MLFlow task plugin for easy of use ( #12071 )
...
optimize code
2 years ago
ZhaoGuodong
86291bb5e6
[Feature-10273][Datasource] Add dataSource for AWS Athena ( #11157 )
2 years ago
caishunfeng
0deafba12c
fix procedure task param pass ( #11919 )
2 years ago
juzimao
5d9331f4ee
[Feature-10683][Task Plugin] Add Java Task Plugin. ( #10689 )
2 years ago
xiangzihao
f0db90f71d
[Doc] Remove re-upload file function in the 3.0.0's doc ( #11804 )
2 years ago
Eric Gao
4a37345436
[Feature][Task Plugin] Support hive cli task plugin ( #11651 )
...
* Add hive cli task plugin
* Add docs for hive-cli task plugin
* Fix hive-cli task related front-end nits and checkstyle
* Fix exception handling logic
2 years ago
Eric Gao
ff4d2c9460
[Doc][Bug] Fix resource center docs for standalone mode ( #11600 )
...
* Fix resource center docs for standalone mode
* Remove useless images
2 years ago
monster
3e360a8ecb
[Improvement-11550] [Doc]Document content update ( #11577 )
...
* [Improvement-11550] [Doc]Document content update
* Update pictures
* fix
* Update Process word to Workflow
Co-authored-by: David <davidzollo365@gmail.com>
2 years ago
JieguangZhou
a974ba74ab
[Feature] New task plugin Pytorch ( #11498 )
...
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2 years ago
Qi Zhang
a4bdadbb84
[doc] Use Rainbond deployment DolphinScheduler Cluster ( #10951 )
...
* [doc] Use Rainbond deployment DolphinScheduler Cluster
Signed-off-by: Qi Zhang <smallqi1@163.com>
* Update docs/docs/en/guide/installation/rainbond.md
* Update docs/docs/en/guide/installation/rainbond.md
* Update docs/docs/zh/guide/installation/rainbond.md
* Update docs/docs/zh/guide/installation/rainbond.md
* [doc] modify rainbond doc and add image
Signed-off-by: Qi Zhang <smallqi1@163.com>
* fix: img link
Signed-off-by: Qi Zhang <smallqi1@163.com>
* fix: modify proposal
Signed-off-by: Qi Zhang <smallqi1@163.com>
* docs: move rainbond docs to integration
Signed-off-by: Qi Zhang <smallqi1@163.com>
Signed-off-by: Qi Zhang <smallqi1@163.com>
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2 years ago
caishunfeng
0464123c2b
[Feature-11223] support stream task ( #11350 )
...
* add task execute type
* update task definition list paging
* update task instance list paging
* stream task start
* [Feature][UI] Some changes to execute task.
* Set the connection edge to dashed line.
* Add FLINK_STREAM task.
* add stream task
* flink savepoint and cancel
* fix query bug
* add stream task definition
* add task instance for stream task
* delete stream task definition state
* update api for stream task definition edit
* modify search for stream task instance
* add language
* delete task type search for stream task definition
* change task type search for stream task instance
* add jump button
* add savepoint
* add down log for stream task instance
* ui test
* stream task start
* run DAG
* [Fix][UI] Fix the stream task edgs not to be dashed when filling back.
* [Feature][UI] Remove some fields for FLINK_STREAM.
* add start modal
* add dryRun column for stream task instance
* fix duration
* fix pon
* fix build error
* Add success tip
* add auto sync for stream task instance
* remove forgien key for task instance
* license header
* UT fix
* modify locales
* recover common config
* fix UT
* add doc
Co-authored-by: Amy <amywang0104@163.com>
Co-authored-by: devosend <devosend@gmail.com>
2 years ago
insist777
8ad6e10da5
[doc] Improve the document introduction of complement ( #11275 )
2 years ago
Eric Gao
3aa9f2ea25
[Bug][Doc] Fix typos in docs which causes links to upgrade section to fail ( #11333 )
...
* [Bug][Doc] Fix typo in docs
* Remove dead links and update related docs
2 years ago
Jiajie Zhong
bf5f7a88c5
[doc] migrate community and development docs into main repo ( #11313 )
2 years ago
xuhhui
513f336015
[Feature] Add new task type chunjun ( #10937 )
2 years ago
Tq
9859b5da1f
add Feishu alert doc and configure email alert doc to the docsdev.js ( #11173 )
...
add Feishu alert doc and configure email alert doc to the docsdev.js
2 years ago
JieguangZhou
af7b359333
[Feature][Task Plugin] Add SageMaker Pipeline task plugin for MLOps scenario ( #10826 ) ( #10935 )
...
* add sagemaker pipeline task plugin
[DOC] add Sagemaker task plugin document
change license and fix dependencies
* [fix] Optimize the code
* Update dolphinscheduler-task-plugin/dolphinscheduler-task-sagemaker/src/main/java/org/apache/dolphinscheduler/plugin/task/sagemaker/SagemakerParameters.java
Optimization parameter judgment
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
* [fix] nips
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2 years ago
Jiajie Zhong
08cfbc73e0
[doc] Add missing doc change by snehal ( #10892 )
2 years ago
ZhaoGuodong
8eaf5a2309
[Feature-10219][EMR] EMR supports use <add-Steps> to add steps to an existing cluster ( #10657 )
...
* Add the ProgramType parameter to distinguish task types
* EmrAddStepsTask supports Add-Steps
* UI supports Add-Steps
* EmrTask modify the name of the class to EmrJobFlowTask
* add ERM Task abstract base class AbstractEmrTask
* add testcase for EmrAddStepsTask
* Modifying help Documents
2 years ago
qianli2022
1e48bbc5c6
[Feature-10629][Improvement] Support multi cluster environments - namespace use cluster ( #10650 )
...
* server code
* namespace ui
* fix dao test
* fix test
* fix
* docs and image update
Co-authored-by: qianl4 <qianl4@cicso.com>
2 years ago
sneh-wha
fa1458b3e0
[doc] Modify features, hw, intro and homepage docs. ( #10713 )
2 years ago
Kerwin
bd1be6cf36
[Task] Added Apache SeaTunnel 2.x task node ( #10480 )
2 years ago
aiwenmo
5b0347e8da
[Task] Add Dinky task to better support the development and execution of FlinkSQL ( #10640 )
2 years ago
sneh-wha
423cc5b9be
[doc] Modified project doc. ( #10711 )
2 years ago
sneh-wha
7898f41dc0
[doc] Change datasource doc ( #10660 )
2 years ago
Stalary
a45fc5b032
[doc] Add doc for pre-sql and post-sql ( #10685 )
2 years ago
caishunfeng
c2f1886306
[doc] Update metadata and design doc ( #10600 )
2 years ago
Stalary
b2df357814
[doc] Add run the task alone doc. ( #10581 )
2 years ago
houshitao
1b1a567fec
[doc] Correct the complement add docs ( #10521 )
2 years ago
JieguangZhou
36e20cdfc8
[Feature][Task Plugin] Add DVC task plugin for MLops scenario ( #10372 ) ( #10407 )
2 years ago
liubo1990
b8d5e78994
[Doc] Add how to set the alarm mailbox in faq ( #10401 )
2 years ago
qianli2022
ff065d8e5b
[Feature][Improvement] Support multi cluster environments - k8s type ( #10096 )
...
* service code
* [Feature][UI] Add front-end for cluster manage
* fix e2e
* remove comment on cluster controller
* doc
* img
* setting e2e.yaml
* test
* rerun e2e
* fix bug from comment
* Update index.tsx
use Nspace instead of css.
* Update index.tsx
Remove the style.
* Delete index.module.scss
Remove the useless file.
Co-authored-by: qianl4 <qianl4@cicso.com>
Co-authored-by: William Tong <weitong@cisco.com>
Co-authored-by: Amy0104 <97265214+Amy0104@users.noreply.github.com>
2 years ago
JieguangZhou
3258438f6e
[Feature] [MLOps] support mlflow deploy with docker compose ( #10217 )
...
* [Feature] [MLOps] support mlflow deploy with docker compose
fix doc
Update docs/docs/en/guide/task/mlflow.md
fix doc
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
revert cancel modification
fix ENV name and docker compose command
* fix doc image link
* fix testModelsDeployDockerCompose
* add docker compose container health check and fix mlflow bug
* update docker compose healthcheck timeout
2 years ago
Wenjun Ruan
e21d7b1551
[Feature][metrics] Add master, worker metrics ( #10326 )
...
* Add mater metrics
* fix UT
* Add url to mysql profile
* Add worker metrics
* Update grafana config
* Add system metrics doc
* Add process failover counter
* Add metrics image
* Change jpg to png
* Add command insert metrics
* Fix UT
* Revert UT
3 years ago
chuxing
7e39e0d48d
[doc] Add switch task demo ( #10247 )
...
Co-authored-by: QuakeWang <45645138+QuakeWang@users.noreply.github.com>
3 years ago
HuangWei
c5961aed25
[feat][task] Add OpenMLDB task plugin ( #10198 )
3 years ago
QuakeWang
cd36401a6a
[doc] Refactor context parameter docment ( #10227 )
3 years ago
QuakeWang
58b1e1da1e
[doc] Upgrade screenshot to latest version in dev document ( #10242 )
...
* fix issue-9898
* delete no use pictures
3 years ago
Jiajie Zhong
6d9bc0743b
[doc] Add setValue syntax in local param ( #10245 )
...
ref: #9576
same as: #9671
3 years ago
QuakeWang
5998c73aac
[doc] Refactor local parameter docment ( #10119 )
3 years ago
Jiajie Zhong
f4b7754952
[doc] Update task DataX document ( #10218 )
3 years ago
JieguangZhou
54ab2651bd
[Feature][MLops] Add MLflow Projects (custom project) component ( #10175 )
...
* Add MLflow Projects (custom project) component
* fix something
* update document
* update document
* Supplementary test cases
3 years ago
QuakeWang
0abfb5e744
[doc] Refactor global parameter docment ( #10045 )
3 years ago
JieguangZhou
e11373b963
[Feature][MLops] Support MLflow Models to deploy model service (MLflow models serve and Docker) ( #10150 )
...
* Add backend of MLflow Moldes component
* Add front end of MLflow Moldes component
* [DOC] update mlflow document
* revert unnecessary
* fix doc image url
* Update docs/docs/en/guide/task/mlflow.md
Discard the lr abbreviation
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
3 years ago
Mr.An
7d5af7e7ec
[doc] Update editorial workflow content and images ( #10130 )
3 years ago
Jiajie Zhong
94c515555e
[doc] Remove flink call docs ( #10122 )
...
Flink call docs is only teld users
how to use flink task in dolphinscheduler
and it should be including in task/flink
3 years ago
Mr.An
73f13a9c9c
[doc] Show all the functions of the home page through screenshots ( #10118 )
3 years ago