Eric Gao
4a37345436
[Feature][Task Plugin] Support hive cli task plugin ( #11651 )
...
* Add hive cli task plugin
* Add docs for hive-cli task plugin
* Fix hive-cli task related front-end nits and checkstyle
* Fix exception handling logic
2 years ago
Eric Gao
ff4d2c9460
[Doc][Bug] Fix resource center docs for standalone mode ( #11600 )
...
* Fix resource center docs for standalone mode
* Remove useless images
2 years ago
monster
3e360a8ecb
[Improvement-11550] [Doc]Document content update ( #11577 )
...
* [Improvement-11550] [Doc]Document content update
* Update pictures
* fix
* Update Process word to Workflow
Co-authored-by: David <davidzollo365@gmail.com>
2 years ago
JieguangZhou
a974ba74ab
[Feature] New task plugin Pytorch ( #11498 )
...
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2 years ago
Qi Zhang
a4bdadbb84
[doc] Use Rainbond deployment DolphinScheduler Cluster ( #10951 )
...
* [doc] Use Rainbond deployment DolphinScheduler Cluster
Signed-off-by: Qi Zhang <smallqi1@163.com>
* Update docs/docs/en/guide/installation/rainbond.md
* Update docs/docs/en/guide/installation/rainbond.md
* Update docs/docs/zh/guide/installation/rainbond.md
* Update docs/docs/zh/guide/installation/rainbond.md
* [doc] modify rainbond doc and add image
Signed-off-by: Qi Zhang <smallqi1@163.com>
* fix: img link
Signed-off-by: Qi Zhang <smallqi1@163.com>
* fix: modify proposal
Signed-off-by: Qi Zhang <smallqi1@163.com>
* docs: move rainbond docs to integration
Signed-off-by: Qi Zhang <smallqi1@163.com>
Signed-off-by: Qi Zhang <smallqi1@163.com>
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2 years ago
caishunfeng
0464123c2b
[Feature-11223] support stream task ( #11350 )
...
* add task execute type
* update task definition list paging
* update task instance list paging
* stream task start
* [Feature][UI] Some changes to execute task.
* Set the connection edge to dashed line.
* Add FLINK_STREAM task.
* add stream task
* flink savepoint and cancel
* fix query bug
* add stream task definition
* add task instance for stream task
* delete stream task definition state
* update api for stream task definition edit
* modify search for stream task instance
* add language
* delete task type search for stream task definition
* change task type search for stream task instance
* add jump button
* add savepoint
* add down log for stream task instance
* ui test
* stream task start
* run DAG
* [Fix][UI] Fix the stream task edgs not to be dashed when filling back.
* [Feature][UI] Remove some fields for FLINK_STREAM.
* add start modal
* add dryRun column for stream task instance
* fix duration
* fix pon
* fix build error
* Add success tip
* add auto sync for stream task instance
* remove forgien key for task instance
* license header
* UT fix
* modify locales
* recover common config
* fix UT
* add doc
Co-authored-by: Amy <amywang0104@163.com>
Co-authored-by: devosend <devosend@gmail.com>
2 years ago
insist777
8ad6e10da5
[doc] Improve the document introduction of complement ( #11275 )
2 years ago
Eric Gao
3aa9f2ea25
[Bug][Doc] Fix typos in docs which causes links to upgrade section to fail ( #11333 )
...
* [Bug][Doc] Fix typo in docs
* Remove dead links and update related docs
2 years ago
Jiajie Zhong
bf5f7a88c5
[doc] migrate community and development docs into main repo ( #11313 )
2 years ago
xuhhui
513f336015
[Feature] Add new task type chunjun ( #10937 )
2 years ago
Tq
9859b5da1f
add Feishu alert doc and configure email alert doc to the docsdev.js ( #11173 )
...
add Feishu alert doc and configure email alert doc to the docsdev.js
2 years ago
JieguangZhou
af7b359333
[Feature][Task Plugin] Add SageMaker Pipeline task plugin for MLOps scenario ( #10826 ) ( #10935 )
...
* add sagemaker pipeline task plugin
[DOC] add Sagemaker task plugin document
change license and fix dependencies
* [fix] Optimize the code
* Update dolphinscheduler-task-plugin/dolphinscheduler-task-sagemaker/src/main/java/org/apache/dolphinscheduler/plugin/task/sagemaker/SagemakerParameters.java
Optimization parameter judgment
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
* [fix] nips
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2 years ago
Jiajie Zhong
08cfbc73e0
[doc] Add missing doc change by snehal ( #10892 )
2 years ago
ZhaoGuodong
8eaf5a2309
[Feature-10219][EMR] EMR supports use <add-Steps> to add steps to an existing cluster ( #10657 )
...
* Add the ProgramType parameter to distinguish task types
* EmrAddStepsTask supports Add-Steps
* UI supports Add-Steps
* EmrTask modify the name of the class to EmrJobFlowTask
* add ERM Task abstract base class AbstractEmrTask
* add testcase for EmrAddStepsTask
* Modifying help Documents
2 years ago
qianli2022
1e48bbc5c6
[Feature-10629][Improvement] Support multi cluster environments - namespace use cluster ( #10650 )
...
* server code
* namespace ui
* fix dao test
* fix test
* fix
* docs and image update
Co-authored-by: qianl4 <qianl4@cicso.com>
2 years ago
sneh-wha
fa1458b3e0
[doc] Modify features, hw, intro and homepage docs. ( #10713 )
2 years ago
Kerwin
bd1be6cf36
[Task] Added Apache SeaTunnel 2.x task node ( #10480 )
2 years ago
aiwenmo
5b0347e8da
[Task] Add Dinky task to better support the development and execution of FlinkSQL ( #10640 )
2 years ago
sneh-wha
423cc5b9be
[doc] Modified project doc. ( #10711 )
2 years ago
sneh-wha
7898f41dc0
[doc] Change datasource doc ( #10660 )
2 years ago
Stalary
a45fc5b032
[doc] Add doc for pre-sql and post-sql ( #10685 )
2 years ago
caishunfeng
c2f1886306
[doc] Update metadata and design doc ( #10600 )
2 years ago
Stalary
b2df357814
[doc] Add run the task alone doc. ( #10581 )
2 years ago
houshitao
1b1a567fec
[doc] Correct the complement add docs ( #10521 )
2 years ago
JieguangZhou
36e20cdfc8
[Feature][Task Plugin] Add DVC task plugin for MLops scenario ( #10372 ) ( #10407 )
2 years ago
liubo1990
b8d5e78994
[Doc] Add how to set the alarm mailbox in faq ( #10401 )
2 years ago
qianli2022
ff065d8e5b
[Feature][Improvement] Support multi cluster environments - k8s type ( #10096 )
...
* service code
* [Feature][UI] Add front-end for cluster manage
* fix e2e
* remove comment on cluster controller
* doc
* img
* setting e2e.yaml
* test
* rerun e2e
* fix bug from comment
* Update index.tsx
use Nspace instead of css.
* Update index.tsx
Remove the style.
* Delete index.module.scss
Remove the useless file.
Co-authored-by: qianl4 <qianl4@cicso.com>
Co-authored-by: William Tong <weitong@cisco.com>
Co-authored-by: Amy0104 <97265214+Amy0104@users.noreply.github.com>
2 years ago
JieguangZhou
3258438f6e
[Feature] [MLOps] support mlflow deploy with docker compose ( #10217 )
...
* [Feature] [MLOps] support mlflow deploy with docker compose
fix doc
Update docs/docs/en/guide/task/mlflow.md
fix doc
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
revert cancel modification
fix ENV name and docker compose command
* fix doc image link
* fix testModelsDeployDockerCompose
* add docker compose container health check and fix mlflow bug
* update docker compose healthcheck timeout
2 years ago
Wenjun Ruan
e21d7b1551
[Feature][metrics] Add master, worker metrics ( #10326 )
...
* Add mater metrics
* fix UT
* Add url to mysql profile
* Add worker metrics
* Update grafana config
* Add system metrics doc
* Add process failover counter
* Add metrics image
* Change jpg to png
* Add command insert metrics
* Fix UT
* Revert UT
2 years ago
chuxing
7e39e0d48d
[doc] Add switch task demo ( #10247 )
...
Co-authored-by: QuakeWang <45645138+QuakeWang@users.noreply.github.com>
2 years ago
HuangWei
c5961aed25
[feat][task] Add OpenMLDB task plugin ( #10198 )
3 years ago
QuakeWang
cd36401a6a
[doc] Refactor context parameter docment ( #10227 )
3 years ago
QuakeWang
58b1e1da1e
[doc] Upgrade screenshot to latest version in dev document ( #10242 )
...
* fix issue-9898
* delete no use pictures
3 years ago
Jiajie Zhong
6d9bc0743b
[doc] Add setValue syntax in local param ( #10245 )
...
ref: #9576
same as: #9671
3 years ago
QuakeWang
5998c73aac
[doc] Refactor local parameter docment ( #10119 )
3 years ago
Jiajie Zhong
f4b7754952
[doc] Update task DataX document ( #10218 )
3 years ago
JieguangZhou
54ab2651bd
[Feature][MLops] Add MLflow Projects (custom project) component ( #10175 )
...
* Add MLflow Projects (custom project) component
* fix something
* update document
* update document
* Supplementary test cases
3 years ago
QuakeWang
0abfb5e744
[doc] Refactor global parameter docment ( #10045 )
3 years ago
JieguangZhou
e11373b963
[Feature][MLops] Support MLflow Models to deploy model service (MLflow models serve and Docker) ( #10150 )
...
* Add backend of MLflow Moldes component
* Add front end of MLflow Moldes component
* [DOC] update mlflow document
* revert unnecessary
* fix doc image url
* Update docs/docs/en/guide/task/mlflow.md
Discard the lr abbreviation
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
3 years ago
Mr.An
7d5af7e7ec
[doc] Update editorial workflow content and images ( #10130 )
3 years ago
Jiajie Zhong
94c515555e
[doc] Remove flink call docs ( #10122 )
...
Flink call docs is only teld users
how to use flink task in dolphinscheduler
and it should be including in task/flink
3 years ago
Mr.An
73f13a9c9c
[doc] Show all the functions of the home page through screenshots ( #10118 )
3 years ago
QuakeWang
243ee8ba70
[Bug][doc] Fix the open-api docs request error ( #10100 )
3 years ago
JieguangZhou
9ab3bebc90
[Feature][Task Plugin] Add mlflow task plugin for MLops scenario. ( #10036 )
...
* [Feature][Task Plugin] Add mlflow task plugin (#9725 )
* [Feature][Task Plugin] Add mlflow task plugin UI (#9725 )
* [Feature][Task Plugin] fix license header (#9725 )
* [Feature][Task Plugin] fix license header (#9725 )
* [Feature][Task Plugin] revert unnecessary
* [Feature][Task Plugin] add auto ml to mlflow task plugin
* [DOC] add mlflow document
* [DOC] fix mlflow docs imgs
* [DOC] fix dead link localhost:5000
* [DOC] fix dead link localhost:5000
* [DOC] remove dead link localhost:5000
* Update docs/docs/en/guide/task/mlflow.md
* Update docs/docs/zh/guide/task/mlflow.md
* [DOC] format ui code
* [DOC] remove dead link localhost:5000
* [Feature][Task Plugin] revert unnecessary
* fix some nits
* Move the personal repository to the public repository.
* Run the command directly instead of saving the file
* fix paramsMap initialize
* revert unnecessary
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
3 years ago
He Zhao
5bb1eb04fc
[Feature][plugin] Add k8s task in task plugin ( #9425 )
...
* [Feature][plugin] Add k8s task in task plugin
* [Feature][plugin] fix dos and code problems
* [Feature][plugin] refactor some code based on sonar
* [Feature][UI] front-end for k8s task plugin
* [Feature][plugin] delete some front files
* [Feature][plugin] update document
* Update docs/docs/zh/guide/task/k8s.md
* Update docs/docs/en/guide/task/k8s.md
* Update docs/docs/en/guide/task/k8s.md
* Update docs/docs/en/guide/task/k8s.md
* [Feature][UI] front-end change from review comments
* [Feature][UI] replace get namespace list api
* [Feature][plugin] change file name
* Add kubernetes to zh task list
Co-authored-by: hezhao2 <hezhao2@cisco.com>
Co-authored-by: William Tong <weitong@cisco.com>
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
3 years ago
xiangzihao
225cb332d1
[Fix-10049] Conditions Task branch flow failed ( #10077 )
3 years ago
Eric Gao
80369363c9
[feat][task plugin] Add Jupyter task plugin ( #9872 )
...
Co-authored-by: Amy0104 <97265214+Amy0104@users.noreply.github.com>
3 years ago
QuakeWang
0fe75482a2
[doc] Add example and notice about task type Dependent ( #10001 )
...
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
3 years ago
qianli2022
bc1c15b142
[Feature-8252][doc] K8s and namespace manager docs and web page update ( #9881 )
...
* test
* test
* doc
* fix image error
* fix
* Update docs/docs/en/guide/security.md
* Update docs/docs/en/guide/security.md
* Update docs/docs/en/guide/security.md
* Update docs/docs/zh/guide/security.md
* fix doc
Co-authored-by: qianl4 <qianl4@cicso.com>
Co-authored-by: William Tong <weitong@cisco.com>
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
3 years ago
QuakeWang
12a4b01268
[Doc] Add example and notice about task type Conditions ( #9945 )
3 years ago