分布式调度框架。
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
 
xiangzihao 23d6437d3b
[Chore] Fix flaky e2e test (#16246)
4 months ago
.github [Chore] Fix flaky e2e test (#16246) 4 months ago
.idea [Chore] Add issue link tempate for IDEA (#16158) 5 months ago
.mvn/wrapper [Improve][CI]Upgrade maven-wrapper to 3.1.0 (#8557) 3 years ago
deploy [Improvement][Helm] Make configmap of api/master/worker/alert configuration (#16058) 4 months ago
docs [DSIP-51][Task] Remove unused pigeon task plugin (#16219) 4 months ago
dolphinscheduler-alert Increase zk connect timeout (#16180) 4 months ago
dolphinscheduler-api Remove unused dependentResult in TaskInstance (#16236) 4 months ago
dolphinscheduler-api-test [Chore] [CI] Add api-test and e2e-test to spotless check (#16242) 4 months ago
dolphinscheduler-authentication [DSIP-42] Add dolphinscheduler-aws-authentication module (#16043) 5 months ago
dolphinscheduler-bom [DSIP-51][Task] Remove unused pigeon task plugin (#16219) 4 months ago
dolphinscheduler-common [DSIP-51][Task] Remove unused pigeon task plugin (#16219) 4 months ago
dolphinscheduler-dao Remove unused dependentResult in TaskInstance (#16236) 4 months ago
dolphinscheduler-dao-plugin [DSIP-28] Donnot scan whole bean under classpath (#15874) 7 months ago
dolphinscheduler-data-quality Add IntegretionTest for registry module (#15981) 6 months ago
dolphinscheduler-datasource-plugin [DSIP-45] Polish the Storage SPI (#16141) 5 months ago
dolphinscheduler-dist [Feature-16229] Add python using file e2e test case (#16240) 4 months ago
dolphinscheduler-e2e [Chore] Fix flaky e2e test (#16246) 4 months ago
dolphinscheduler-extract [Fix] Fix typo: tpc -> tcp (#16160) 5 months ago
dolphinscheduler-master Fix worker overload will casue task failed (#16221) 4 months ago
dolphinscheduler-meter [DSIP-28] Donnot scan whole bean under classpath (#15874) 7 months ago
dolphinscheduler-microbench Optimizing the scope of RPC base classes (#15946) 6 months ago
dolphinscheduler-registry Fix JDBCRegistry refresh lock error (#16252) 4 months ago
dolphinscheduler-scheduler-plugin Fix task cannot use workflow's environment (#16199) 4 months ago
dolphinscheduler-service [DSIP-50][UDF Manage] Remove unused udf manage function (#16212) 4 months ago
dolphinscheduler-spi [Fix-16224] Add Shell using file E2E case (#16220) 4 months ago
dolphinscheduler-standalone-server [Feature-16229] Add python using file e2e test case (#16240) 4 months ago
dolphinscheduler-storage-plugin [DSIP-51][Task] Remove unused pigeon task plugin (#16219) 4 months ago
dolphinscheduler-task-plugin [Fix-16211] Remove ExecutePath in buildJarCommand to fix Java Task in Jar Mode (#16238) 4 months ago
dolphinscheduler-tools [DSIP-50][UDF Manage] Remove unused udf manage function (#16212) 4 months ago
dolphinscheduler-ui [Feature-16229] Add python using file e2e test case (#16240) 4 months ago
dolphinscheduler-worker [DSIP-46] Unify the logic task params data structure between front-end and back-end (#16193) 4 months ago
dolphinscheduler-yarn-aop Rename dolphinscheduler-aop to dolphinscheduler-yarn-aop (#16095) 5 months ago
images [Doc] fix CNCF logo (#15634) 8 months ago
licenses [Fix][Common] rewrite code generate,fix bit shift (#6914) 3 years ago
script [Fix-16174] Incorrect cluster installation guide. (#16208) 4 months ago
style [feat][ci] Add pre-commit for easy spotless config (#12192) 2 years ago
tools [DSIP-51][Task] Remove unused pigeon task plugin (#16219) 4 months ago
.asf.yaml [Chore] Add mergeable check (#16217) 4 months ago
.dlc.json [Feature][DataSource] add oceanbase datasource (#13675) 2 years ago
.flake8 [release] version 3.0.3 (#13131) 2 years ago
.gitattributes Create .gitattributes 6 years ago
.gitignore [Chore] Add issue link tempate for IDEA (#16158) 5 months ago
.gitmodules [Feature-16229] Add python using file e2e test case (#16240) 4 months ago
.licenserc.yaml [Chore] Add issue link tempate for IDEA (#16158) 5 months ago
.pre-commit-config.yaml [chore] Separate Python API into another repository (#12779) 2 years ago
CONTRIBUTING.md doc: Change readme and standalone docker quick start (#14002) 2 years ago
LICENSE [Improve][CI]Upgrade maven-wrapper to 3.1.0 (#8557) 3 years ago
NOTICE [NOTICE]Update the NOTICE year (#14272) 1 year ago
README.md [Doc] fix CNCF logo (#15634) 8 months ago
README_zh_CN.md [Doc] fix CNCF logo (#15634) 8 months ago
doap.rdf Add doap.rdf (#14883) 1 year ago
lombok.config add lombok config (#11212) 2 years ago
mvnw [Improve][CI]Upgrade maven-wrapper to 3.1.0 (#8557) 3 years ago
mvnw.cmd [Improve][CI]Upgrade maven-wrapper to 3.1.0 (#8557) 3 years ago
pom.xml [Chore] [CI] Add api-test and e2e-test to spotless check (#16242) 4 months ago

README.md

Apache Dolphinscheduler

License codecov Quality Gate Status Twitter Follow Slack Status CN doc

About

Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code. It is also provided powerful user interface, dedicated to solving complex task dependencies in the data pipeline and providing various types of jobs available out of the box

The key features for DolphinScheduler are as follows:

  • Easy to deploy, provide four ways to deploy which including Standalone, Cluster, Docker and Kubernetes.
  • Easy to use, workflow can be created and managed by four ways, which including Web UI, Python SDK, Yaml file and Open API
  • Highly reliable and high availability, decentralized architecture with multi-master and multi-worker, native supports horizontal scaling.
  • High performance, its performance is N times faster than other orchestration platform and it can support tens of millions of tasks per day
  • Cloud Native, DolphinScheduler supports orchestrating multi-cloud/data center workflow, and supports custom task type
  • Versioning both workflow and workflow instance(including tasks)
  • Various state control of workflow and task, support pause/stop/recover them in any time
  • Multi-tenancy support
  • Others like backfill support(Web UI native), permission control including project, resource and data source

QuickStart

User Interface Screenshots

  • Homepage: Project and workflow overview, including the latest workflow instance and task instance status statistics. home

  • Workflow Definition: Create and manage workflow by drag and drop, easy to build and maintain complex workflow, support bulk of tasks out of box. workflow-definition

  • Workflow Tree View: Abstract tree structure could clearer understanding of the relationship between tasks workflow-tree

  • Data source: Manage support multiple external data sources, provide unified data access capabilities for such as MySQL, PostgreSQL, Hive, Trino, etc. data-source

  • Monitor: View the status of the master, worker and database in real time, including server resource usage and load, do quick health check without logging in to the server. monitor

Suggestions & Bug Reports

Follow this guide to report your suggestions or bugs.

Contributing

The community welcomes everyone to contribute, please refer to this page to find out more: How to contribute, find the good first issue in here if you are new to DolphinScheduler.

Community

Welcome to join the Apache DolphinScheduler community by:

Landscapes



cncf-landscape  cncf-logo

DolphinScheduler enriches the CNCF CLOUD NATIVE Landscape.