分布式调度框架。
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
 
Wenjun Ruan 86ef9666c4
Fix exception occur in RpcServer side, it will not be sent to RpcClient (#15536)
9 months ago
.github Change download url in backend.yml (#15526) 9 months ago
.idea Add icon in idea (#12829) 2 years ago
.mvn/wrapper [Improve][CI]Upgrade maven-wrapper to 3.1.0 (#8557) 3 years ago
deploy Enable set ServerLoadProtection fot Master/Worker (#15439) 10 months ago
docs [Doc][K8S] Add DS K8S Operator into k8s deployment character (#15516) 9 months ago
dolphinscheduler-alert Use DefaultUncaughtExceptionHandler to log the uncached exception (#15496) 10 months ago
dolphinscheduler-aop fix aop typo error (#13047) 2 years ago
dolphinscheduler-api [improvement][api] Fix typo for controllers (#15438) 9 months ago
dolphinscheduler-api-test Enable set ServerLoadProtection fot Master/Worker (#15439) 10 months ago
dolphinscheduler-bom Use Druid to split sql (#15367) 10 months ago
dolphinscheduler-common Use DefaultUncaughtExceptionHandler to log the uncached exception (#15496) 10 months ago
dolphinscheduler-dao [Fix] [Bug] Change default version of Workflow/TaskDefinition to `1` (#15498) 9 months ago
dolphinscheduler-dao-plugin Remove mapper usage in tools (#15073) 1 year ago
dolphinscheduler-data-quality [Feature][Data Quality] Data Quality Support Choose Database (#14406) 1 year ago
dolphinscheduler-datasource-plugin [bug] Exception when using host in ipv6 format (#14040) 10 months ago
dolphinscheduler-dist Use Druid to split sql (#15367) 10 months ago
dolphinscheduler-e2e [Improvement][E2E] add e2e javatask case (#15469) 10 months ago
dolphinscheduler-extract Fix exception occur in RpcServer side, it will not be sent to RpcClient (#15536) 9 months ago
dolphinscheduler-master 【Master】【Bug】Fix a bug, When the worker service offline, workerNodeInfo cache in master cannot delete the offline worker (#15459) 9 months ago
dolphinscheduler-meter Enable set ServerLoadProtection fot Master/Worker (#15439) 10 months ago
dolphinscheduler-microbench Optimize server startup log (#15362) 10 months ago
dolphinscheduler-registry [Improvement][Alert] Add a test send feature when creating an alert instance (#15163) 12 months ago
dolphinscheduler-scheduler-plugin [Improvement-13932][API] Tenant parameters and Worker group parameters are put together in the task startup parameters (#13935) 2 years ago
dolphinscheduler-service TaskGroupPriority only compare When TaskGroup is same (#15486) 10 months ago
dolphinscheduler-spi [Improvement] Refactoring K8S task plugin with connections managed in connection center (#14977) 1 year ago
dolphinscheduler-standalone-server Enable set ServerLoadProtection fot Master/Worker (#15439) 10 months ago
dolphinscheduler-storage-plugin Fix resource file usage(Delete Resource/ResourceUser which is deprecated) (#15355) 10 months ago
dolphinscheduler-task-plugin [BUG] #15013 Fix retryInterval in RetryPolicy will never be used in RetryUtils (#15014) 9 months ago
dolphinscheduler-tools Fix PostgresqlDatabaseContainerProvider get Image is incorrect (#15434) 10 months ago
dolphinscheduler-ui front: When you edit a task in the task definition list, the front task list is displayed (#12819) 9 months ago
dolphinscheduler-worker Use DefaultUncaughtExceptionHandler to log the uncached exception (#15496) 10 months ago
images doc: Change readme and standalone docker quick start (#14002) 2 years ago
licenses [Fix][Common] rewrite code generate,fix bit shift (#6914) 3 years ago
script [improvement][install.sh] fix the install Error "Command not found rmr" & su… (#13163) 2 years ago
style [feat][ci] Add pre-commit for easy spotless config (#12192) 2 years ago
tools Use Druid to split sql (#15367) 10 months ago
.asf.yaml Disable dependabot pull requests (#14596) 1 year ago
.dlc.json [Feature][DataSource] add oceanbase datasource (#13675) 2 years ago
.flake8 [release] version 3.0.3 (#13131) 2 years ago
.gitattributes Create .gitattributes 6 years ago
.gitignore Remove dao module in worker (#13242) 2 years ago
.gitmodules [Feature][style] Add spotless maven plugin for automatic style fix. (#11272) 2 years ago
.licenserc.yaml [Improvement][Helm] using helm-docs to generate docs automatically (#15299) 10 months ago
.pre-commit-config.yaml [chore] Separate Python API into another repository (#12779) 2 years ago
CONTRIBUTING.md doc: Change readme and standalone docker quick start (#14002) 2 years ago
LICENSE [Improve][CI]Upgrade maven-wrapper to 3.1.0 (#8557) 3 years ago
NOTICE [NOTICE]Update the NOTICE year (#14272) 1 year ago
README.md Add guideline link into DolphinScheduler mail list (#15447) 10 months ago
README_zh_CN.md Add guideline link into DolphinScheduler mail list (#15447) 10 months ago
doap.rdf Add doap.rdf (#14883) 1 year ago
lombok.config add lombok config (#11212) 2 years ago
mvnw [Improve][CI]Upgrade maven-wrapper to 3.1.0 (#8557) 3 years ago
mvnw.cmd [Improve][CI]Upgrade maven-wrapper to 3.1.0 (#8557) 3 years ago
pom.xml [Improvement][Helm] using helm-docs to generate docs automatically (#15299) 10 months ago

README.md

Apache Dolphinscheduler

License codecov Quality Gate Status Twitter Follow Slack Status CN doc

About

Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code. It is also provided powerful user interface, dedicated to solving complex task dependencies in the data pipeline and providing various types of jobs available out of the box

The key features for DolphinScheduler are as follows:

  • Easy to deploy, provide four ways to deploy which including Standalone, Cluster, Docker and Kubernetes.
  • Easy to use, workflow can be created and managed by four ways, which including Web UI, Python SDK, Yaml file and Open API
  • Highly reliable and high availability, decentralized architecture with multi-master and multi-worker, native supports horizontal scaling.
  • High performance, its performance is N times faster than other orchestration platform and it can support tens of millions of tasks per day
  • Cloud Native, DolphinScheduler supports orchestrating multi-cloud/data center workflow, and supports custom task type
  • Versioning both workflow and workflow instance(including tasks)
  • Various state control of workflow and task, support pause/stop/recover them in any time
  • Multi-tenancy support
  • Others like backfill support(Web UI native), permission control including project, resource and data source

QuickStart

User Interface Screenshots

  • Homepage: Project and workflow overview, including the latest workflow instance and task instance status statistics. home

  • Workflow Definition: Create and manage workflow by drag and drop, easy to build and maintain complex workflow, support bulk of tasks out of box. workflow-definition

  • Workflow Tree View: Abstract tree structure could clearer understanding of the relationship between tasks workflow-tree

  • Data source: Manage support multiple external data sources, provide unified data access capabilities for such as MySQL, PostgreSQL, Hive, Trino, etc. data-source

  • Monitor: View the status of the master, worker and database in real time, including server resource usage and load, do quick health check without logging in to the server. monitor

Suggestions & Bug Reports

Follow this guide to report your suggestions or bugs.

Contributing

The community welcomes everyone to contribute, please refer to this page to find out more: How to contribute, find the good first issue in here if you are new to DolphinScheduler.

Community

Welcome to join the Apache DolphinScheduler community by:

Landscapes



  

DolphinScheduler enriches the CNCF CLOUD NATIVE Landscape.