DolphinScheduler

Commit Graph

Author	SHA1	Message	Date
ZhongJinHacker	738da1cda3	[Fix][Master] Fix Potential danger in the event of a worker failover (#15689 ) * clean unused import * fix style check * fix when path is null or empty, it will cause serverhost is null, * fix UT test (#15684) * [Fix-15639] parameterPassing is null case NPE (#15678) Co-authored-by: caishunfeng <caishunfeng2021@gmail.com> * fix when path is null or empty, it will cause serverhost is null,	3 months ago
Wenjun Ruan	04a6b0d281	Fix task mighe be dispatched even if it has been killed (#15662 )	4 months ago
Wenjun Ruan	8a35e8b2f8	Fix switch task will throw exception when there is not parameters (#15594 )	4 months ago
caishunfeng	ef9ed3db55	fix switch js (#15487 ) Co-authored-by: Rick Cheng <rickchengx@gmail.com> Co-authored-by: Eric Gao <ericgao.apache@gmail.com>	4 months ago
Wenjun Ruan	89742332a8	Fix TaskGroupQueue will never be wakeup due to wakeup failed at one time (#15528 )	5 months ago
sleo	431414729f	【Master】【Bug】Fix a bug, When the worker service offline, workerNodeInfo cache in master cannot delete the offline worker (#15459 ) * remove work from workerNodeInfo when work server down * modify log msg Co-authored-by: xiangzihao <zihaoxiang@apache.org> * add unit test * add unit test * modify the code style * add license header --------- Co-authored-by: xiangzihao <zihaoxiang@apache.org> Co-authored-by: Rick Cheng <rickchengx@gmail.com>	5 months ago
Wenjun Ruan	7b9c9e0eb2	Enable set ServerLoadProtection fot Master/Worker (#15439 )	5 months ago
Wenjun Ruan	2119e41800	[Improvement] Move delay calculation to Master (#15278 )	7 months ago
caishunfeng	b5eddc0ce8	fix switch condition (#15228 ) Co-authored-by: Eric Gao <ericgao.apache@gmail.com>	7 months ago
Wei Xiaonan	c0ed68121d	[Feature-14832][Listener]Implementation of Listener Mechanism (#14981 ) * first commit * 1. sql: sync ddl 2. front-end: change to ternary expression 3. back-end: correct license header in ListenerEvent.java * test case * frontend: remove unnecessary console * fix unit test * remove log depends on user-provided value * fix dolphinscheduler_postgresql.sql * sync database schema * fix unit test * fix unit test * fix some NIT. * extract GLOBAL_ALERT_GROUP_ID into variable * fix ddl bug * add column task_type in t_ds_fav_task in upgrade/3.2.0_schema * add unit test	8 months ago
Aaron Wang	73e846d03e	[Improvement-14884][Master] Add overload state in master heartbeat to trigger slot change (#14887 )	9 months ago
eye-gu	7ae4fb3787	[Fix-14149][master] task finished so not dispatch (#14161 )	10 months ago
Wenjun Ruan	55cc77226f	[RPC] Refactor the remote module. (#14776 ) * Add dolphinscheduler-extract-base * Add dolphinscheduler-extract-master * Add dolphinscheduler-extract-worker * Add dolphinscheduler-extract-alert	10 months ago
caishunfeng	59998f4c75	[Improvement] add dispatch fail times when compare (#14761 ) Co-authored-by: Rick Cheng <rickchengx@gmail.com>	10 months ago
Tengting Xu	9963bfc612	[Workflow] Print WorkflowInstance detail/ TaskInstance detail when finished (#14677 ) * [Workflow] Print WorkflowInstance detail/ TaskInstance detail when finished * [Workflow] minor fix * [Workflow] add ut * [Workflow] add header --------- Co-authored-by: tengting.xu <xtt@dipeak.com>	11 months ago
Wenjun Ruan	e6d94632b9	Add WorkflowExecuteContext (#14544 )	11 months ago
旺阳	c812bf9d49	[Bug] [Mater] Not got latest task intance by task code (#14529 ) * add task code->instance map --------- Co-authored-by: Eric Gao <ericgao.apache@gmail.com>	11 months ago
旺阳	465e7ae6ee	[Bug] [Master] Workflow keep running when task has no id (#14315 ) * change completeTaskMap to completeTaskSet * Update dolphinscheduler-master/src/main/java/org/apache/dolphinscheduler/server/master/runner/WorkflowExecuteRunnable.java Co-authored-by: Wenjun Ruan <wenjun@apache.org> * change method name * fix ut * fix spotless --------- Co-authored-by: Wenjun Ruan <wenjun@apache.org>	1 year ago
Wenjun Ruan	aa2d9a7f05	Add baseDao (#14316 )	1 year ago
JieguangZhou	e7cdc7c136	[Feature][Task Plugin] Add Dynamic task to generate dynamic worklfows with list parameters (#14127 ) * add dynamic task plugin * fix ui * update code * add DOC * ADD UT * fix doc * fix sanity check * add upgrade ddl * fix sql	1 year ago
Wenjun Ruan	cf91544b99	Refactor logic task (#13948 )	1 year ago
Kerwin	79cb707b57	[Improvement-13932][API] Tenant parameters and Worker group parameters are put together in the task startup parameters (#13935 ) * [Improvement][API] Tenant parameters and Worker group parameters are put together in the task startup parameters	1 year ago
Wenjun Ruan	41a8ba9aab	Support alert server HA (#13865 ) * Support alert server cluster * Remove WORKER_ALERT_LISTEN_HOST in statefulset-dolphinscheduler-worker.yaml	1 year ago
Wenjun Ruan	9b269b3c53	Use common response for sync request (#13847 )	1 year ago
Wenjun Ruan	9df89cf0cf	Use bootstrap user as the default tenant (#13825 )	1 year ago
caishunfeng	9d9ae9ad54	[improvement] support self-dependent (#13818 )	1 year ago
Wenjun Ruan	68660ec96b	Refactor remote command (#13809 ) * Refactor remote command * Rename Command to Message	1 year ago
Wenjun Ruan	d1b6e6f02c	Take over task instance in master failover (#13798 )	1 year ago
Eric Gao	394805b2c7	[Feature][Metrics] Tag workflow related metrics with process definition code (workflow id) (#13640 ) * Tag workflow related metrics with process definition code (workflow id) * Clean up related metrics when deleting workflow definition * Add license headers * Update related UT cases * Add an example in grafana-demo * Add related docs	1 year ago
Wenjun Ruan	ce34e21960	Task instance failure when worker group doesn't exist (#13448 )	1 year ago
Wenjun Ruan	14ec4a2398	Remove dao module in worker (#13242 )	2 years ago
JieguangZhou	66e20271ad	[Feature][Master] Add task caching mechanism to improve the running speed of repetitive tasks (#13194 ) * Supports task instance cache operation * add task plugin cache * use SHA-256 to generate key * Update dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_mysql.sql Co-authored-by: Jay Chung <zhongjiajie955@gmail.com> * Update dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_postgresql.sql Co-authored-by: Jay Chung <zhongjiajie955@gmail.com> * Optimizing database Scripts * Optimize clear cache operation Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>	2 years ago
JieguangZhou	e4b9b67255	Allow execute task in workflow instance (#13103 )	2 years ago
ZhenjiLiu	7cdb926a5f	[Improvement][Batch Query] Batch query ProcessDefinitions belongs to need failover ProcessInstance. (#12506 )	2 years ago
Wenjun Ruan	e6da1ccf81	Add worker-group-refresh-interval in master config (#12601 ) * Add worker-group-refresh-interval in master config * Set interval cannot smaller than 10s * Update dolphinscheduler-master/src/main/java/org/apache/dolphinscheduler/server/master/config/MasterConfig.java Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>	2 years ago
Yann Ann	04aa125ba2	[Refactor]migrate some task dao functions from ProcessServiceImpl to dao modules. (#12505 ) * migrate some task DAO to dao modules. * Update dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/repository/impl/ProcessInstanceMapDaoImpl.java Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>	2 years ago
caishunfeng	dedff70f90	[Improvement] Merge spi.utils into common.utils (#12502 ) * improve JSONUtil * merge spi.utils into common.utils * split constants && remove some copy utils method * remove StringUtils	2 years ago
Yann Ann	b936b882bb	[Refactor] Migrate all command-related interface functions from ProcessServiceImpl (#12474 ) * migrate all command-related interface functions to CommonService	2 years ago
Eric Gao	d46e4659d9	[Improvement][Style] Fix remaining style errors and wildcard imports (#12412 ) * Fix remaining style errors and wildcard imports * Upgrade spotless to the latest stable version, exclude .github folder from spotless check and fix dead link * Fix spotless matching scope of markdown files	2 years ago
Yann Ann	bc80f34056	[Migrate][Test] Migrate all UT cases from jUnit 4 to 5 in master, worker, and remote modules (#12362 ) * migrate junit4 -> junit5 in master, worker, and remote modules	2 years ago
kezhenxu94	db1d319159	Reorganize some classes in common module, remove duplicate classes (#12321 )	2 years ago
rickchengx	05099bd8f7	[Improvement-12296][Test] Close static mock (#12300 )	2 years ago
Yann Ann	c87f6d89a4	[fix#12195] Change date to timestamp to support cross diff time zones (#12239 ) * fix DS support cross time zone, use timestamp replace date	2 years ago
xuhhui	55388be21f	[Improvement][Master] LowerWeightRoundRobin doSelect may be null (#12159 )	2 years ago
Wenjun Ruan	d526dd89f6	[hotfix][UI] Remove SURVEIL and NEXT_LOOP in ui (#12160 ) * Remove SURVEIL and NEXT_LOOP in ui * Fix UT	2 years ago
Eric Gao	cc82206c33	Remove powermock in dolphinscheduler-master module (#12143 ) * Remove powermock related code in dolphinscheduler-master module * Remove redundant comments, useless code and unnecessary stubbings	2 years ago
insist777	5b384f3fab	[Feature-11473][Task]Support test task (#11670 ) * [improve] support test tasks * [improve] support test tasks * [improve] support test tasks * [improve] support test tasks * [improve] support test tasks * Update TaskExecuteThread.java * try solve e2e q * try solve e2e q * try solve e2e q * try solve e2e q * try solve e2e q * try solve e2e q * try solve e2e q * try solve e2e q * try solve e2e q * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * Update DataSource.java * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * Update messages_zh_CN.properties * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * Update messages.properties * Update messages_en_US.properties * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks	2 years ago
Wenjun Ruan	d3a77c68e6	Make LogServiceClient Singleton (#11777 )	2 years ago
caishunfeng	2e61c76c22	[Improvement] Add remote task model (#11767 )	2 years ago
kezhenxu94	efedc9a53c	Bump up dependencies to fix cves (#11765 )	2 years ago

1 2

95 Commits (738da1cda3731543cdec61c249a051fbc99da929)