DolphinScheduler

Commit Graph

Author	SHA1	Message	Date
Wenjun Ruan	43f5f24529	Add dolphinscheduler-extract-common module (#15266 )	12 months ago
Wenjun Ruan	9c7ad6df0a	[Improvement] Clean up Scheduler logic (#15198 ) * Clean up Scheduler logic * Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ProcessDefinitionServiceImpl.java Co-authored-by: 旺阳 <wang@lqwang.net> --------- Co-authored-by: 旺阳 <wang@lqwang.net>	1 year ago
旺阳	5afd94136c	[Fix][Data Quality] Change t_ds_dq_rule_input_entry field name fix PostgreSQL not support value issue (#14992 ) * change data quality field name * fix-dao * fix-dao * fix-dao * fix-dao * update * test * update * update	1 year ago
Wei Xiaonan	c0ed68121d	[Feature-14832][Listener]Implementation of Listener Mechanism (#14981 ) * first commit * 1. sql: sync ddl 2. front-end: change to ternary expression 3. back-end: correct license header in ListenerEvent.java * test case * frontend: remove unnecessary console * fix unit test * remove log depends on user-provided value * fix dolphinscheduler_postgresql.sql * sync database schema * fix unit test * fix unit test * fix some NIT. * extract GLOBAL_ALERT_GROUP_ID into variable * fix ddl bug * add column task_type in t_ds_fav_task in upgrade/3.2.0_schema * add unit test	1 year ago
Chenshuai	4b5eb1a2bb	[Improvement-14894][dolphinscheduler-alert] alert message contains the operator (#14910 ) * feat: add operator in alert info * fix: optimize get user info directly * fix: also optimize get user info directly * fix: code style * fix: code style * fix: update test case * fix: code check style --------- Co-authored-by: Jim Chen <chenshuai19950725@gmail.com> Co-authored-by: David Zollo <dailidong66@gmail.com> Co-authored-by: Rick Cheng <rickchengx@gmail.com> Co-authored-by: caishunfeng <caishunfeng2021@gmail.com> Co-authored-by: xiangzihao <460888207@qq.com>	1 year ago
Chenshuai	6dcc26f52e	feat: add task priority in alert info (#14919 ) Co-authored-by: Jim Chen <chenshuai19950725@gmail.com> Co-authored-by: Aaron Wang <wangweirao16@gmail.com>	1 year ago
Aaron Wang	73e846d03e	[Improvement-14884][Master] Add overload state in master heartbeat to trigger slot change (#14887 )	1 year ago
Jay Chung	3fa69d2db8	[Bug][Worker] Fix sql/shell task doesn't replace parameter (#14876 ) Fix parameter assign error, fix #14869 which including * shell task param not work, botch local and global * others task chain assign not work	1 year ago
Wenjun Ruan	d223d654cc	Add rpc benchmark test (#14797 )	1 year ago
Wenjun Ruan	55cc77226f	[RPC] Refactor the remote module. (#14776 ) * Add dolphinscheduler-extract-base * Add dolphinscheduler-extract-master * Add dolphinscheduler-extract-worker * Add dolphinscheduler-extract-alert	1 year ago
Aaron Wang	a491e3a849	fix: null app-info-path cause NPE (#14752 )	1 year ago
Wenjun Ruan	db62ce0e47	Fix serial mode will cause NPE in Workflow bootstrap (#14703 )	1 year ago
fuchanghai	b391b74df4	[fix-#14537] the branch that needs to be executed overlaps with another branch, it may not be able to complete the normal execution (#14563 )	1 year ago
KingsleyY	4a80e3a021	[DS-14566][master] fix serial_wait command_param does not replace global_params (#14606 ) This closes #14566 Co-authored-by: yangxin3 <yangxin3@newhope.cn> Co-authored-by: Eric Gao <ericgao.apache@gmail.com> Co-authored-by: xiangzihao <460888207@qq.com>	1 year ago
Wenjun Ruan	e6d94632b9	Add WorkflowExecuteContext (#14544 )	1 year ago
Rick Cheng	3de0b5a38c	[Feature-14339][Parameter] Add parameter combining of project-level parameters (#14452 )	1 year ago
Jay Chung	221df4a278	revert: Datasource need test binding to create prod (#14381 ) We should keep our step as less as possible, for now, we have to test datasource and binding it to the prod datasource, I think it will make our users do not thing to use datasource, so I do like to revert it and keep step as less as possible related to https://github.com/apache/dolphinscheduler/pull/11670	1 year ago
Rick Cheng	b49b91c45d	[Improvement-14331][common] Remove the duplicate ParameterUtils (#14332 )	1 year ago
Wenjun Ruan	aa2d9a7f05	Add baseDao (#14316 )	1 year ago
JieguangZhou	e7cdc7c136	[Feature][Task Plugin] Add Dynamic task to generate dynamic worklfows with list parameters (#14127 ) * add dynamic task plugin * fix ui * update code * add DOC * ADD UT * fix doc * fix sanity check * add upgrade ddl * fix sql	1 year ago
Wenjun Ruan	d810c487fd	Fix taskGroupQueue doesn't removed from inQueue where wakeup failed (#14200 ) * Fix taskGroupQueue doesn't removed from inQueue where wakeup failed * Fix avaliable taskGroup is 0 the TaskGroupQueue doesn't out queue	2 years ago
haibingtown	af7da0630e	[Feature] Add project name/workflow definition name/instance id/task name to the built-in variables (#14099 ) * [Feature] Add project name/workflow definition name/instance id/task name to the built-in variables	2 years ago
Drake Youngkun Min	801216bd35	RECOVER_TOLERANCE_FAULT_PROCESS CommandType needs the start parameters (#13958 )	2 years ago
Wenjun Ruan	cf91544b99	Refactor logic task (#13948 )	2 years ago
Aaron Wang	45586f71d5	[BUG][Resource Center] Task can not select main JAR (#13536 )	2 years ago
Kerwin	79cb707b57	[Improvement-13932][API] Tenant parameters and Worker group parameters are put together in the task startup parameters (#13935 ) * [Improvement][API] Tenant parameters and Worker group parameters are put together in the task startup parameters	2 years ago
旺阳	61637cc0a3	[Bug] [Cron] Parse corn expression error (#13841 ) * fix-cron * update catch exception	2 years ago
Wenjun Ruan	41a8ba9aab	Support alert server HA (#13865 ) * Support alert server cluster * Remove WORKER_ALERT_LISTEN_HOST in statefulset-dolphinscheduler-worker.yaml	2 years ago
Rick Cheng	85605bbef9	[Improvement-13653][Remote Logging] Support api-server to get task log from remote target (#13654 )	2 years ago
caishunfeng	9d9ae9ad54	[improvement] support self-dependent (#13818 )	2 years ago
Wenjun Ruan	68660ec96b	Refactor remote command (#13809 ) * Refactor remote command * Rename Command to Message	2 years ago
Wenjun Ruan	d1b6e6f02c	Take over task instance in master failover (#13798 )	2 years ago
Aaron Wang	8895921d87	[Improvement-13651] Remove useless resources_task (#13721 )	2 years ago
Wenjun Ruan	c9066e8de9	Use MDC to filter task instance log (#13673 ) * Use MDC to collect task instance log * Use MDCAutoClosableContext to remove the MDC key	2 years ago
Aaron Wang	047fa2f65e	[Feature-13511] Submit Spark task directly on Kubernetes (#13550 )	2 years ago
seedscoder	8d12dc0702	[Improvement-13491] Use lombok @Slf4j annotation to generate logger (#13509 )	2 years ago
Wenjun Ruan	6300a9b8de	Fix serial wait will go into block when there is no task need to submit (#13486 )	2 years ago
Wenjun Ruan	12dd60fa46	Fix task wake up failed will block the event (#13466 )	2 years ago
qianli2022	8be32d4145	[Feature][Api] When use api to run a process we want get processInstanceId (#13184 ) * add sql * add mapper * add dao * add excutor Co-authored-by: qianl4 <qianl4@cicso.com>	2 years ago
Wenjun Ruan	01f4fb26f0	Change remove task instance log to async request (#13399 )	2 years ago
Wenjun Ruan	98dfd64444	Clear the task group data when delete a project/workflowInstance (#13383 )	2 years ago
Wenjun Ruan	8a479927f3	Add projectCode in t_ds_process_instance and t_ds_task_instance to remove join (#13284 )	2 years ago
Wenjun Ruan	52134277a3	Fix task group cannot release when kill task (#13314 )	2 years ago
Aaron Wang	8503ee0eed	[Improvement][Worker] Startup parameter should have the highest priority (#13274 )	2 years ago
Wenjun Ruan	fd3afd84ad	Remove alert when delete workflow instance (#13281 )	2 years ago
Wenjun Ruan	de70421a1e	Remove the log path check (#13280 )	2 years ago
Wenjun Ruan	14ec4a2398	Remove dao module in worker (#13242 )	2 years ago
JieguangZhou	66e20271ad	[Feature][Master] Add task caching mechanism to improve the running speed of repetitive tasks (#13194 ) * Supports task instance cache operation * add task plugin cache * use SHA-256 to generate key * Update dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_mysql.sql Co-authored-by: Jay Chung <zhongjiajie955@gmail.com> * Update dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_postgresql.sql Co-authored-by: Jay Chung <zhongjiajie955@gmail.com> * Optimizing database Scripts * Optimize clear cache operation Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>	2 years ago
JieguangZhou	e4b9b67255	Allow execute task in workflow instance (#13103 )	2 years ago
Wenjun Ruan	838a0df783	Remove logic task plugin module (#13171 )	2 years ago

1 2 3 4 5 ...

507 Commits (f8a44ff7192f7dc998f7568b229b48a2bf7ee769)