DolphinScheduler

Commit Graph

Author	SHA1	Message	Date
hjli	242b5dd5b6	[Bug-8760]Resource file deletion conditions (#8765 )	3 years ago
Kerwin	a1bef43981	[Feature-8579][Task] Task back-end plugin optimization, new plugins only need to modify the plugin's own module (#8584 ) * Task plug-in optimization, task-related classes are migrated to the task plugin module * remove tasktype enum class. * fix code style. * fix code style * fix code style * fix ProcessServiceTest.testUpdateResourceInfo test class * fix code style * fix test task plugin manager check parameters null * fix test ut * update aws license * change TaskTimeoutStrategy class	3 years ago
wangyang	0d8079a816	[DS-7992][feat] Alert module judging strategy (#8636 )	3 years ago
ouyangyewei	b0ffec5a4c	to issue/#8826 (#8827 ) Co-authored-by: ouyangyewei <yewei.oyyw@alibaba-inc.com>	3 years ago
Martin Huang	b0fc6e7a69	[Feature-5752][server]Add blocking task (#6272 ) * fix python task execution error * modify code style * delete AbstractTask#setCommand * migrate blocking task alert feature and common attribute * blocking task migrate(complete base features) * migrate blocking task test * resolve TaskNode.java conflict * fix package problem in BlockingParameters * resolve duplicate code * resolve code style * resolve code style * resolve code style * resolve code style * resolve code style * resolve code style * resolve code style * resolve code style * resolve code style * resolve code style * resolve code style * resolve code style * optimise code based on pr#6283 in ds master repo * add log * modify log * resolve conflicts * change hardcode to variable * Add blocking task UI * refactor old code to compatable with the newest branch * add override annotation * remove old code * remove never used packages * add missing packages declaration * Refine the i18n description * add UT * resolve some code smell problems * add fetch-depth * enable unit test in sonar analysis * disable unit test * remove unused packages * resolve duplicate codes * add logs when task status changed and rename some variables * add BLOCK & READY_BLOCK status and corresponding processing code * revoke UI * revert unit-test Co-authored-by: Jave-Chen <baicai.chen@gmail.com>	3 years ago
xiangzihao	2ab8c1ca7d	[Fix-8616][WorkFlowLineage] work flow lineage search result missing data (#8684 ) * fix bug_8616 * remove meaningless query column * fix code smell * fix remaining problems	3 years ago
BaoLiang	44bb654c5e	Revert "upgrade mybatis-plus to 3.4.3 (#8515 )" (#8659 ) This reverts commit `ca6d148a1b`.	3 years ago
yimaixinchen	a72742b9de	remove unuse import jsonFormat (#8548 )	3 years ago
xiangzihao	891a002bea	[Feature-#8373][MasterServer] Dependent tasks can re-run automatically in the case of complement (#8496 ) * first add feature_8373 * fix code smell * add blank line * fix some problems * fix unit test error	3 years ago
BaoLiang	ca6d148a1b	upgrade mybatis-plus to 3.4.3 (#8515 )	3 years ago
caishunfeng	84f2cfec39	[Feature][Server] Custom timezone - Add timezone handler unified (#8477 ) * date convert of timezone * remove @JsonFormat * add unit test * fix time preview in scheduler * optimization & add env config Co-authored-by: caishunfeng <534328519@qq.com>	3 years ago
jegger	6ece0283df	feat: Unify mysql insert value queto (#8502 )	3 years ago
xiangzihao	512f8cb5dd	add index (#8500 )	3 years ago
天仇	95c119226b	[Feature-8386][Server] Custom timezone - Add timezone into user info (#8457 ) * [Feature-8386][Server] Custom timezone - Add timezone into user info 1. Add column `time_zone varchar(32) default null` in table `t_ds_user` 2. Add system default timezone like `GMT+08:00` when create user 3. Add timeZone property when update user info This completes #8386 * [Feature-8386][Server] Custom timezone - Add timezone into user info 1. Add column `time_zone varchar(32) default null` in table `t_ds_user` 2. Add system default timezone like `GMT+08:00` when create user 3. Add timeZone property when update user info 4. add ddl sql in update sql script This completes #8386 * [Feature-8386][Server] Custom timezone - Add timezone into user info 1. Add column `time_zone varchar(32) default null` in table `t_ds_user` 2. Set timeZone null when create user 3. Add timeZone property when update user info This completes #8386 * [Feature-8386][Server] Custom timezone - Add timezone into user info 1. Add column `time_zone varchar(32) default null` in table `t_ds_user` 2. Set timeZone null when create user 3. Add timeZone property when update user info This completes #8386 * [Feature-8386][Server] Custom timezone - Add timezone into user info 1. Add column `time_zone varchar(32) default null` in table `t_ds_user` 2. Set timeZone null when create user 3. Add timeZone property when update user info This completes #8386 * [Feature-8386][Server] Custom timezone - Add timezone into user info 1. Add column `time_zone varchar(32) default null` in table `t_ds_user` 2. Set timeZone null when create user 3. Add timeZone property when update user info This completes #8386 * [Feature-8386][Server] Custom timezone - Add timezone into user info 1. Add column `time_zone varchar(32) default null` in table `t_ds_user` 2. Set timeZone null when create user 3. Add timeZone property when update user info This completes #8386	3 years ago
zixi0825	df6eef84cd	fix(dq) change comparison_type from fluctuation to avg (#8382 )	3 years ago
xiangzihao	f6e2a2cf23	[Fix-8296][API] Update process definition error (#8408 ) * fix bug_8296 * fix bug_8296 * fix bug_8296 * add postgres sql * add postgres sql * add postgres sql	3 years ago
calvin	f18f28cc4a	fix this issue (#8399 )	3 years ago
qianli2022	151100562f	[Feature][api] Task can run on kubernetes - k8s client and namespace #8247 (#8252 ) * add db operator for namespace * add k8s client * add k8s controller * add namespace ui * add licenses * add kubernetes model known-dependencies * add new licenses * fix SonarCloud Code Analysis bug * remove license for standard protocol * fix variable MemoryStr to memoryStr Co-authored-by: qianl4 <qianl4@cicso.com>	3 years ago
calvin	5f25d31a26	fix this issue (#8306 )	3 years ago
calvin	6ae3efb5b6	fix this issue (#8274 )	3 years ago
calvin	7333348632	fix this issue (#8273 )	3 years ago
zixi0825	4ba6d667fc	[Feature][DataQuality] Add Data quality Module #4283 (#6718 ) * add data quality module * add license * add package configuration in dist pom * fix license and jar import bug * replace apache/skywalking-eyes@9bd5feb SHA * refacotr jbdc-connector and writer * modify parameter name in HiveConnector * fix checkstyle error * fix checkstyle error in dolphinschesuler-dist * fix checkstyle error in dolphinschesuler-dist * fix checkstyle error in dolphinschesuler-dist * fix duplicate code bug * fix code style bug * fix code smells * add dq relevant enums and parameter * replace apache/skywalking-eyes@9bd5feb SHA * fix Constants bug * remove the unused class * add unit test * fix code style error * add unit test * refactor data quality common entity * fix code style error * add unit test * close e2e test * fix code smell bug * modify dataquality enum value to 14 in TaskType * add data qualtiy task * update * add getDatasourceOptions interface * fix checkstyle * close e2e test * add data quality task ui * update skywalking-eyes SHA * fix style * fix eslint error * fix eslint error * test e2e * add unit test and alter dataquality task result * fix checkstyle * fix process service test error * add unit test and fix code smells * fix checkstyle error * fix unit test error * fix checkstyle error * change execute sql type name * revert ui pom.xml * fix data quality task error * fix checkstyle error * fix dq task src_connector_type ui select bug * fix spark rw postgresql bug * change mysql driver scope * fix form-create json bug * fix code smell * fix DolphinException Bug * fix ui validate rule and Alert title * fix target connection param bug * fix threshold validate change * add rule input entry index * change statistic_comparison_check logic * remove check type change * add DateExpressionReplaceUtil * fix null point expetion * fix null point expetion * fix test error * add more sql driver * fix test error and remove DateExprReplaceUtil * add get datasource tables and columns * add get datasource tables and columns * remove hive-jdbc in pom.xml * fix code smells * update sql * change the pom.xml * optimize multi_table_accuracy ui * fix v-show error * fix code smells * update sql * [Feature][DataQuality] Add data quality task ui (#5054) * add data quality task ui * update skywalking-eyes SHA * fix style * fix eslint error * fix eslint error * test e2e * fix dq task src_connector_type ui select bug * fix threshold validate change * remove check type change * add get datasource tables and columns * optimize multi_table_accuracy ui * fix v-show error * fix code smells Co-authored-by: sunchaohe <sunzhaohe@linklogis.com> * [Feature][DataQuality] Add data quality module (#4830) * add data quality module * add license * add package configuration in dist pom * fix license and jar import bug * replace apache/skywalking-eyes@9bd5feb SHA * refacotr jbdc-connector and writer * modify parameter name in HiveConnector * fix checkstyle error * fix checkstyle error in dolphinschesuler-dist * fix checkstyle error in dolphinschesuler-dist * fix checkstyle error in dolphinschesuler-dist * fix duplicate code bug * fix code style bug * fix code smells * update * close e2e test * fix spark rw postgresql bug * change mysql driver scope * add more sql driver * remove hive-jdbc in pom.xml * change the pom.xml Co-authored-by: sunchaohe <sunzhaohe@linklogis.com> * [Feature][DataQuality] Add data quality task backend (#4883) * add dq relevant enums and parameter * replace apache/skywalking-eyes@9bd5feb SHA Co-authored-by: sunchaohe <sunzhaohe@linklogis.com> * refactor data_quality_module * add header license * data quality module refactor * fix unit test error * fix checkstyle error * fix unit test error * fix checkstyle error * fix unit test error * fix code smell * fix check style * fix unit test error * task statistics value add unique code * fix unit test error * fix checkstyle error * fix checkstyle * fix security hotspot * fix unit test error * fix security hotspot * fix check * add data quality task error handling * fix unit test error * add unit test * add unit test * optimize data quality result alert * fix unit test * fix sql script error * fix bug * update sql script * fix checkstyle * add license * fix checkstyle * fix checkstyle * fix unit test * add jacoco dependencies * fix unit test * fix unit test * add jacoco dependencies * add unit test * add unit test * add license * fix checkstyle * fix pom * fix checkstyle * fix checkstyle * merge dev * fix ui error * fix pom error * fix pom error * fix test error * fix test error * mssql-jdbc exclude azure-keyvault * fix test error * merge dev and add unit test * add notes * rollback the CollectionUtils * fix * update sql * fix * fix * fix query rule page error * change dq.jar path * fix sql error * fix ui error * fix(dq): jar path&task enum description * add notes on DataQualityApplication * fix dq result jump error * fix(ui): page condition * feat(ui): add show error output path * change version * remove all chinese word in sql * merge Co-authored-by: sunchaohe <sunzhaohe@linklogis.com>	3 years ago
ouyangyewei	aeb7d89c50	to improvement #8192 (#8193 ) Co-authored-by: ouyangyewei <yewei.oyyw@alibaba-inc.com>	3 years ago
yc322	fb9f4a1339	[Feature-5822][api] Add audit log (#6322 ) * rebase * update audit log type name * fix the quoted property error * fix bug * update audit global switch default value * fix wrong ddl comment * fix wrong code style * update audit log search sql * add licenses * add unit test * fix wrong code style * fix bugs * fix wrong code style * add test case * add test case * add license * Add unit test in pom.xml * resolve code smell problem * mysql and postgresql ddl update * update audit log path and audit page query * update audit configuration * update audit log schema, add resource type and resource id * update audit query and list page * resolve audit log front page bugs and log query error * update audit configuration * resolve wrong configuration * update AuditLogControllerTest * update application.yaml * resolve code smell * update standalone configuration * resolve bugs Co-authored-by: yc322 <1393242780@qq.com>	3 years ago
Kerwin	103ccb01da	change version to 2.0.4-SNAPSHOT (#8188 )	3 years ago
wind	b5fa54b6be	[Bug-7865][MasterServer] retry logic optimization (#8156 ) * submit task optimization * cloneAndReset * update * tolerant task restart when init * fix snoar check * fix test * delete unuse file * taskInstance key * code style * skip complete when retry Co-authored-by: caishunfeng <534328519@qq.com>	3 years ago
springmonster	5e975dad34	[Enhancement-8006] Improve the performance of SQL query (#8007 ) Co-authored-by: kuanghc1 <kuanghc1@lenovo.com>	3 years ago
JinYong Li	24a97fda75	[Bug] [dolphinscheduler-api]support workflow instance to definition (#7930 ) * add task save and binds workflow * add task update with upstream * support workflow instance to definition * fix ut	3 years ago
mazhong	5ea06e7eb8	Update ProcessDefinitionMapper.xml (#7931 ) Resolves process definition list issue（data duplication ）	3 years ago
天仇	361d68db26	[FIX-7732][fix] fix column 'is_directory' of table `t_ds_resources` type error in PG database (#7898 ) Fix column 'is_directory' of table t_ds_resources type error in PG database This closes #7732	3 years ago
JinYong Li	acf9c84c50	[Feature][workflow list edit] add task update with upstream (#7829 ) * add task save and binds workflow * add task update with upstream	3 years ago
ououtt	4c2f77ee9c	[DS-7016][feat] Auto create workflow while import sql script with specific hint (#7214 ) * [DS-7016][feat] Auto create workflow while import sql script with specific hint * datasource : datasource name * name: task name * upstream: pre task names * [DS-7016][feat] Auto create workflow while import sql script with specific hint * remove excess blank lines * [DS-7016][feat] Auto create workflow while import sql script with specific hint * datasource : datasource name * name: task name * upstream: pre task names * [DS-7016][feat] Auto create workflow while import sql script with specific hint * datasource : datasource name * name: task name * upstream: pre task names * Code optimization * for Zip Bomb Attack Co-authored-by: eye <eye.gu@aloudata.com>	3 years ago
天仇	4662e6d929	[BUG-7779][SQL] fix syntax error in init sql of postgre (#7782 ) fix syntax error of table `t_ds_task_definition` and `t_ds_task_definition_log` in postgresql with column `task_group_priority int(4)`	3 years ago
JinYong Li	c97170853e	add task save and binds workflow (#7772 )	3 years ago
uh001	3e34e69cfb	The sql has a syntax error, and because it is a function, the exception information will be hidden (#7761 )	3 years ago
JinYong Li	d7d13f7f51	[Feature][workflow list edit] add task list page api (#7743 ) * fix 7597 * fix copy bug * add task list page api * fix total * fix total	3 years ago
calvin	71ccb42697	fix a few bugs (#7703 )	3 years ago
calvin	5ab0135d18	[Fix-7345] Support the whole operations for the task group and the task group queue. (#7678 ) * add task group * modify task group * add task group queue * add task group queue * add task group queue * add task group queue * add task group priority * fix a few issue with api * add task group queue * modify task group queue * modify task group * fix a little bit issue * fix a little bug in the page of managing task group	3 years ago
wind	8808c0a700	[Bug-7474][MasterServer] fix failover when node host is null (#7475 ) * fix failover when node host is null * add failover execute thread * worker handle dead server * fix task instance failover time check * fix upgrade sql * failover logic update Co-authored-by: caishunfeng <534328519@qq.com>	3 years ago
xiangzihao	8b292132c8	[Feature-7569]Optimize Dependent node loading times (#7626 ) * feature 7569 * feature_7569 Co-authored-by: SbloodyS <sbloodys@qq.com>	3 years ago
xiangzihao	c7d7eec679	[Fix-7520][Master] Data too long for column 'task_params' at row 1 (#7521 ) * fix bug_7520 * fix bug_7520 * fix bug_7520 * bug_7520 Co-authored-by: SbloodyS <sbloodys@qq.com>	3 years ago
kezhenxu94	7a888c544c	Try (#7603 )	3 years ago
wangxj3	9e763ad0d1	[Feature-#6422] [api-server] task group queue (#7491 ) * add task group * modify task group * pull dev * add license header * modify code style * fix code style * fix sql error * fix error * fix test * fix test * fix test * fix test * fix code style * fix ut * code style * fix unit test * test ut * ut * add unittest * test ut * modify back ut * majorization code * fix conflict * fix ut * add task group api * reset file * fix ut * fix lost column * fix ut * fix ut * fix ut * fix ut * delete duplicate code * fix code style 、name * fix ut * fix mapper Co-authored-by: wangxj <wangxj31>	3 years ago
时光	a00c4f9709	finished issue#7527 (#7561 ) Co-authored-by: 时光 <caizhedong@cai-inc.com>	3 years ago
lgcareer	cdd4e7bf03	[Improvement-#7529][tools] Init DB schema from the full sql file. (#7530 )	3 years ago
Tom	bb140fbc3b	[DS-7227][refactor] optimize alert plugin instance list order (#7506 ) [DS-7227][refactor] optimize alert plugin instance list order query all alert plugin instance list order by update time desc optimize `select *` sql in the AlterPluginInstanceMapper.xml	3 years ago
KyoYang	676a952bcb	[Fix-#6854][dao] fix "ResourceMapper.xml -> queryResourcePaging" sql bug (#6907 ) * fix complement data retry bug; issues: [Bug] [Master] A bug on task retry mechanism #6613 * [DS-#5293][chore]upgrade cron-utils version 5.0.5 -> 9.1.3 * [DS-#5293]update the licensing information of that dependency * [DS-#5293]update the licensing information of that dependency * update the licensing information of that dependency * [DS-#5293]update the licensing information of that dependency * [DS-#6854][fix] fix "ResourceMapper.xml -> queryResourcePaging" sql bug * [DS-#6854][fix] fix "ResourceMapper.xml -> queryResourcePaging" sql bug Co-authored-by: yangqiyu <yangqiyu@deepexi.com>	3 years ago
Zonglei Dong	7e0010de35	[Refactor] Rename class file, unified word spelling. (#7261 )	3 years ago
Jiajie Zhong	04805818c2	Fix alert plugin instance filter (#7172 ) (#7210 ) * Fix alert plugin instance filter (#7172) alert plugin could not filter by given pattern, cause api server do not handle parameter searchVal, This patch add parameter `searchVal` for alert plugin. fix: #7209 * Add test * Recover AlertPluginInstanceVO	3 years ago
wind	99b8ec6492	[Bug-7319][MasterServer] fix taskNode NPE when switch else branch is empty (#7320 ) Co-authored-by: caishunfeng <534328519@qq.com>	3 years ago

1 2 3 4 5 ...

632 Commits (e17c2bb56a0c844cd9760518ef3fe2505d0491c0)