DolphinScheduler

Commit Graph

Author	SHA1	Message	Date
Aaron Wang	08335b1032	[Improvement][Task] Improved way to collect yarn job's appIds (#12197 ) * Provide aop way as an optional way to collect yarn job's applicationId, and import new module `dolphinscheduler-aop` to place the aop code. * Add user property `appId.collect` for user to decide how to collect applicationId. * Add new environment configuration for each type of yarn tasks to support aop in `dolphinscheduler_env.sh` * Update docs to declare how to use aop way. * Update `LogUtils` to support fetch applicationId in different ways based on the user property. Co-authored-by: gabrywu <gabrywu@apache.com>	2 years ago
Wenjun Ruan	a0d37fc7ae	Set tenantDir permission (#12486 )	2 years ago
caishunfeng	dedff70f90	[Improvement] Merge spi.utils into common.utils (#12502 ) * improve JSONUtil * merge spi.utils into common.utils * split constants && remove some copy utils method * remove StringUtils	2 years ago
fuchanghai	f0a34cddec	[improvement-#12416] Use CollectionUtils.isEmpty judge the collection isEmpty to avoid NPE (#12449 )	2 years ago
Eric Gao	d46e4659d9	[Improvement][Style] Fix remaining style errors and wildcard imports (#12412 ) * Fix remaining style errors and wildcard imports * Upgrade spotless to the latest stable version, exclude .github folder from spotless check and fix dead link * Fix spotless matching scope of markdown files	2 years ago
Eric Gao	2f37da0dbc	[Improvement][Test] Block the usage of powermock and move mockito dependencies from sub-modules to root pom (#12311 ) * move mockito dependencies from sub-modules to root pom * Add check in CI to block the usage of powermock	2 years ago
Yann Ann	b357781df2	[Migrate][Test] Migrate junit4 -> junit5 test cases in common, service, and spi modules (#12363 )	2 years ago
kezhenxu94	db1d319159	Reorganize some classes in common module, remove duplicate classes (#12321 )	2 years ago
Yann Ann	17cd644506	[Fix-#11669][Workflow Instance Page] Fix the duration in Workflow Instance page. (#12264 ) * fix process duration issue * use processInstance.getState().isFinished() replace new isFinish function * add WorkflowUtils	2 years ago
Eric Gao	9ab79e064c	[Improvement][Test] Fully remove the usage of powermock from the whole project (#12244 ) * Fully remove the usage of powermock from the whole project * Upgrade org.reflections to 0.10.12	2 years ago
calvin	b4947b471c	fix this issue (#12281 )	2 years ago
Yann Ann	c87f6d89a4	[fix#12195] Change date to timestamp to support cross diff time zones (#12239 ) * fix DS support cross time zone, use timestamp replace date	2 years ago
Tq	cf5a8894e2	[BUG][BE-12113]fix htrace dependency conflicts (#12126 ) * fix htrace dependency conflicts * replace htrace-core with hbase-noop-htrace	2 years ago
Yann Ann	289e1ecdc6	[Bug] [Common] update IPv4 Pattern (#11762 ) * [Bug] [Common] IPv4 Pattern is wrong. #11758	2 years ago
rickchengx	08a4c7981f	[improve] Remove the spark version of spark task (#11860 )	2 years ago
JieguangZhou	cf522e2fc0	[improve] Optimize MLFlow task plugin for easy of use (#12071 ) optimize code	2 years ago
Eric Gao	66958b91d7	[Feature][Resource Center] Add support for Alibaba Cloud OSS as storage of resource center (#11708 ) * Add support for Alibaba Cloud OSS as storage of resource center * Add dependency licenses * Refactor code, add unit tests and related docs	2 years ago
insist777	5b384f3fab	[Feature-11473][Task]Support test task (#11670 ) * [improve] support test tasks * [improve] support test tasks * [improve] support test tasks * [improve] support test tasks * [improve] support test tasks * Update TaskExecuteThread.java * try solve e2e q * try solve e2e q * try solve e2e q * try solve e2e q * try solve e2e q * try solve e2e q * try solve e2e q * try solve e2e q * try solve e2e q * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * Update DataSource.java * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * Update messages_zh_CN.properties * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * Update messages.properties * Update messages_en_US.properties * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks	2 years ago
Wenjun Ruan	d833a28b2e	Fix cannot save processDefinition (#11931 )	2 years ago
jackfanwan	71b4087421	Example Change the regular expression of the data source password (#11459 )	2 years ago
Wenjun Ruan	9813ded981	Add debug logs for properties read from `common.properties` (#11910 )	2 years ago
LiuBodong	3ca9680b20	[Fix][Monitor]Monitor UI not show DisakAvailable and MemoryUsage correctly (#11870 )	2 years ago
Kengo Seki	3664d85143	[Improve] Upgrade Hadoop to 3.2.4 (#11832 )	2 years ago
caishunfeng	2e61c76c22	[Improvement] Add remote task model (#11767 )	2 years ago
kezhenxu94	efedc9a53c	Bump up dependencies to fix cves (#11765 )	2 years ago
xiangzihao	ebcffb04aa	fix hdfs defaultFs not working (#11823 )	2 years ago
Kengo Seki	444c7e6eb7	[Improvement] Replace commons-lang 2 function invocations with commons-lang3 (#11810 ) * [Improvement] Replace commons-lang 2 function invocations with commons-lang3	2 years ago
Tq	b3cc8a55b9	[feature][API]feature: add task type list and enable user to add task type to fav (#11727 ) * feature: add task type list and enable user to add task type to fav * make DependentExecute.java variable protected * add standalone server fileSet	2 years ago
Wenjun Ruan	67e7f88d8b	Refactor heart beat task, use json to serialize/deserialize (#11702 ) * Refactor heart beat task, use json to serialize/deserialize	2 years ago
Wenjun Ruan	03e1e6fe45	[Bug] [Worker] Optimize the getAppId method to avoid worker OOM when kill task (#11701 ) * Fix kill job may cause worker oom	2 years ago
Wenjun Ruan	c110f4acae	Refresh server startup time when recovery from waiting (#11595 )	2 years ago
kezhenxu94	13e4720aa2	Upgrade spring boot and swagger (#11574 )	2 years ago
juzimao	3b72c6efe7	[Improvement]Add a stop function when you are ready to do pause operation (#11543 ) * add can stop for execute state machine * add execute type check for pause operation	2 years ago
Wenjun Ruan	7ff34c3947	[Feature-7024] Add waiting strategy to support master/worker can recover from registry lost (#11368 ) * Add waiting strategy to support master/worker can recover from registry lost * throw exception when zookeeper registry start failed due to interrupted	2 years ago
fuchanghai	6e2bed4d6b	[fix-11378] fix API-Server release response message typo (#11400 ) * [fix-11295] remove duplicate classes * [fix-11378] fix response message error Co-authored-by: fuchanghai <changhai.fu@marketingforce.com>	2 years ago
caishunfeng	0464123c2b	[Feature-11223] support stream task (#11350 ) * add task execute type * update task definition list paging * update task instance list paging * stream task start * [Feature][UI] Some changes to execute task. * Set the connection edge to dashed line. * Add FLINK_STREAM task. * add stream task * flink savepoint and cancel * fix query bug * add stream task definition * add task instance for stream task * delete stream task definition state * update api for stream task definition edit * modify search for stream task instance * add language * delete task type search for stream task definition * change task type search for stream task instance * add jump button * add savepoint * add down log for stream task instance * ui test * stream task start * run DAG * [Fix][UI] Fix the stream task edgs not to be dashed when filling back. * [Feature][UI] Remove some fields for FLINK_STREAM. * add start modal * add dryRun column for stream task instance * fix duration * fix pon * fix build error * Add success tip * add auto sync for stream task instance * remove forgien key for task instance * license header * UT fix * modify locales * recover common config * fix UT * add doc Co-authored-by: Amy <amywang0104@163.com> Co-authored-by: devosend <devosend@gmail.com>	2 years ago
Wenjun Ruan	8774415197	Split ExecutionStatus to WorkflowExecutionStatus and TaskExecutionStatus (#11340 )	2 years ago
fuchanghai	05932bcf55	[fix-11295] remove duplicate classes (#11355 )	2 years ago
zhuxt2015	c34503e3f6	[fix] Process definition length too long when copy or import (#10621 )	2 years ago
Wenjun Ruan	8e21c38c00	Write alert result into db (#11221 )	2 years ago
Sheldon	efd68f4805	[Fix-10665] [S3] Fix s3 download method (#10675 ) when overwrite param is true and dest file is exist, throw exception make dirs for ancestor directories of the source file path if it is not exists To describe the error more clearly, change "the file isn`t exists" to specific error message Co-authored-by: sheldonliu <sheldonliu>	2 years ago
liyangyang	6f0a609793	[Improvement 11072][common] Added HTTPS request support in kerberos environment (#11127 ) * [Improvement-11072][dolphinscheduler-common] Added HTTPS request support in kerberos environment * [Improvement-11072][dolphinscheduler-common] supplement Co-authored-by: liyangyang <liyangyang@bizseer.com>	2 years ago
liyangyang	f13e7a95ae	[Improvement-11013][dolphinscheduler-common] YarnHAAdminUtils#getActiveRMName function Add HTTPS Hadoop environment support (#11017 ) * [Improvement-11013][dolphinscheduler-common] YarnHAAdminUtils#getActiveRMName function Add HTTPS Hadoop environment support * [Improvement-11013][dolphinscheduler-common] add test code * [Improvement-11013][dolphinscheduler-common] code format * [Improvement-11013][dolphinscheduler-common] add hadooputils test code * [Improvement-11013][dolphinscheduler-common] remove extra blank lines * [Improvement-11013][dolphinscheduler-common] adjusts test code * [Improvement-11013][dolphinscheduler-common] remove useless import * [Improvement-11013][dolphinscheduler-common] add test code * [Improvement-11013][dolphinscheduler-common] shortened string * [Improvement-11013][dolphinscheduler-common] format test code style Co-authored-by: liyangyang <liyangyang@bizseer.com>	2 years ago
旺阳	28b40da1b1	[Improve] Hide Change Pwd Page When Login With LDAP (#11041 ) * hide-change-pwd-page-when-ldap-login * add unit test	2 years ago
Wenjun Ruan	5e9c7dad23	Add dolphinscheduler-bom to manage the dependency version (#11025 )	2 years ago
Wenjun Ruan	2be1d4bf0a	Fix worker cannot shutdown due to resource close failed or heart beat check failed (#10979 ) * Use try-with-resource to close resource, and add heart error threshold to avoid worker cannot close due to heart beat check failed * Move heartbeat error threshold to applicaiton.yml	2 years ago
Eric Gao	a38fa34d43	[Feature][Task Plugin] Enable users to switch endpoints in zeppelin tasks (#10925 ) * [Feature][Task Plugin] Enable users to switch endpoints in zeppelin tasks (#9814)	2 years ago
Jiajie Zhong	0db9bbd538	[fix] delete workflow or task used by other tasks (#10873 ) currently, users can delete process definitions used in other sub-process tasks or in other dependent tasks. but this change will break the dependence of those task and failed DAG, this patch add validation of those delete behavior to avoid this error	2 years ago
陈家名	59cd86157f	[Python] Supports creating or editing resources. (#10823 )	2 years ago
Wenjun Ruan	f639a2eed4	[Fix-10854] Fix database restart may lost task instance status (#10866 ) * Fix database update error doesn't rollback the task instance status * Fix database error may cause workflow dead with running status	2 years ago

1 2 3 4 5 ...

890 Commits (e3fdb1a3ff8831275ce2e46d0ae9d481305b3c23)