DolphinScheduler

Commit Graph

Author	SHA1	Message	Date
Rick Cheng	428f1559a3	[Improv-14083][Resource Center] Handle deleteSource in OSS / S3 / GCS (#14084 )	1 year ago
Wenjun Ruan	05df0269f6	Fix task exception might not exist in task instance log (#14085 )	1 year ago
Aaron Wang	74ed7856bc	[Bug-14105][Task] Replace default tenant when downloading resource (#14106 )	1 year ago
Aaron Wang	1e3ae7b942	[improv][Resource Center] Implement getResourceFileName in StorageOperator (#14097 )	1 year ago
Rick Cheng	3eb4c0ed1d	[Improvement-14054][Worker] Kill multiple yarn apps at the same time (#14055 ) * [Improvement-14054][Worker] Kill multiple yarn apps at the same time * Update dolphinscheduler-task-plugin/dolphinscheduler-task-api/src/main/java/org/apache/dolphinscheduler/plugin/task/api/am/YarnApplicationManager.java Co-authored-by: Aaron Wang <wangweirao16@gmail.com>	1 year ago
Wenjun Ruan	cf91544b99	Refactor logic task (#13948 )	1 year ago
klaokai	f6e0f2e471	[Bug] [worker] WorkerConfig output is wrong (#14000 ) (#14001 )	1 year ago
Aaron Wang	731123cebc	[Bug][Worker] get worker status bug (#13992 ) * get worker status bug * modify configuration name	1 year ago
Aaron Wang	45586f71d5	[BUG][Resource Center] Task can not select main JAR (#13536 )	1 year ago
Wenjun Ruan	61a689aa5a	Use percentage to represent memory/cpu usage (#13896 )	1 year ago
Rick Cheng	7ee66f2d02	[Feature-13429][Remote Logging] Add support for writing task logs to Google Cloud Storage (#13777 )	1 year ago
Wenjun Ruan	41a8ba9aab	Support alert server HA (#13865 ) * Support alert server cluster * Remove WORKER_ALERT_LISTEN_HOST in statefulset-dolphinscheduler-worker.yaml	1 year ago
Aaron Wang	d6fcf60534	[Improvement-13751][Worker] Support real-time pod log collection (#13752 ) * Support real-time pod log collection * datax task test have to mock ShellCommandExecutor with whole dependencies * replace \n with EMPTY_STRING * modify error log msg * Update dolphinscheduler-task-plugin/dolphinscheduler-task-api/src/main/java/org/apache/dolphinscheduler/plugin/task/api/AbstractCommandExecutor.java Co-authored-by: caishunfeng <caishunfeng2021@gmail.com> * throw exception in pod log collection thread --------- Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>	1 year ago
Wenjun Ruan	64833952fc	Remove the extra default tenant in workflow save page (#13867 )	1 year ago
Wenjun Ruan	9df89cf0cf	Use bootstrap user as the default tenant (#13825 )	1 year ago
Wenjun Ruan	68660ec96b	Refactor remote command (#13809 ) * Refactor remote command * Rename Command to Message	1 year ago
Wenjun Ruan	d1b6e6f02c	Take over task instance in master failover (#13798 )	1 year ago
Wenjun Ruan	1f365819a6	Ignore unknown VM options in start.sh (#13719 )	1 year ago
Wenjun Ruan	aef5524ee7	Clearer task runnable. (#13689 ) * Clean unused method in AbstractTask * Kill task by process.destroy * wait 5/s after destroy process	1 year ago
Wenjun Ruan	c9066e8de9	Use MDC to filter task instance log (#13673 ) * Use MDC to collect task instance log * Use MDCAutoClosableContext to remove the MDC key	1 year ago
Wenjun Ruan	ca9df868f1	Fix task instance log order might be wrong due to async print (#13660 )	1 year ago
fuchanghai	7bf3e3cdd6	[improve-#13201] update pid during running (#13206 )	1 year ago
Aaron Wang	047fa2f65e	[Feature-13511] Submit Spark task directly on Kubernetes (#13550 )	1 year ago
Rick Cheng	2bd65fb2df	[Feature][Remote Logging] Add support for writing task logs to OSS (#13332 )	1 year ago
seedscoder	8d12dc0702	[Improvement-13491] Use lombok @Slf4j annotation to generate logger (#13509 )	1 year ago
Wenjun Ruan	45694aa697	Fix MessageSender may be null due to class initialize late (#13446 )	1 year ago
hokie-chan	3b980cb06a	[fix][worker][bug] master/worker crash when registry recover from SUSPENDED to RECONNECTED (#13328 )	2 years ago
Aaron Wang	ccad56e88e	[Improvement][Master] Validate same content of input file when using task cache (#13298 ) * support file content checksum * fix inject null storageOperate bug	2 years ago
Wenjun Ruan	14ec4a2398	Remove dao module in worker (#13242 )	2 years ago
Wenjun Ruan	70ccffeee2	Format task parameter as pretty json (#13173 )	2 years ago
Yann Ann	6ef74073cc	[Improve-13001]migrate commons-collections -> commons-collections4 (#13002 )	2 years ago
Wenjun Ruan	ffc9fb280a	Add gc timestampt (#13059 )	2 years ago
Wenjun Ruan	32a8241ef2	Don't source env file in task, this will override tenant's environment (#13028 )	2 years ago
Yann Ann	3106054ea7	[Improvement-12907] Change heartbeat log level to debug (#12980 )	2 years ago
rickchengx	38b876733c	[Feature-10498] Mask the password in the log of sqoop task (#11589 )	2 years ago
John Bampton	27c37b8828	Fix grammar and spelling (#12937 )	2 years ago
Kerwin	401fb4edd4	Fix execute shell task exception no dolphinscheduler_env.sh file execute permission (#12909 )	2 years ago
Wenjun Ruan	403c6a6bb6	Fix memory leak in worker due to message retry map (#12878 )	2 years ago
JieguangZhou	a47b4d0672	[Feature][Task] Transfer files between tasks (#12552 ) * add data transfer between tasks * add delete DATA_TRANSFER API * convert Result to DeleteDataTransferResponse * add api UT * fix final * fix doc	2 years ago
Aaron Wang	08335b1032	[Improvement][Task] Improved way to collect yarn job's appIds (#12197 ) * Provide aop way as an optional way to collect yarn job's applicationId, and import new module `dolphinscheduler-aop` to place the aop code. * Add user property `appId.collect` for user to decide how to collect applicationId. * Add new environment configuration for each type of yarn tasks to support aop in `dolphinscheduler_env.sh` * Update docs to declare how to use aop way. * Update `LogUtils` to support fetch applicationId in different ways based on the user property. Co-authored-by: gabrywu <gabrywu@apache.com>	2 years ago
kezhenxu94	065d5caccc	Only expose necessary actuator endpoints (#12571 )	2 years ago
HanayoZz	489e7fe4e2	[Feature-10495][Resource Center] Resource Center Refactor (#12076 ) * resource center refactor - S3 services connection Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>	2 years ago
Wenjun Ruan	76a9e6d8a6	Add task executor threads full policy config in worker (#12510 )	2 years ago
Wenjun Ruan	a0d37fc7ae	Set tenantDir permission (#12486 )	2 years ago
caishunfeng	dedff70f90	[Improvement] Merge spi.utils into common.utils (#12502 ) * improve JSONUtil * merge spi.utils into common.utils * split constants && remove some copy utils method * remove StringUtils	2 years ago
fuchanghai	f0a34cddec	[improvement-#12416] Use CollectionUtils.isEmpty judge the collection isEmpty to avoid NPE (#12449 )	2 years ago
Eric Gao	d46e4659d9	[Improvement][Style] Fix remaining style errors and wildcard imports (#12412 ) * Fix remaining style errors and wildcard imports * Upgrade spotless to the latest stable version, exclude .github folder from spotless check and fix dead link * Fix spotless matching scope of markdown files	2 years ago
kezhenxu94	4ea7eec750	Use temurin Java docker images instead of deprecated ones (#12334 )	2 years ago
Yann Ann	bc80f34056	[Migrate][Test] Migrate all UT cases from jUnit 4 to 5 in master, worker, and remote modules (#12362 ) * migrate junit4 -> junit5 in master, worker, and remote modules	2 years ago
Eric Gao	2f37da0dbc	[Improvement][Test] Block the usage of powermock and move mockito dependencies from sub-modules to root pom (#12311 ) * move mockito dependencies from sub-modules to root pom * Add check in CI to block the usage of powermock	2 years ago

1 2 3

145 Commits (5c4ba4105ded04a61264044c5aa192bd78700165)