DolphinScheduler

Commit Graph

Author	SHA1	Message	Date
kezhenxu94	5400abc74f	Refactor registry plugin and simplify its usage (#6712 )	3 years ago
Yao WANG	73f20b7553	[Fix-#6641]fix npe when the LowerWeightHostManager can not get the workNodeInfo (#6656 ) * change the return type of getHostWeight Co-authored-by: ywang46 <ywang46@paypal.com>	3 years ago
wind	72daba58cd	[DS-6694][Master] Reduce the refresh resource interval of LowerWeight (#6695 ) * [DS-6694][Master] Reduce the refresh resource interval of LowerWeight * add server node update event handle Co-authored-by: caishunfeng <534328519@qq.com>	3 years ago
wangxj3	dc8b87e473	[Feature-#6268][server-master] Serial execte process (#6185 ) * add serial processInstance * fix bug * add test * fix code style * fix style code * add sql * fix sql error * add api * add test * fix code style * modify api * delete column , fix mapper * fix unimport * fix test * fix bug of missing param for Python * fix code style * fix test * fix test Co-authored-by: wangxj <wangxj31>	3 years ago
xuhhui	2b90d90873	improve install_config.conf description (#6681 ) * improve install_config.conf description * Update install_config.conf update accroding review ideas	3 years ago
wind	ae0b18f3a3	[DS-6638][MasterServer] fix task state no change when failover worker (#6639 ) Co-authored-by: caishunfeng <534328519@qq.com>	3 years ago
wind	8850baff07	[DS-6640][WorkerServer] support process update host command type (#6642 ) Co-authored-by: caishunfeng <534328519@qq.com>	3 years ago
wind	06e8e24708	[DS-6616][WorkerServer] fix worker stop fail and fakes death (#6621 ) * [DS-6616][WorkerServer] fix worker stop fail and fakes death * remove unuse test * just add try catch to remove zk worker path Co-authored-by: caishunfeng <534328519@qq.com>	3 years ago
wind	b642e9ca54	[DS-6582][Master] fix condition task state (#6583 ) Co-authored-by: caishunfeng <534328519@qq.com>	3 years ago
mask	9b1984c244	[fix-6570][task] add sql task udf resource load (#6570 ) (#6571 ) * [fix-6570][task] add sql task udf resource load (#6570) -add sql task udf resource load -Fix UdfFuncRequest serialization * fix checkstyle * add defaultFS in sqlTaskContext * fix checkstyle	3 years ago
ououtt	a3982f5025	[Improvement-6540][server] Optimize the code related to the processInstanceExecMaps object (#6556 ) * [DS-6540][refactor-server] Optimize the code related to the processInstanceExecMaps object	3 years ago
Kirs	de61d65af2	[Task]fix business log using error (#6538 )	3 years ago
OS	52a550b6ae	[BUG-6543][Master] process instance state is always running when failure task (#6547 ) * fix-6543: process instance state is always running when failure task exists * code style * code style	3 years ago
Jiajie Zhong	6495a204f3	Fix install.sh for DS 2.0 and add comment to install_config.conf (#6506 ) * Fix install.sh for DS 2.0 * Use #* make it work in macos * Add comment for properties change * Add JAVA HOME for only one file change to deploy * Reduce config change by using default value of: plugin registry, alert, task as * Change javaHome default value * Delete config param zkQuorum * Reorder param * Add comment for install_config.conf	3 years ago
wind	50f1766903	[DS-6499][WorkerServer] report busy state when worker is overload (#6512 ) * [DS-6499][WorkerServer] report busy state when worker is overload	3 years ago
OS	db04a5b04d	[Feature-6471]Cache Process definition in master (#6485 ) * feature-6471 Cache Process definition in master	3 years ago
wind	e091801e05	[Improvement-6474] [MasterServer] schedule time for process instance optimization (#6477 ) * [DS-6474][MasterServer] change to handle schedule time for process instance in WorkflowExecuteThread * delete all the valid tasks when complement data if id is not null * checkstyle Co-authored-by: caishunfeng <534328519@qq.com>	3 years ago
OS	a8baa9553f	[Bug-6455][Master]fix bug 6455: cannot stop sub-task (#6458 ) * fix bug: cannot stop the task. * fix bug: cannot stop the task. * remove the check thread number	3 years ago
Hua Jiang	fac6b4afd3	[Fix-5875][API] When I saved the task that had the same name task in another flow ,the service would throw DuplicateKeyException (#6430 ) * using the task code in the dag	3 years ago
Kirs	ea2a8d26a0	[Improvement#6438][Worker]remove meaningless DB query (#6440 ) org.apache.dolphinscheduler.server.worker.runner.TaskExecuteThread In the process of task kill, it will query the DB to obtain the task instance object, but this judgment does not make any sense. In fact, the relevant context is already clear, so there is no need to query from DB.	3 years ago
百岁	d284e44d52	Rename tis to pigeon from backend layer (#6437 ) * add mock getTaskLogName() for UT test pass * make task-tis rename to task-pigeon * rename module name 'tis' to pigeon * rename module name 'tis' to pigeon,make sanity check pass * remove execute console.log()	3 years ago
Shukun Zhang	6e453de241	[Feature] workflow level task dry run (#6104 ) * feat workflow level task dry run * feat workflow level task dry run * feat workflow level task dry run * feat workflow level task dry run * feat workflow level task dry run * feat workflow level task dry run * feat workflow level task dry run * feat workflow level task dry run * feat workflow level task dry run * feat workflow level task dry run	3 years ago
caishunfeng	ea6503b997	[DS-6403][fix] Put DB queries ahead before submit to TaskPriorityQueue (#6406 ) * [DS-6403][fix] Put DB queries ahead before submit to TaskPriorityQueue * [DS-6403][fix] Put DB queries ahead before submit to TaskPriorityQueue * [DS-6403][fix] Put DB queries ahead before submit to TaskPriorityQueue * checkstyle Co-authored-by: caishunfeng <534328519@qq.com>	3 years ago
RichardStark	d184ebda1e	issue-6298-added-the-task-plugin (#6299 )	3 years ago
OS	c013b49e72	[Fix-6347][Master-API]fix bug #6347 the first schedule_time is error in complement data (#6389 ) * fix bug #6347 complement data errors	3 years ago
Kirs	67508d8d1b	update project version to 2.0.0-SNAPSHOT (#6383 )	3 years ago
caishunfeng	67094d0f7f	[BUG-6353][MasterServer] fix event handle slowly (#6375 ) Co-authored-by: caishunfeng <534328519@qq.com>	3 years ago
Wenjun Ruan	ebb56b2620	fix dead loop in StateEventResponseWorker (#6281 )	3 years ago
OS	20a3741b24	fix bug #6347 the first schedule_time is error in complement data (#6351 )	3 years ago
jon-qj	dee191f2bb	provide the default value(task.plugin.dir) (#6340 )	3 years ago
Kirs	be158328fb	[Bug #6306 ][Worker] task log path generated error. (#6338 )	3 years ago
caishunfeng	89cc045961	[DS-6323][fix] EventExecuteService run loop without sleep which make cpu high (#6324 ) Co-authored-by: caishunfeng <534328519@qq.com>	3 years ago
RichardStark	c855a5926c	fix-6316 (#6317 )	3 years ago
Kirs	552fd17878	[Plugin][Task]Fix Yarn Task Kill Not valid (#6293 )	3 years ago
OS	b71967b017	fix bug-6279 Parallel tasks would be Irregularly submitted twice (#6280 )	3 years ago
RichardStark	7098855ee0	restored install.sh (#6257 ) * restored install.sh * install.sh +x	3 years ago
Kirs	fab4eae923	[SPI][Task]fix Task parse Err (#6244 ) * [SPI][Task]fix Task parse Err	3 years ago
Kirs	fced3892ee	[Fix][Task] Wrong complement date (#6009 ) (#6186 ) * [Fix][Task] Wrong complement date (#6009)	3 years ago
Kirs	b90152fc2e	[SPI][Task]add SQL Task (#6237 ) Add Sql Task And Fix Task Parse Err	3 years ago
Kirs	fa0b86ac82	[Fix][Registry]server listener err (#6232 ) * [Fix][Registry]server listener err	3 years ago
JinyLeeChina	71e2c8808b	[Fix-6194] [Server] fix master buildFlowDag error (#6195 ) * fix bug of view-tree api * fix bug of view-tree api * fix ut * fix ut * fix master buildFlowDag error Co-authored-by: JinyLeeChina <297062848@qq.com>	3 years ago
Kirs	7029062f4c	[Improvement][Task]Check the task plugin configuration when the worke… (#6184 ) * [Improvement][Task]Check the task plugin configuration when the worker starts	3 years ago
Jiajie Zhong	170280fab2	Simplify constants variables (#6183 ) * Combine `alter` and `registry` properties, bese on https://github.com/apache/dolphinscheduler/pull/6180 * Remove duplicate variable `SLASH` and `SINGLE_SLASH`	3 years ago
kezhenxu94	ea2a9dbcb2	Clean up third-party files that are not mentioned in LICENSE (#6165 )	3 years ago
Kerwin	f75b5be28f	fix master server task execute processor register. (#6162 )	3 years ago
kezhenxu94	a632be73c0	Clean up unused util classes... (#6154 )	3 years ago
Kerwin	bcb1ccba6f	[Bug][sql] fix mysql create sentence bug (#6148 ) * fix mysql error.	3 years ago
CalvinKirs	ac8fafa343	fix code style	3 years ago
CalvinKirs	2dd5279388	Merge remote-tracking branch 'upstream/dev' into task-end # Conflicts: # .asf.yaml # dolphinscheduler-alert/src/main/java/org/apache/dolphinscheduler/alert/utils/FuncUtils.java # dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/controller/ExecutorController.java # dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/controller/SchedulerController.java # dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ExecutorServiceImpl.java # dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ProcessInstanceServiceImpl.java # dolphinscheduler-api/src/test/java/org/apache/dolphinscheduler/api/controller/AlertGroupControllerTest.java # dolphinscheduler-api/src/test/java/org/apache/dolphinscheduler/api/service/ExecutorService2Test.java # dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/Constants.java # dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/enums/StateEventType.java # dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/entity/Command.java # dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/entity/ErrorCommand.java # dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/entity/ProcessInstance.java # dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/entity/TaskDefinition.java # dolphinscheduler-dao/src/main/resources/org/apache/dolphinscheduler/dao/mapper/ScheduleMapper.xml # dolphinscheduler-dao/src/main/resources/org/apache/dolphinscheduler/dao/mapper/TaskDefinitionLogMapper.xml # dolphinscheduler-dao/src/main/resources/org/apache/dolphinscheduler/dao/mapper/TaskDefinitionMapper.xml # dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/master/runner/ConditionsTaskExecThread.java # dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/master/runner/DependentTaskExecThread.java # dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/master/runner/WorkflowExecuteThread.java # dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/master/runner/task/CommonTaskProcessor.java # dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/master/runner/task/ConditionTaskProcessor.java # dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/master/runner/task/DependentTaskProcessor.java # dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/WorkerServer.java # dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/runner/ConditionsTaskExecThread.java # dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/runner/DependentTaskExecThread.java # dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/runner/MasterBaseTaskExecThread.java # dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/runner/MasterTaskExecThread.java # dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/runner/SubProcessTaskExecThread.java # dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/runner/TaskExecuteThread.java # dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/runner/WorkerManagerThread.java # dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/task/python/PythonTask.java # dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/task/sql/SqlTask.java # dolphinscheduler-server/src/test/java/org/apache/dolphinscheduler/server/master/WorkflowExecuteThreadTest.java # dolphinscheduler-server/src/test/java/org/apache/dolphinscheduler/server/worker/processor/TaskKillProcessorTest.java # dolphinscheduler-server/src/test/java/org/apache/dolphinscheduler/server/worker/runner/TaskExecuteThreadTest.java # dolphinscheduler-server/src/test/java/org/apache/dolphinscheduler/server/worker/runner/WorkerManagerThreadTest.java # dolphinscheduler-server/src/test/java/org/apache/dolphinscheduler/server/worker/task/PythonCommandExecutorTest.java # dolphinscheduler-server/src/test/java/org/apache/dolphinscheduler/server/worker/task/http/HttpTaskTest.java # dolphinscheduler-server/src/test/java/org/apache/dolphinscheduler/server/worker/task/sql/SqlTaskTest.java # dolphinscheduler-service/src/main/java/org/apache/dolphinscheduler/service/process/ProcessService.java # dolphinscheduler-service/src/main/java/org/apache/dolphinscheduler/service/quartz/cron/CronUtils.java # dolphinscheduler-service/src/test/java/org/apache/dolphinscheduler/service/process/ProcessServiceTest.java # dolphinscheduler-spi/src/main/java/org/apache/dolphinscheduler/spi/DolphinSchedulerPlugin.java # dolphinscheduler-standalone-server/pom.xml # dolphinscheduler-standalone-server/src/main/java/org/apache/dolphinscheduler/server/StandaloneServer.java # dolphinscheduler-task-plugin/dolphinscheduler-task-api/src/main/java/org/apache/dolphinscheduler/plugin/task/api/ShellCommandExecutor.java # dolphinscheduler-task-plugin/dolphinscheduler-task-procedure/src/main/java/org/apache/dolphinscheduler/plugin/task/procedure/ProcedureTaskChannelFactory.java # dolphinscheduler-task-plugin/dolphinscheduler-task-python/src/main/java/org/apache/dolphinscheduler/plugin/task/python/PythonCommandExecutor.java # dolphinscheduler-task-plugin/dolphinscheduler-task-shell/src/main/java/org/apache/dolphinscheduler/plugin/task/shell/ShellTask.java # dolphinscheduler-task-plugin/dolphinscheduler-task-spark/src/main/java/org/apache/dolphinscheduler/plugin/task/spark/SparkTask.java # dolphinscheduler-task-plugin/dolphinscheduler-task-sqoop/src/main/java/org/apache/dolphinscheduler/plugin/task/sqoop/SqoopTask.java # dolphinscheduler-ui/package.json # dolphinscheduler-ui/src/js/conf/home/pages/dag/_source/dag.scss # dolphinscheduler-ui/src/js/conf/home/pages/dag/_source/dag.vue # dolphinscheduler-ui/src/js/conf/home/pages/dag/_source/formModel/formModel.vue # sql/dolphinscheduler_h2.sql	3 years ago
Kerwin	18047881d5	fix task plugin shell exec (#6128 )	3 years ago

1 2 3 4 5 ...

737 Commits (02b2de2a1e3198b96eb5b6a4c42411ec265e1731)