wind
6cf3328be1
[DS-6582][Master] fix condition task state ( #6583 )
...
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
lenboo
fcfcedea0a
[maven-release-plugin] prepare release 2.0.0-alpha
3 years ago
lenboo
c82d908690
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
c644f8608f
[maven-release-plugin] prepare release 2.0.0-alpha
3 years ago
Kirs
38fb2b4413
[fix-6570][task] add sql task udf resource load ( #6570 ) ( #6571 ) ( #6579 )
...
* [fix-6570][task] add sql task udf resource load (#6570 )
-add sql task udf resource load
-Fix UdfFuncRequest serialization
* fix checkstyle
* add defaultFS in sqlTaskContext
* fix checkstyle
Co-authored-by: mask <39329477+Narcasserun@users.noreply.github.com>
3 years ago
lenboo
f77efc551f
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
d6b32fecb7
[maven-release-plugin] prepare release 2.0.0-alpha
3 years ago
lenboo
d1ef024db1
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
2ab404e25b
[maven-release-plugin] prepare release 2.0.0-alpha
3 years ago
lenboo
a729c82974
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
1ac362463e
[maven-release-plugin] prepare release 2.0.0-alpha
3 years ago
lenboo
81b13533a6
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
b94735c3b7
[maven-release-plugin] prepare release 2.0.0-alpha
3 years ago
Kirs
4723d64d56
[Task]fix business log using error ( #6538 )
3 years ago
OS
6fe27389d9
[BUG-6543][Master] process instance state is always running when failure task ( #6547 ) ( #6548 )
...
* fix-6543: process instance state is always running when failure task exists
* code style
* code style
3 years ago
Jiajie Zhong
5f19d5be41
Fix install.sh for DS 2.0 and add comment to install_config.conf ( #6506 ) ( #6525 )
...
* Fix install.sh for DS 2.0
* Use #* make it work in macos
* Add comment for properties change
* Add JAVA HOME for only one file change to deploy
* Reduce config change by using default value of: plugin registry, alert, task as
* Change javaHome default value
* Delete config param zkQuorum
* Reorder param
* Add comment for install_config.conf
3 years ago
Kirs
1fd12a59b1
[DS-6499][WorkerServer] report busy state when worker is overload ( #6512 ) ( #6518 )
...
* [DS-6499][WorkerServer] report busy state when worker is overload
Co-authored-by: wind <caishunfeng@users.noreply.github.com>
3 years ago
OS
6ffd019683
[cherry-pick][6471-6502]cherry-pick 6471 && 6502 to 2.0-prepare ( #6508 )
3 years ago
Kirs
cbc457b1a7
[Improvement-6474] [MasterServer] schedule time for process instance optimization ( #6477 ) ( #6496 )
...
* [DS-6474][MasterServer] change to handle schedule time for process instance in WorkflowExecuteThread
* delete all the valid tasks when complement data if id is not null
* checkstyle
Co-authored-by: caishunfeng <534328519@qq.com>
Co-authored-by: wind <caishunfeng@users.noreply.github.com>
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
OS
c99ad738c0
[Bug-6455][Master]fix bug 6455: cannot stop sub-task ( #6458 )
...
* fix bug: cannot stop the task.
* fix bug: cannot stop the task.
* remove the check thread number
3 years ago
Kirs
ea2a8d26a0
[Improvement#6438][Worker]remove meaningless DB query ( #6440 )
...
org.apache.dolphinscheduler.server.worker.runner.TaskExecuteThread
In the process of task kill, it will query the DB to obtain the task instance object, but this judgment does not make any sense. In fact, the relevant context is already clear, so there is no need to query from DB.
3 years ago
百岁
d284e44d52
Rename tis to pigeon from backend layer ( #6437 )
...
* add mock getTaskLogName() for UT test pass
* make task-tis rename to task-pigeon
* rename module name 'tis' to pigeon
* rename module name 'tis' to pigeon,make sanity check pass
* remove execute console.log()
3 years ago
Shukun Zhang
6e453de241
[Feature] workflow level task dry run ( #6104 )
...
* feat workflow level task dry run
* feat workflow level task dry run
* feat workflow level task dry run
* feat workflow level task dry run
* feat workflow level task dry run
* feat workflow level task dry run
* feat workflow level task dry run
* feat workflow level task dry run
* feat workflow level task dry run
* feat workflow level task dry run
3 years ago
caishunfeng
ea6503b997
[DS-6403][fix] Put DB queries ahead before submit to TaskPriorityQueue ( #6406 )
...
* [DS-6403][fix] Put DB queries ahead before submit to TaskPriorityQueue
* [DS-6403][fix] Put DB queries ahead before submit to TaskPriorityQueue
* [DS-6403][fix] Put DB queries ahead before submit to TaskPriorityQueue
* checkstyle
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
RichardStark
d184ebda1e
issue-6298-added-the-task-plugin ( #6299 )
3 years ago
OS
c013b49e72
[Fix-6347][Master-API]fix bug #6347 the first schedule_time is error in complement data ( #6389 )
...
* fix bug #6347 complement data errors
3 years ago
Kirs
67508d8d1b
update project version to 2.0.0-SNAPSHOT ( #6383 )
3 years ago
caishunfeng
67094d0f7f
[BUG-6353][MasterServer] fix event handle slowly ( #6375 )
...
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
Wenjun Ruan
ebb56b2620
fix dead loop in StateEventResponseWorker ( #6281 )
3 years ago
OS
20a3741b24
fix bug #6347 the first schedule_time is error in complement data ( #6351 )
3 years ago
jon-qj
dee191f2bb
provide the default value(task.plugin.dir) ( #6340 )
3 years ago
Kirs
be158328fb
[Bug #6306 ][Worker] task log path generated error. ( #6338 )
3 years ago
caishunfeng
89cc045961
[DS-6323][fix] EventExecuteService run loop without sleep which make cpu high ( #6324 )
...
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
RichardStark
c855a5926c
fix-6316 ( #6317 )
3 years ago
Kirs
552fd17878
[Plugin][Task]Fix Yarn Task Kill Not valid ( #6293 )
3 years ago
OS
b71967b017
fix bug-6279 Parallel tasks would be Irregularly submitted twice ( #6280 )
3 years ago
RichardStark
7098855ee0
restored install.sh ( #6257 )
...
* restored install.sh
* install.sh +x
3 years ago
Kirs
fab4eae923
[SPI][Task]fix Task parse Err ( #6244 )
...
* [SPI][Task]fix Task parse Err
3 years ago
Kirs
fced3892ee
[Fix][Task] Wrong complement date ( #6009 ) ( #6186 )
...
* [Fix][Task] Wrong complement date (#6009 )
3 years ago
Kirs
b90152fc2e
[SPI][Task]add SQL Task ( #6237 )
...
Add Sql Task And Fix Task Parse Err
3 years ago
Kirs
fa0b86ac82
[Fix][Registry]server listener err ( #6232 )
...
* [Fix][Registry]server listener err
3 years ago
JinyLeeChina
71e2c8808b
[Fix-6194] [Server] fix master buildFlowDag error ( #6195 )
...
* fix bug of view-tree api
* fix bug of view-tree api
* fix ut
* fix ut
* fix master buildFlowDag error
Co-authored-by: JinyLeeChina <297062848@qq.com>
3 years ago
Kirs
7029062f4c
[Improvement][Task]Check the task plugin configuration when the worke… ( #6184 )
...
* [Improvement][Task]Check the task plugin configuration when the worker starts
3 years ago
Jiajie Zhong
170280fab2
Simplify constants variables ( #6183 )
...
* Combine `alter` and `registry` properties,
bese on https://github.com/apache/dolphinscheduler/pull/6180
* Remove duplicate variable `SLASH` and `SINGLE_SLASH`
3 years ago
kezhenxu94
ea2a9dbcb2
Clean up third-party files that are not mentioned in LICENSE ( #6165 )
3 years ago
Kerwin
f75b5be28f
fix master server task execute processor register. ( #6162 )
3 years ago
kezhenxu94
a632be73c0
Clean up unused util classes... ( #6154 )
3 years ago
Kerwin
bcb1ccba6f
[Bug][sql] fix mysql create sentence bug ( #6148 )
...
* fix mysql error.
3 years ago
CalvinKirs
ac8fafa343
fix code style
3 years ago
CalvinKirs
2dd5279388
Merge remote-tracking branch 'upstream/dev' into task-end
...
# Conflicts:
# .asf.yaml
# dolphinscheduler-alert/src/main/java/org/apache/dolphinscheduler/alert/utils/FuncUtils.java
# dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/controller/ExecutorController.java
# dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/controller/SchedulerController.java
# dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ExecutorServiceImpl.java
# dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ProcessInstanceServiceImpl.java
# dolphinscheduler-api/src/test/java/org/apache/dolphinscheduler/api/controller/AlertGroupControllerTest.java
# dolphinscheduler-api/src/test/java/org/apache/dolphinscheduler/api/service/ExecutorService2Test.java
# dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/Constants.java
# dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/enums/StateEventType.java
# dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/entity/Command.java
# dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/entity/ErrorCommand.java
# dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/entity/ProcessInstance.java
# dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/entity/TaskDefinition.java
# dolphinscheduler-dao/src/main/resources/org/apache/dolphinscheduler/dao/mapper/ScheduleMapper.xml
# dolphinscheduler-dao/src/main/resources/org/apache/dolphinscheduler/dao/mapper/TaskDefinitionLogMapper.xml
# dolphinscheduler-dao/src/main/resources/org/apache/dolphinscheduler/dao/mapper/TaskDefinitionMapper.xml
# dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/master/runner/ConditionsTaskExecThread.java
# dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/master/runner/DependentTaskExecThread.java
# dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/master/runner/WorkflowExecuteThread.java
# dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/master/runner/task/CommonTaskProcessor.java
# dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/master/runner/task/ConditionTaskProcessor.java
# dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/master/runner/task/DependentTaskProcessor.java
# dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/WorkerServer.java
# dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/runner/ConditionsTaskExecThread.java
# dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/runner/DependentTaskExecThread.java
# dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/runner/MasterBaseTaskExecThread.java
# dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/runner/MasterTaskExecThread.java
# dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/runner/SubProcessTaskExecThread.java
# dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/runner/TaskExecuteThread.java
# dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/runner/WorkerManagerThread.java
# dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/task/python/PythonTask.java
# dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/task/sql/SqlTask.java
# dolphinscheduler-server/src/test/java/org/apache/dolphinscheduler/server/master/WorkflowExecuteThreadTest.java
# dolphinscheduler-server/src/test/java/org/apache/dolphinscheduler/server/worker/processor/TaskKillProcessorTest.java
# dolphinscheduler-server/src/test/java/org/apache/dolphinscheduler/server/worker/runner/TaskExecuteThreadTest.java
# dolphinscheduler-server/src/test/java/org/apache/dolphinscheduler/server/worker/runner/WorkerManagerThreadTest.java
# dolphinscheduler-server/src/test/java/org/apache/dolphinscheduler/server/worker/task/PythonCommandExecutorTest.java
# dolphinscheduler-server/src/test/java/org/apache/dolphinscheduler/server/worker/task/http/HttpTaskTest.java
# dolphinscheduler-server/src/test/java/org/apache/dolphinscheduler/server/worker/task/sql/SqlTaskTest.java
# dolphinscheduler-service/src/main/java/org/apache/dolphinscheduler/service/process/ProcessService.java
# dolphinscheduler-service/src/main/java/org/apache/dolphinscheduler/service/quartz/cron/CronUtils.java
# dolphinscheduler-service/src/test/java/org/apache/dolphinscheduler/service/process/ProcessServiceTest.java
# dolphinscheduler-spi/src/main/java/org/apache/dolphinscheduler/spi/DolphinSchedulerPlugin.java
# dolphinscheduler-standalone-server/pom.xml
# dolphinscheduler-standalone-server/src/main/java/org/apache/dolphinscheduler/server/StandaloneServer.java
# dolphinscheduler-task-plugin/dolphinscheduler-task-api/src/main/java/org/apache/dolphinscheduler/plugin/task/api/ShellCommandExecutor.java
# dolphinscheduler-task-plugin/dolphinscheduler-task-procedure/src/main/java/org/apache/dolphinscheduler/plugin/task/procedure/ProcedureTaskChannelFactory.java
# dolphinscheduler-task-plugin/dolphinscheduler-task-python/src/main/java/org/apache/dolphinscheduler/plugin/task/python/PythonCommandExecutor.java
# dolphinscheduler-task-plugin/dolphinscheduler-task-shell/src/main/java/org/apache/dolphinscheduler/plugin/task/shell/ShellTask.java
# dolphinscheduler-task-plugin/dolphinscheduler-task-spark/src/main/java/org/apache/dolphinscheduler/plugin/task/spark/SparkTask.java
# dolphinscheduler-task-plugin/dolphinscheduler-task-sqoop/src/main/java/org/apache/dolphinscheduler/plugin/task/sqoop/SqoopTask.java
# dolphinscheduler-ui/package.json
# dolphinscheduler-ui/src/js/conf/home/pages/dag/_source/dag.scss
# dolphinscheduler-ui/src/js/conf/home/pages/dag/_source/dag.vue
# dolphinscheduler-ui/src/js/conf/home/pages/dag/_source/formModel/formModel.vue
# sql/dolphinscheduler_h2.sql
3 years ago