* Fix install.sh for DS 2.0
* Use #* make it work in macos
* Add comment for properties change
* Add JAVA HOME for only one file change to deploy
* Reduce config change by using default value of: plugin registry, alert, task as
* Change javaHome default value
* Delete config param zkQuorum
* Reorder param
* Add comment for install_config.conf
* [DS-6474][MasterServer] change to handle schedule time for process instance in WorkflowExecuteThread
* delete all the valid tasks when complement data if id is not null
* checkstyle
Co-authored-by: caishunfeng <534328519@qq.com>
org.apache.dolphinscheduler.server.worker.runner.TaskExecuteThread
In the process of task kill, it will query the DB to obtain the task instance object, but this judgment does not make any sense. In fact, the relevant context is already clear, so there is no need to query from DB.
* add mock getTaskLogName() for UT test pass
* make task-tis rename to task-pigeon
* rename module name 'tis' to pigeon
* rename module name 'tis' to pigeon,make sanity check pass
* remove execute console.log()
* [DS-6403][fix] Put DB queries ahead before submit to TaskPriorityQueue
* [DS-6403][fix] Put DB queries ahead before submit to TaskPriorityQueue
* [DS-6403][fix] Put DB queries ahead before submit to TaskPriorityQueue
* checkstyle
Co-authored-by: caishunfeng <534328519@qq.com>
* fix bug of view-tree api
* fix bug of view-tree api
* fix ut
* fix ut
* fix master buildFlowDag error
Co-authored-by: JinyLeeChina <297062848@qq.com>
)
* Fix unchecked type conversions
* Use indentation level reported by checkstyle
* Reorganize CI workflows to fasten the wasted time and resources (#6011
An error occurred
)
* Add standalone server module to make it easier to develop (#6022
)
* [Improvement][Api Module]split alert group list-paging interface
* [FIX-#6007]Wrong complement date (#6026
An error occurred
)
* [FIX-#6007]Wrong complement date
* [style]Wrong complement date
* [Improvement-6024][dist] Remove useless packaging commands (#6029
An error occurred
)
·Remove useless packaging commands in dolphinscheduler-bin.xml
This closes#6024
An error occurred
Co-authored-by: mask <liuhu@zhiyoutec.com>
* [FIX-5908][MasterServer] When executing an compensation task, the execution thread would have a NPE (#5909
An error occurred
)
* fix the npe in MasterExec
* fix the compile error
* Add `.asf.yaml` to easily set the GitHub metadata (#6035
)
* Fix inefficient map iterator
* Use forEach and remove call to valueOf
* Modify AbstractParameters
* Enhance `StandaloneServer` so that we don't need to update the version number manually (#6074
An error occurred
)
* Remove invalid character in `.asf.yaml` (#6075
An error occurred
)
* Remove invalid character `\n` in `.asf.yaml` (#6077
An error occurred
)
It turns out that the invalid character is `\n`
* Add alert server into standalone-server as well and some minor polish (#6087
An error occurred
)
* Support starting standalone server in Docker image (#6102
An error occurred
)
Also remove unused class
* [Feature-4355][Master-Worker-API] improvements of master and scheduler module (#6095
An error occurred
)
* [Feature-4355][Master-Worker-API] improvements of master and scheduler module (#6085
An error occurred
)
* master refactor:
1. spi for task submit and other actions(pause, kill)
2. remove threads for process instance and task instance.
3. add events for process instance and task instance
* ut npe
* add try catch
* code style
* fix critical bugs
* fix critical bugs
* fix critical bugs
* fix critical bugs
* Remove unused params in SwitchTaskTest (#6109
An error occurred
)
* [Feature-5987][Server] Support to set multiple environment configs for a certain worker. (#6082
An error occurred
)
* support multi environments
* add some test cases
* add an environment vue component
* improve environment form
* improve environment form
* add environment worker group relation
* add environment worker group relation
* add the environment choice for formModel
* set an environment for the task
* modify the modal form of starting process
* add the environment config to TaskExecutionContext
* add the environment config to the timing form
* fix conflicts
* fix issues of the code style
* fix some issues of the code style
* fix some issues of the code style
* fix some issues of the code style
* fix some issues of the code style
* fix some issues of the code style
* fix some bugs in the code review
* add the same table and columns to support H2
* fix some bugs
* [Plugin][Task]Task Spi
* [Plugin][Task]Task Spi
* [Plugin][Task]Task Spi
* [Plugin][Task]Task Spi
* [Plugin][Task]Task Spi
* [Plugin][Task]Task Spi
Co-authored-by: didiaode18 <563646039@qq.com>
Co-authored-by: Roy <yongjuncao1213@gmail.com>
Co-authored-by: lyxell <alyxell@kth.se>
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
Co-authored-by: myangle1120 <942542838@qq.com>
Co-authored-by: wangxj3 <857234426@qq.com>
Co-authored-by: gabry.wu <gabrywu@apache.org>
Co-authored-by: shaojwu <shaojwu@ebay.com>
Co-authored-by: Shukun Zhang <60541766+andream7@users.noreply.github.com>
Co-authored-by: linquan <1175687813@qq.com>
Co-authored-by: mask <39329477+Narcasserun@users.noreply.github.com>
Co-authored-by: mask <liuhu@zhiyoutec.com>
Co-authored-by: kyoty <echohlne@gmail.com>
Co-authored-by: RichardStark <49977764+RichardStark@users.noreply.github.com>
Co-authored-by: David <dailidong66@gmail.com>
Co-authored-by: lenboo <baoliang.leon@gmail.com>
Co-authored-by: lilyzhou <lj_zhou@outlook.com>
Co-authored-by: OS <29528966+lenboo@users.noreply.github.com>
Co-authored-by: junfan.zhang <zuston.shacha@gmail.com>
Co-authored-by: Hua Jiang <jianghuachinacom@163.com>
* [BUG-#5678][Registry]fix registry init node miss (#5686
An error occurred
)
* [Improvement][UI] Update the update time after the user information is successfully modified (#5684
An error occurred
)
* improve
edit the userinfo success, but the updatetime is not the latest.
* Improved shell task execution result log information, adding process.waitFor() and process.exitValue() information to the original log (#5691
An error occurred
)
Co-authored-by: shenglm <shenglm840722@126.com>
* [Feature-#5565][Master Worker-Server] Global Param passed by sense dependencies (#5603
An error occurred
)
* add globalParams new plan with varPool
* add unit test
* add python task varPoolParams
Co-authored-by: wangxj <wangxj31>
* Issue robot translation judgment changed to Chinese (#5694
An error occurred
)
Co-authored-by: chenxingchun <438044805@qq.com>
* the update function should use post instead of get (#5703
)
Co-authored-by: wangxj <wangxj31>
* [Fix-5738][UI] The cancel button in the pop-up dialog of `batch copy` and `batch move` doesn't work. (#5739
An error occurred
)
* Update relatedItems.vue
* Update relatedItems.vue
* [Improvement#5741][Worker] Improve task process status log (#5776
An error occurred
)
* [Improvement-5773][server] need to support two parameters related to task (#5774
An error occurred
)
* add some new parameter for task
* restore official properties
* improve imports
* modify a variable's name
Co-authored-by: jiang hua <jiang.hua@zhaopin.com.cn>
* [FIX-5786][Improvement][Server] When the Worker turns down, the MasterServer cannot handle the Remove event correctly and throws NPE
* [Improvement][Worker] Task log may be lost #5775
][CheckStyle] upgrade checkstyle file
Upgrade checkstyle.xml to support checkstyle version 8.24+
* change ci checkstyle version
* [Fix-5795][Improvement][Server] The starttime field in the HttpTask log is not displayed as expected. (#5796
An error occurred
)
* improve timestamp format
make the startime in the log of httptask to be easier to read.
* fix bad code smell and update the note.
* [Imporvement #5621
)
Co-authored-by: wen-hemin <wenhemin@apache.com>
* [Improvement][SPI] support load single plugin (#5794
An error occurred
)
change load operation of 'registry.plugin.dir'
* [Improvement][Api Module] refactor registry client, remove spring annotation (#5814
An error occurred
)
* fix: refactor registry client, remove spring annotation
* fix UT
* fix UT
* fix checkstyle
* fix UT
* fix UT
* fix UT
* fix: Rename RegistryCenterUtils method name
Co-authored-by: wen-hemin <wenhemin@apache.com>
* [Fix-5699][UI] Fix update user error in user information introduced by #5700
)
Co-authored-by: wanggang <wanggy01@servyou.com.cn>
* [Fix-5719][K8s] Fix Ingress tls: got map expected array On TLS enabled On Kubernetes
[Fix-5719][K8s] Fix Ingress tls: got map expected array On TLS enabled On Kubernetes
* [Fix-5825][BUG][WEB] the resource tree in the process definition of latest dev branch can't display correctly (#5826
An error occurred
)
* resoures-shows-error
* fix codestyle error
* add license header for new js
* fix codesmell
* [Improvement-5852][server] Support two parameters related to task for the rest of type of tasks. (#5867
An error occurred
)
* provide two system parameters to support the rest of type of tasks
* provide two system parameters to support the rest of type of tasks
* improve test conversion
* [Improvement][Fix-5769][UI]When we try to delete the existing dag, the console in web browser would shows exception (#5770
An error occurred
)
* fix bug
* cache the this variable
* Avoid self name
* fix code style compile error
* [Fix-5781][UT] Fix test coverage in sonar (#5817
An error occurred
)
* build(UT): make jacoco running in offline-instrumentation
issue: #5781
An error occurred
* build(UT): remove the jacoco agent dependency in microbench
issue: #5781
An error occurred
* [Fix-5808][Server] When we try to transfer data using datax between different types of data sources, the worker will exit with ClassCastException (#5809
An error occurred
)
* bug fix
* fix bug
* simplify the code format
* add a new parameter to make it easier to understand.
* [Fix-5830][Improvement][UI] Improve the selection style in dag edit dialog (#5829
An error occurred
)
* improve the selection style
* update another file
* remove unnecessary css part.
* [Fix-5904][upgrade]fix dev branch upgrade mysql sql script error (#5821
An error occurred
)
* fix dev branch upgrade mysql sql script error.
* Update naming convention.
* [Improvement][Api Module] refactor DataSourceParam and DependentParam, remove spring annotation (#5832
An error occurred
)
* fix: refactor api utils class, remove spring annotation.
* fix: Optimization comments
Co-authored-by: wen-hemin <wenhemin@apache.com>
* correct the wrong annotion from zk queue implemented to java priority blocking queue (#5906
An error occurred
)
Co-authored-by: ywang46 <ywang46@paypal.com>
* Add a Gitter chat badge to README.md (#5883
An error occurred
)
* Add Gitter badge
* Update README.md
Co-authored-by: David <dailidong66@gmail.com>
* ci: improve maven connection in CI builds (#5924
)
* Add:Name verification remove the first and last spaces.
* Update: wrong word: 'WAITTING' ->'WAITING'
* Add: Strengthen verification
Co-authored-by: Squid <2824638304@qq.com>
* [Improvement-5880][api] Optimized data structure of pagination query API results (#5895
An error occurred
)
* [5880][refactor]Optimized data structure of pagination query API results
- refactor PageInfo and delete returnDataListPaging in API
- modify the related Controller and Service and the corresponding Test
* Merge branch 'dev' of github.com:apache/dolphinscheduler into dev
Conflicts:
dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ProcessDefinitionServiceImpl.java
Co-authored-by: 蔡泽华 <sorea1k@163.com>
* [IMPROVEMENT]fix mysql comment error (#5959
)
·the list of workflow instances is sorted by start time and end time
·This closes#5621
An error occurred
* [FIX-5975]queryLastRunningProcess sql in ProcessInstanceMapper.xml (#5980
An error occurred
)
* [NEW FEATURE][FIX-4385] compensation task add the ability to configure parallelism (#5912
An error occurred
)
* update
* web improved
* improve the ui
* add the ability to configure the parallelism
* update variables
* enhance the ut and add necessary note
* fix code style
* fix code style issue
* ensure the complation task in parallel mode can run the right numbers of tasks.
* [Improvement][dao]When I search for the keyword description, the web UI shows empty (#5952
)
* Fix unchecked type conversions
* Use indentation level reported by checkstyle
* Reorganize CI workflows to fasten the wasted time and resources (#6011
An error occurred
)
* Add standalone server module to make it easier to develop (#6022
)
* [Improvement][Api Module]split alert group list-paging interface
* [FIX-#6007]Wrong complement date (#6026
An error occurred
)
* [FIX-#6007]Wrong complement date
* [style]Wrong complement date
* [Improvement-6024][dist] Remove useless packaging commands (#6029
An error occurred
)
·Remove useless packaging commands in dolphinscheduler-bin.xml
This closes#6024
An error occurred
Co-authored-by: mask <liuhu@zhiyoutec.com>
* [FIX-5908][MasterServer] When executing an compensation task, the execution thread would have a NPE (#5909
An error occurred
)
* fix the npe in MasterExec
* fix the compile error
* Add `.asf.yaml` to easily set the GitHub metadata (#6035
)
* Fix inefficient map iterator
* Use forEach and remove call to valueOf
* Modify AbstractParameters
* Enhance `StandaloneServer` so that we don't need to update the version number manually (#6074
An error occurred
)
* Remove invalid character in `.asf.yaml` (#6075
An error occurred
)
* Remove invalid character `\n` in `.asf.yaml` (#6077
An error occurred
)
It turns out that the invalid character is `\n`
* Add alert server into standalone-server as well and some minor polish (#6087
An error occurred
)
* Support starting standalone server in Docker image (#6102
An error occurred
)
Also remove unused class
* [Feature-4355][Master-Worker-API] improvements of master and scheduler module (#6095
An error occurred
)
* [Feature-4355][Master-Worker-API] improvements of master and scheduler module (#6085
An error occurred
)
* master refactor:
1. spi for task submit and other actions(pause, kill)
2. remove threads for process instance and task instance.
3. add events for process instance and task instance
* ut npe
* add try catch
* code style
* fix critical bugs
* fix critical bugs
* fix critical bugs
* fix critical bugs
* Remove unused params in SwitchTaskTest (#6109