Jiajie Zhong
6e812be14d
[python] Add ut cover process definitions separate mode ( #6908 )
...
* [python] Add ut cover process definitions separate mode
* Remove unused print syntax
* Fix test error, cause raw_script not exists anymore
3 years ago
Jiajie Zhong
0dce68edd7
[python] Add task type python http ( #6906 )
...
* [python] Add task type python http
* Fix unittest error
* Fix UT error
3 years ago
JinYong Li
4bec792160
[Fix][Common] rewrite code generate,fix bit shift ( #6914 )
...
* rewrite code generate,fix bit shift
* fix ut
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* fix ut
3 years ago
wind
595e4843d0
[DS-6849][MasterServer] fetch more commands and handle in parallel ( #6850 )
...
* [DS-6849][MasterServer] fetch more commands and handle in parallel
* add return
* handle command with check
* add test
* delete master prefix
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
songjianet
1be080237b
[Fix-6896] fix the problem that the name search cannot be used. ( #6911 )
3 years ago
Jiajie Zhong
f9a130d73e
Use docker.scarf.sh to track docker user info ( #6913 )
...
* Use docker.scarf.sh to track docker user info
* Revert ci docker image change
3 years ago
songjianet
eb01f2e617
[Feature][Process definition] add search function to `select` in batch operation `dialog`. ( #6915 )
3 years ago
Kerwin
802fc498b5
[Fix-#6605][Common] Fix the situation where the obtained string property is empty. ( #6661 )
...
* Fix the situation where the obtained string property is empty.
* recovery test
* update code style.
* megre dev.
3 years ago
songjianet
00813b0a69
[Improvement-6889] split the routing module to increase subsequent maintainability. ( #6892 )
3 years ago
KyoYang
80dcf9b03e
[Improvement-#5293]upgrade cron-utils version 5.0.5 -> 9.1.3 ( #6857 )
...
* fix complement data retry bug; issues: [Bug] [Master] A bug on task retry mechanism #6613
Co-authored-by: yangqiyu <yangqiyu@deepexi.com>
3 years ago
Jeff Zhan
3101218c73
[Improvement][API][num-5] The workflow of the main table version is not allowed to be deleted ( #6893 )
...
* feature:deleteProcessDefinitionVersion
* pref:delete duplicate enum definition
Co-authored-by: 北笙 <“zhanqian@cai-inc.com”>
3 years ago
JinYong Li
fc6a5116c4
[Improvement][API][num-7] add task delete check ( #6887 )
...
* upgrade add sub_process
* add interface method
* add interface method
* fix ut
* add task delete check
* add task delete check
3 years ago
yihong
861aaaf971
[FIX-#6505][Dao] upgrade the MySQL driver package for building MySQL jdbcUrl ( #6708 )
...
* replace com.mysql.jdbc.Driver everywhere with com.mysql.cj.jdbc.Driver
3 years ago
OS
653eae2419
[BUG][Master] process cannot finish and its status is always running ( #6886 )
...
* fix 6882: process cannot finish and its status is always running
* fix 6882: process cannot finish and its status is always running
3 years ago
chouc
f564687a89
[Improvement][Log] optimize task log path to reduce task running time ( #6731 )
...
* [Improvement][Log] optimize task log path to reduce task running time
* Reduce the creation of log directories
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
DingPengfei
842c3857c1
fix bug of extra 'and' in ResourceMapper.xml ( #6876 )
...
Co-authored-by: ding <dingpf@helowin>
3 years ago
Jiajie Zhong
7c5c7ec907
[ci][python] Add isort to sort out import ( #6871 )
...
* Add isort config file to fix conflict with black
* Add some doc about isort
3 years ago
Jiajie Zhong
54933b33e3
[ci][python] Add coverage check in CI ( #6861 )
...
* [ci] Add coverage check in CI
* Coverage add dependent
* Install pydolphinscheduler before run coverage
* Up test coverage to 87% and down threshold to 85%
* Fix code style
* Add doc about coverage
3 years ago
JinYong Li
f5e7da3cf6
[Improvement][API] add interface method ( #6863 )
...
* upgrade add sub_process
* add interface method
* add interface method
* fix ut
3 years ago
zwZjut
94352a4f5f
fix switchVersion error ( #6783 ) ( #6784 )
...
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
OS
1160b53940
[Feature][Master] change sub process id to code ( #6858 )
...
* feature 6597 change sub process id to code
* feature 6597 change sub process id to code
3 years ago
xiaoguaiguai
44b24cd3df
When the SQL node is selected ( #6851 )
...
The data source list needs to scroll continuously, and the search efficiency is low
Add a quick search box to quickly locate the data source to be selected
3 years ago
DuChaoJiaYou
36c19748a6
[Feature-6600][UI] Implement page about task-definition ( #6762 )
...
* fix api error in dependent task
* feat: This is a connecting test
* feat: second push test
* feat: email test
* [Feature]add taskdefinition
add new pages named taskDifinition
add new router
add new action in store/dag
* [Feature] add/edit/view task definition
* [DS-6600][feat][UI] Add page about task-definition list
* Add page about task-definition list
* Add create/edit/view/delete task-definition
* Add research task-definition
This closes #6600
* modify API_BASE
Co-authored-by: wangyizhi <wangyizhi1_yewu@cmss.chinamobile.com>
Co-authored-by: duchao <duchao@cmss.chinamobile.com>
3 years ago
KyoYang
94f6c5c27e
fix complement data retry bug; issues: [Bug] [Master] A bug on task retry mechanism #6613 ( #6843 )
...
Co-authored-by: yangqiyu <yangqiyu@deepexi.com>
3 years ago
OS
880c1d28ff
[Feature][master] change sub process id to code. ( #6846 )
...
* 6597 change sub process id to code.
* 6597 change sub process id to code.
* 6597 change sub process id to code.
* 6597 change sub process id to code.
* 6597 change sub process id to code.
* 6597 change sub process id to code.
* code style
* fix ut process
* fix ut process
3 years ago
JinYong Li
7f3b999e5c
upgrade add sub_process ( #6845 )
3 years ago
kezhenxu94
4114cb07f6
Add actuator and enable metrics, add Grafana configs ( #6840 )
3 years ago
zwZjut
4b848fb6d9
fix #6807 : dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars ( #6808 )
...
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
mask
a998415afe
[Feature][datasource] Change DataSource Connection Pool from Druid to HiKariCP ( #6490 ) ( #6828 )
...
* [Feature][datasource] Change DataSource Connection Pool from Druid to HiKariCP (#6490 )
* fix pom dep scope
* filter alert
* filter alert
* filter alert
* fix checkstyle
* remove hikaricp version
* update pom
* add properties
* add properties
* rename properties
* fix e2e fail
* rename properties
3 years ago
GaoTianDuo
e3dc4016d2
[Bug] [readme] Error link to Docker and k8s in readme #6802 ( #6833 )
...
1、modify the error link
3 years ago
Jiajie Zhong
e76cf77040
[python] Add parameter schedule for process definition ( #6664 )
...
* [python] Add parameter schedule for process definition
* Rebase and fix some code style
* May schedule work on both string and datetime
* Fix flaky test
* Add comment about freeze time
* Add edge test for schedule_json with None schedule
* Fix test function name
* Fix rebase error
3 years ago
Assert
089f73ebe4
[Fix-6707][common] Fix complement data error because of global variables ( #6759 )
...
* [Fix-6707][common] Fix complement data error because of global variables
* [Fix-6707][common] Fix complement data error because of global variables
* [Fix-6707][common] Fix complement data error because of global variables
* [Fix-6707][common] Fix complement data error because of global variables
Co-authored-by: shangeyao <sgy960921>
Co-authored-by: OS <29528966+lenboo@users.noreply.github.com>
3 years ago
Jiajie Zhong
0f92a1f541
[community] Add version selection for issue bug selection ( #6793 )
...
closes : #6620
Co-authored-by: Kirs <acm_master@163.com>
Co-authored-by: Jiwei Guo <technoboy@apache.org>
3 years ago
Jiajie Zhong
6045728428
[ci] Add checkstyle prohibit rule System.out.println ( #6778 )
...
* [ci] Add checkstyle prohibit rule System.out.println
* Correct RegexpSingleline place
3 years ago
Jiajie Zhong
cd8205217a
[python] Fix process definition's user assigned not pass ( #6753 )
3 years ago
wangyizhi
e2d516f279
Optimize DAG page opening speed ( #6830 )
3 years ago
Jiajie Zhong
5453f1e349
[ci] Remove PR requests strict rebase ( #6831 )
3 years ago
wind
5741c758b3
[DS-6771][MasterServer] fix failover worker interrupt ( #6801 )
...
Co-authored-by: caishunfeng <534328519@qq.com>
Co-authored-by: Kirs <acm_master@163.com>
Co-authored-by: OS <29528966+lenboo@users.noreply.github.com>
3 years ago
OS
d168a3cdf7
[feature][Install] 6597 add worker group when upgrading from version 1.x to 2.0 ( #6806 )
...
* feature 6597 add worker group. Upgrade dolphinscheduler version 1. X to version 2.0
* feature 6597 add worker group. Upgrade dolphinscheduler version 1. X to version 2.0
* code style
* code style
* code style
* code style
* update postgre sql
Co-authored-by: JinYong Li <42576980+JinyLeeChina@users.noreply.github.com>
3 years ago
JinYong Li
dfe4945b48
remove processDefinition resourceIds ( #6813 )
3 years ago
mask
e36d18b588
[Fix-6792] resolve API and alert port conflicts ( #6792 ) ( #6815 )
...
* [Fix-6792]Multiple ApplicationRunners on classpath make SpringApplication.run only run one (#6792 )
3 years ago
JinYong Li
da2a044947
[Feature][API] add processDefinitionSimpleList api ( #6814 )
...
* add processDefinitionSimpleList api
* add processDefinitionSimpleList api
3 years ago
罗铭涛
975131e913
[Improvement#6655] [UI] remove registry monitor ( #6789 )
...
* [DS-6655][fix] remove zkmonitor
- delete zkmonitor ui
* [DS-6655][fix] remove zkmonitor
- delete zkmonitor ui
- Modify the actions.js comma
* [DS-6655][fix] remove zkmonitor
- remove all backend API
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
Jiajie Zhong
c110488269
[ci] Remove GA path rule in build and unittest ( #6797 )
...
CI could not be run due to we add 9113817b
to asf
configure and same file change will not trigger
build or unit test github actions run. This patch
try to skip github action path ignore rule temporarily
Maybe we should find more effective way to spearate py
, js, java CI later
3 years ago
zwZjut
088a5a4706
add default constructor ( #6780 )
...
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
3 years ago
kezhenxu94
9113817b78
Require build and unit tests before merging ( #6777 )
3 years ago
kezhenxu94
11844415b0
Refactor datasource and task plugins and simplify its usage ( #6767 )
3 years ago
Jiajie Zhong
98f466e09e
Make sql file change synchronize ( #6465 )
...
closes : #6431
3 years ago
zhang
28f871e58b
[Fix-6764]modifying prompt messages and modify dolphinscheduler_mysql.sql dolphinscheduler version ( #6765 )
...
* [FIX:201106]fix issue#6657
* replacement version number
* update resource create error messag
Co-authored-by: 张柏强 <zhangbaiqiang@lvshou.com>
Co-authored-by: crane <zhangbq3306@163.com>
3 years ago
mask
0aea5ae11a
[feature-6071][plugin] add datasource plugin. ( #6071 ) ( #6361 )
...
* [feature-6071][plugin] add datasource plugin. (#6071 )
* remove the dependency of datasource in common and task-plugin module.
* the new datasource-api module provides data source connection acquisition.
* add sqlserver data source plug-in.
* add ds license
* fix check style
* update spi pom
* frx conflict resolution
* fix check style
* fix datasource ut
* fix code check style
* fix code check style
* fix datasource ut
* add pg hive mysql oracle clickhouse db2 datasource
* fix datasource package
* update datasource pom
* update datasource pom
* update datasource pom
* update datasource pom
* update pom
* update pom dep
* update pom dep
* fix license
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* add oracle package
* modify comments
* conflict resolution
* rename log comment
* rename log comment
3 years ago