Manhua
2dc09c627f
[Fix-5551][common] Fix ExecutionStatus for hive-on-Tez application ( #6289 )
...
* add ENDED state
* Update HadoopUtils.java
3 years ago
zwZjut
af9ed35295
[Feature][MasterServer] add cache for workGroup and schedule #6987 ( #7161 )
...
* to #6987
* to #6987
* to #6987
* to #6987
* to #6987
* to #6987 : @Param -> @Name
* to #6987 : fix Sonar
* to #6987 : fix Sonar
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
3 years ago
wind
ba2b2a67c2
[Feature-6988][MasterServer] add cache manager for workflow ( #7090 )
...
* add cache manager for workflow
* [DS-6988][MasterServer] add cache manager for workflow
* cache evict code optimization
* test
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
wangxj3
2b519f31e9
[Feature-#6422] task group queue ( #6722 )
...
* add task group
* modify task group
* pull dev
* add license header
* modify code style
* fix code style
* fix sql error
* fix error
* fix test
* fix test
* fix test
* fix test
* fix code style
* fix ut
* code style
* fix unit test
* test ut
* ut
* add unittest
* test ut
* modify back ut
* majorization code
* fix conflict
* fix ut
Co-authored-by: wangxj <wangxj31>
3 years ago
kezhenxu94
2ed3c0c3a7
Recover unit tests that have not been run for some time ( #7054 )
3 years ago
Sunny Lei
0dcff1425a
[DS-5229][feat] Implement server port custom config ( #6947 )
...
* [DS-5229][fix] server port custom config
This closes #5229
* [DS-5229][feat] Implement server port custom config
This closes #5229
* [Bug] [readme] Error link to Docker and k8s in readme apache#6802 (#6862 )
* [Bug] [readme] Error link to Docker and k8s in readme #6802
1、modify the error link
* [Bug] [readme] Error link to Docker and k8s in readme #6802
1、modify the error link in readme_zh_cn.md
* [DS-6829][WorkerServer] skip create log dir and print log in dryRun model (#6852 )
Co-authored-by: caishunfeng <534328519@qq.com>
* [DS-5229][feat] Implement server port custom config
Modify review suggestion
This closes #5229
Co-authored-by: GaoTianDuo <gaotianduo_yewu@cmss.chinamobile.com>
Co-authored-by: wind <caishunfeng@users.noreply.github.com>
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
Kerwin
f0630bc9a0
Fix view task status module on project homepage cannot read property label of undefined ( #6956 )
3 years ago
Hua Jiang
a0955a078a
[Fix-7019][MasterServer] Fix the issue with failing to save and run the process that contains the switch task. ( #7046 )
3 years ago
wind
8e93939121
[DS-6963][MasterServer]add cache manager for tenant and user ( #6974 )
...
* cache manager for tenant and user
* add test
* fix checkstyle
* add dependencies
* fix sonar check
* use spring boot cache configuration
* add license
* check style
* check style
* add license
* change proxy name to processor
* add license header
* check style
* add license file
* add license file
* add license
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
lvshaokang
1a88b1863b
[Improvement-5785][common] Fix code format ( #6864 )
...
* [DS-5785][style] Fix common module code format
* [DS-5785][style] Fix common module code format
3 years ago
kezhenxu94
ef0cb46661
Fix shell tools for database schema cannot run ( #7003 )
3 years ago
wind
e6239e808b
[DS-6829][WorkerServer] skip create log dir and print log in dryRun model ( #6852 )
...
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
JinYong Li
4bec792160
[Fix][Common] rewrite code generate,fix bit shift ( #6914 )
...
* rewrite code generate,fix bit shift
* fix ut
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* fix ut
3 years ago
Kerwin
802fc498b5
[Fix-#6605][Common] Fix the situation where the obtained string property is empty. ( #6661 )
...
* Fix the situation where the obtained string property is empty.
* recovery test
* update code style.
* megre dev.
3 years ago
chouc
f564687a89
[Improvement][Log] optimize task log path to reduce task running time ( #6731 )
...
* [Improvement][Log] optimize task log path to reduce task running time
* Reduce the creation of log directories
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
OS
880c1d28ff
[Feature][master] change sub process id to code. ( #6846 )
...
* 6597 change sub process id to code.
* 6597 change sub process id to code.
* 6597 change sub process id to code.
* 6597 change sub process id to code.
* 6597 change sub process id to code.
* 6597 change sub process id to code.
* code style
* fix ut process
* fix ut process
3 years ago
kezhenxu94
4114cb07f6
Add actuator and enable metrics, add Grafana configs ( #6840 )
3 years ago
mask
a998415afe
[Feature][datasource] Change DataSource Connection Pool from Druid to HiKariCP ( #6490 ) ( #6828 )
...
* [Feature][datasource] Change DataSource Connection Pool from Druid to HiKariCP (#6490 )
* fix pom dep scope
* filter alert
* filter alert
* filter alert
* fix checkstyle
* remove hikaricp version
* update pom
* add properties
* add properties
* rename properties
* fix e2e fail
* rename properties
3 years ago
Assert
089f73ebe4
[Fix-6707][common] Fix complement data error because of global variables ( #6759 )
...
* [Fix-6707][common] Fix complement data error because of global variables
* [Fix-6707][common] Fix complement data error because of global variables
* [Fix-6707][common] Fix complement data error because of global variables
* [Fix-6707][common] Fix complement data error because of global variables
Co-authored-by: shangeyao <sgy960921>
Co-authored-by: OS <29528966+lenboo@users.noreply.github.com>
3 years ago
Jiajie Zhong
6045728428
[ci] Add checkstyle prohibit rule System.out.println ( #6778 )
...
* [ci] Add checkstyle prohibit rule System.out.println
* Correct RegexpSingleline place
3 years ago
kezhenxu94
11844415b0
Refactor datasource and task plugins and simplify its usage ( #6767 )
3 years ago
mask
0aea5ae11a
[feature-6071][plugin] add datasource plugin. ( #6071 ) ( #6361 )
...
* [feature-6071][plugin] add datasource plugin. (#6071 )
* remove the dependency of datasource in common and task-plugin module.
* the new datasource-api module provides data source connection acquisition.
* add sqlserver data source plug-in.
* add ds license
* fix check style
* update spi pom
* frx conflict resolution
* fix check style
* fix datasource ut
* fix code check style
* fix code check style
* fix datasource ut
* add pg hive mysql oracle clickhouse db2 datasource
* fix datasource package
* update datasource pom
* update datasource pom
* update datasource pom
* update datasource pom
* update pom
* update pom dep
* update pom dep
* fix license
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* add oracle package
* modify comments
* conflict resolution
* rename log comment
* rename log comment
3 years ago
kezhenxu94
05bae0b226
Refactor alert plugins and simplify its usage ( #6723 )
3 years ago
kezhenxu94
02350ea37b
Fix datasource not work in tests and standalone server, and run all tests by default ( #6743 )
3 years ago
JinYong Li
be28d2c63b
[Bug][SnowFlakeUtils] fix snowFlake bug ( #6744 )
...
* fix snowFlake bug
* fix hash machine
3 years ago
kezhenxu94
63602bf77c
Clean up the utility codes ( #6732 )
3 years ago
Wenjun Ruan
0f94577d26
Use nanoTime replace currentTimemill to avoid clock backwards ( #6740 )
3 years ago
OS
24bd8a16e1
[Bug][Master] The task of dependent should use taskCode ( #6730 )
...
* fix #6682 The task of dependent should use taskCode
* fix #6682 The task of dependent should use taskCode
3 years ago
Wenjun Ruan
0afb780718
[Improvement-5807][Dao] Use h2 in UT ( #6500 )
...
* Use H2 in UT
* change scope
* Change profile name to h2
* Add datasource-h2.properties, datasource-postgresql.properties
* Fix UT
* Resolve conflict
* Remove startDatabase
3 years ago
kezhenxu94
5400abc74f
Refactor registry plugin and simplify its usage ( #6712 )
3 years ago
wind
72daba58cd
[DS-6694][Master] Reduce the refresh resource interval of LowerWeight ( #6695 )
...
* [DS-6694][Master] Reduce the refresh resource interval of LowerWeight
* add server node update event handle
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
wangxj3
dc8b87e473
[Feature-#6268][server-master] Serial execte process ( #6185 )
...
* add serial processInstance
* fix bug
* add test
* fix code style
* fix style code
* add sql
* fix sql error
* add api
* add test
* fix code style
* modify api
* delete column , fix mapper
* fix unimport
* fix test
* fix bug of missing param for Python
* fix code style
* fix test
* fix test
Co-authored-by: wangxj <wangxj31>
3 years ago
Jiajie Zhong
dd6ed36f65
Add Python API implementation of workflows-as-code ( #6269 )
...
* Init DS python SDK pydolphinscheduler: python code definition
* Doc first
* Add quick start and developer doc
* Java documentation change
* Add LICENSE-py4j.txt
* Add py4j to release-docs/LICENSE
* Move dependency version to parent pom
* Remove outdated code
* Add tenant parameter to tutorial
3 years ago
aCodingAddict
f60e3c219a
[DS-6606] [common] JSONUtils#getNodeString String type ( #6618 )
3 years ago
mask
9b1984c244
[fix-6570][task] add sql task udf resource load ( #6570 ) ( #6571 )
...
* [fix-6570][task] add sql task udf resource load (#6570 )
-add sql task udf resource load
-Fix UdfFuncRequest serialization
* fix checkstyle
* add defaultFS in sqlTaskContext
* fix checkstyle
3 years ago
wind
50f1766903
[DS-6499][WorkerServer] report busy state when worker is overload ( #6512 )
...
* [DS-6499][WorkerServer] report busy state when worker is overload
3 years ago
calvinit
59daf3c837
[DS-6276][fix] specify UTF-8 encoding to read file contents ( #6466 )
...
This closes #6276
3 years ago
百岁
d284e44d52
Rename tis to pigeon from backend layer ( #6437 )
...
* add mock getTaskLogName() for UT test pass
* make task-tis rename to task-pigeon
* rename module name 'tis' to pigeon
* rename module name 'tis' to pigeon,make sanity check pass
* remove execute console.log()
3 years ago
Shukun Zhang
6e453de241
[Feature] workflow level task dry run ( #6104 )
...
* feat workflow level task dry run
* feat workflow level task dry run
* feat workflow level task dry run
* feat workflow level task dry run
* feat workflow level task dry run
* feat workflow level task dry run
* feat workflow level task dry run
* feat workflow level task dry run
* feat workflow level task dry run
* feat workflow level task dry run
3 years ago
OS
c013b49e72
[Fix-6347][Master-API]fix bug #6347 the first schedule_time is error in complement data ( #6389 )
...
* fix bug #6347 complement data errors
3 years ago
Kirs
67508d8d1b
update project version to 2.0.0-SNAPSHOT ( #6383 )
3 years ago
百岁
34352c1bf8
Enhance using experience of DataX by introduce TIS ( #6229 )
...
* Enhance using experience of DataX by introduce TIS [Feature-5992]
* Enhance using experience of DataX by introduce TIS [Feature-5992]
* fix stylecheck error
* make testCase pass
* make dev testCase pass
* add new java dependency Java-WebSocket
* modfiy TISParameters.java avoid to name confliction
* add InterruptedException checking
* reAdd async-http-client annotation
* in order to staisfy the coverage degree add test which has been removed
* make testCase pass
* make testCase pass
* add jacoco dependency
* make code duplications be more lower
* add Java-WebSocket dependency in root pom
* remove useless code comment
* make tis http apply path and post body configurable ,the params save in config.properites
* Remove the dangerous instance of double-checked locking
3 years ago
HanayoZz
4625783479
[Fix-6072][common] Remove Generic method JsonUtils.toMap ( #6283 )
...
* [Fix][common] Remove Generic method JsonUtils.toMap, Replace by parseObj(String json, TypeReference type)
3 years ago
LiuBodong
c4375a54c1
[Fix][Task] Task lost resource information ( #6292 ) ( #6295 )
...
Co-authored-by: liubodong <liubodong>
3 years ago
JinyLeeChina
07d6542feb
[Fix-6139][API] fix workFlowLineage relation ( #6217 )
...
* fix bug of view-tree api
* fix bug of view-tree api
* fix ut
* fix ut
* fix master buildFlowDag error
* fix workFlowLineage relation
* fix ut
* fix ut
* fix ut
Co-authored-by: JinyLeeChina <297062848@qq.com>
3 years ago
OS
8694b9c8f9
fix bug-6208 json parse error in sub process ( #6211 )
3 years ago
Jiajie Zhong
170280fab2
Simplify constants variables ( #6183 )
...
* Combine `alter` and `registry` properties,
bese on https://github.com/apache/dolphinscheduler/pull/6180
* Remove duplicate variable `SLASH` and `SINGLE_SLASH`
3 years ago
JinyLeeChina
14e4d7086d
[Fix-6139][API] fix bug of view-tree api ( #6188 )
...
* fix bug of view-tree api
* fix bug of view-tree api
* fix ut
* fix ut
Co-authored-by: JinyLeeChina <297062848@qq.com>
3 years ago
kezhenxu94
ea2a9dbcb2
Clean up third-party files that are not mentioned in LICENSE ( #6165 )
3 years ago
kezhenxu94
a632be73c0
Clean up unused util classes... ( #6154 )
3 years ago