6df58e8d78
[Feature-#5565][Master Worker-Server] Global Param passed by sense dependencies ( #5603 )
...
* add globalParams new plan with varPool
* add unit test
* add python task varPoolParams
Co-authored-by: wangxj <wangxj31>
3 years ago
664206cb81
wrong word: 'WAITTING' ->'WAITING' ( #5682 )
...
* Add:Name verification remove the first and last spaces.
* Update: wrong word: 'WAITTING' ->'WAITING'
Co-authored-by: Squid <2824638304@qq.com>
3 years ago
75813e7866
[bug fix] Some password attributes can be viewd directly in the log ( #5638 )
...
* fix the password display incorrectly
* update
* update
* fic code style
fic code style
* Update SensitiveDataConverterTest.java
* Update SensitiveDataConverter.java
* Update SensitiveDataConverter.java
* Update SensitiveDataConverterTest.java
* Update pom.xml
3 years ago
3026f04d85
[Improvement-5452][Task] ds flink task support submit a PyFlink job via the CLI ( #5453 )
...
* flink task support submit a PyFlink job via the CLI.
* optimize attribute name.
* Modify pyflink parameter judgment logic
3 years ago
67711442d5
[Improvement][SQL] Query return number In SQL should be configurable ( #5632 )
...
* [Improvement][SQL] Query return number should be configurable #5580
* Update SqlTaskTest.java
* Update sql.vue
3 years ago
71a44f8a57
[Fix-5483] [Bug][API] Can't view variables in the page of Process Instance ( #5631 )
3 years ago
053e548bf3
[Improvement-5539][Master] Check status of taskInstance from cache ( #5572 )
...
* improvement:check status of taskInstance from cache
* issue5572 use timer instead of while&sleep; consider concurrent modification
* use computeifpresent instead of lock
* simplify getByTaskInstanceId function
* add ut for TaskInstanceCacheManagerImpl; fix bug in TaskInstanceCacheManagerImpl
* add Apache license header;add test class in root pom
3 years ago
30c88032d3
[Feature-#3961][Registry]Registry-SPI ( #5562 )
...
[Feature#3961]Registry SPI
All the logical structure of the registry must be converted into a tree structure within the system, so some plug-ins must be converted internally, such as ETCD
The registry supports distributed locks.
todo: The specific information about the registration center of the API module needs to be adjusted.
3 years ago
d8f2aa3f20
[Fix-5468][Common] Fix obtaining IP is incorrect ( #5594 )
3 years ago
0d5037e7c3
[Fix-5483] [Bug][API] Can't view variables in the page of Process Instance ( #5631 )
3 years ago
79eb2e85d7
[Improvement-5539][Master] Check status of taskInstance from cache ( #5572 )
...
* improvement:check status of taskInstance from cache
* issue5572 use timer instead of while&sleep; consider concurrent modification
* use computeifpresent instead of lock
* simplify getByTaskInstanceId function
* add ut for TaskInstanceCacheManagerImpl; fix bug in TaskInstanceCacheManagerImpl
* add Apache license header;add test class in root pom
3 years ago
e2243d63be
[Feature-#3961][Registry]Registry-SPI ( #5562 )
...
[Feature#3961]Registry SPI
All the logical structure of the registry must be converted into a tree structure within the system, so some plug-ins must be converted internally, such as ETCD
The registry supports distributed locks.
todo: The specific information about the registration center of the API module needs to be adjusted.
3 years ago
281b5aea6b
[Fix-5468][Common] Fix obtaining IP is incorrect ( #5594 )
3 years ago
b537f4eb26
[Improvement][Docker/K8s] Support more configurations and service accesses, reduce the duplication configurations, improve image for python and the compatibility of python home ( #5393 )
...
* [Improvement][Docker] Support more configurations and improve image for python
* [Improvement][K8s] Support more configurations, more service accesses, and reduce the duplication configurations
* [Improvement][Python] Improve the compatibility of python home
* [Improvement][Install] Fix install config and install.sh
* [Improvement][Install] Fix workflow ut
* [Improvement][Docker] Optimize docker-swarm/check script
* [Improvement][DB] Update default username and password of database
* Update comments in master/worker.properties
* Specify version for all images
* [Improvement][Docker] Optimize PS1 and WORKDIR
* [Improvement][SQL] Reduce heap size to 64m in create-dolphinscheduler.sh and upgrade-dolphinscheduler.sh
* [Fix-5431][K8s] Fix master and worker cannot get the right address with custom DNS
4 years ago
9ba4ffbe48
[Improvement-5527][api-server] failed find any kerberos ( #5533 )
...
* fix failed find any kerberos.
* increase code coverage.
* update common utils test.
* update common utils test.
* update common utils test.
* fix exception type.
4 years ago
46660b58ed
[Test] Add SparkParameters test ( #5478 )
...
* Create SparkparametersTest.java
Add a test case
* Update and rename SparkparametersTest.java to SparkParametersTest.java
* Update pom.xml
add SparkParametersTest.java in pom file
4 years ago
1b7dcea610
[Improvement-5440][Maven] Project module maven dependency optimization ( #5441 )
...
* Optimize dependencies between modules.
* update module-alert dependency.
* add repository in the pom xml.
* update Central Repository in the pom.xml.
4 years ago
bc22ae7c91
[Improvement][Task] Remove deprecated TaskRecordDao and simply the after() method in the AbstractTask class ( #5492 )
...
* remove the depreated data quality module
* fix lint
Co-authored-by: Yao <ywang46@paypal.com>
4 years ago
a925f64571
[Feature][api] schedule add timezone support #5259 ( #5465 )
...
* [Feature][api] schedule add timezone support #5259
* import moment-timezone
* fix code smell
4 years ago
68301db6b9
[Improvement][Api] Upload resource to remote failed, the local tmp file need to be cleared #5475 ( #5476 )
4 years ago
d04f4b6053
[Implement][Common] Modify the plug-in loading log to print messages
...
Co-authored-by: caoping <caoping@staff.weibo.com>
4 years ago
9c77faa8ac
[Improvement-5058][Master] The master-server creates the DB data source twice ( #5139 )
...
* reduce the number of data sources created twice by master server.
* update ProcessAlertManagerTest test class to increase coverage.
* add DolphinSchedulerPluginLoaderTest test ignore.
Co-authored-by: zhuang chong
4 years ago
f7b71fb9ca
[Feature][JsonSplit] Fix codeStyle for json_split ( #5432 )
...
* update taskParams/add task delayTime/fix conditionType bug
* update codeStyle for merge to dev
* fix process lineage bug
* fix codeStyle for json_split
Co-authored-by: JinyLeeChina <297062848@qq.com>
4 years ago
1646188027
fix code style
4 years ago
86dcddb32b
[Feature-4417]fix code style ( #5395 )
...
* fix code style
* fix ut
* remove unused ut
* remove unused ut
Co-authored-by: baoliang <baoliang@analysys.com.cn>
4 years ago
2a44cb9de6
[Feature][JsonSplit] update codeStyle for merge to dev ( #5392 )
...
* update taskParams/add task delayTime/fix conditionType bug
* update codeStyle for merge to dev
Co-authored-by: JinyLeeChina <297062848@qq.com>
4 years ago
c3558965c1
update taskParams/add task delayTime/fix conditionType bug ( #5385 )
...
Co-authored-by: JinyLeeChina <297062848@qq.com>
4 years ago
e6d8da484f
[Improvement][API] Create Datasource #5083 ( #5116 )
...
* [Improvement][API] Create Datasource #5083
* Refact create/ update datasource API
* fix Code Smells
* fix code smell
* resolve code smell
* use ConnectionParam to replace BaseDatasource
* solve license
* add ut
* code check
* add ut
* fix ut coverage
* fix ut
4 years ago
75d1ad645c
fix bug: 5349, work flow would running if task is killed by manual. ( #5362 )
...
Co-authored-by: baoliang <baoliang@analysys.com.cn>
4 years ago
e57ee658e8
[Improvement] Optimized close of IO ( #5336 )
...
* [improvement]modify all methods that refer to LogClientService in the code.
* delete unused code
* [Improvement] Optimized close of IO
4 years ago
feffd972b5
[Feature][JsonSplit] Fix task logger path ( #5331 )
...
* update SnowFlake
* update processDefinite from processInstance
* update processDefinite from processInstance
* Fix task logger path
Co-authored-by: JinyLeeChina <297062848@qq.com>
4 years ago
5f1fc462c9
[Bug][server-api] copy the node ,the preTasks is error #5261 ( #5264 )
4 years ago
49b234609a
update SnowFlake ( #5321 )
...
Co-authored-by: JinyLeeChina <297062848@qq.com>
4 years ago
837c9ba2cc
fix bug:when shell task raw script has $[${day} - 1],throw java.lang.IllegalArgumentException::Pattern includes reserved character:'{' ( #5313 )
4 years ago
83519bdfc3
[Improvement][Server] Optimize log display ( #5311 )
4 years ago
e92e29ef9a
[Fix-5309][Common] Fix the wrong memory ( #5312 )
...
* [Fix-5309][Common] Fix the wrong memory
* [Fix-5309][Common] Fix unit test and remove unused code
4 years ago
f7a06a033d
[Feature][JsonSplit] Fix master/worker about shellTask ( #5300 )
...
* Fix quoted bug about processDefineId of processInstance
* Fix master/worker about shellTask
* codeStyle
* codeStyle
* update taskType
* codeStyle
* update timeoutNotifyStrategy
* codeStyle
Co-authored-by: JinyLeeChina <297062848@qq.com>
4 years ago
f3dfaacca2
[Improvement][Service] Optimize query log ( #5205 )
...
* [Improvement][Service] Optimize query log
* remove IPUtils
4 years ago
1c1f6663a6
[Improvement][WorkerGroup] Optimize and reduce database and zookeeper queries and replace worker address input with multiple-select ( #5182 )
...
* [Improvement][Server] Optimize and reduce database and ZooKeeper query
* [Improvement][WorkerGroup] Replace worker address input with multiple-select
* [Improvement][WorkerGroup] Fix unit test
* [Improvement][API&UI] Optimize long host to short host and long host display in k8s
4 years ago
0eb8c0c234
[Improvement][common]Task status error
4 years ago
73f5a8e0a7
[Feature][JsonSplit] Fix master/worker server ( #5253 )
...
* Fix dependency failure
* Fix taskInstance
* task instance list page
* code review
* fix logger path
* Fix master/worker server
Co-authored-by: JinyLeeChina <297062848@qq.com>
4 years ago
31188ffca0
[Feature][JsonSplit] Fix taskInstance ( #5246 )
...
* Fix dependency failure
* Fix taskInstance
* task instance list page
* code review
* fix logger path
Co-authored-by: JinyLeeChina <297062848@qq.com>
4 years ago
73e917d3c1
Clean up useless files. ( #5252 )
4 years ago
8c88bfa222
Fix dependency failure ( #5239 )
...
Co-authored-by: JinyLeeChina <297062848@qq.com>
4 years ago
2f1f193ba8
Update common.properties ( #5223 )
4 years ago
86ce8f133a
[JsonSplit-4417][master/worker/api]json split- remove json in task instance. ( #5160 )
...
* [json split] refactor json in task instance
* add task_pramas in task_instance
* feature #4417 refactor json split in task instance
* code style
* code style
* code style
* code style
* code style
* update
* update
* update unit test
* update
4 years ago
dd36da8d1f
[Feature][JsonSplit] fix process bug ( #5193 )
...
* transform taskCode from long to string
* fix process bug
* code review
* code review
* code review
Co-authored-by: JinyLeeChina <297062848@qq.com>
4 years ago
e53369318b
[Fix-4721][worker]The shell background starts the YARN task scenario, and the kill function is abnormal ( #4722 )
...
* fix the shell starts the yarn task in the background
* update StringUtils code style.
* solve code smell.
* add method comment in StringUtils class.
* update AlertGroupMapper code style.
* update AlertGroupMapperTest
* update sql script test.
4 years ago
689106d114
transform taskCode from long to string ( #5174 )
...
Co-authored-by: JinyLeeChina <297062848@qq.com>
4 years ago
a467fffd7b
[Feature][JsonSplit] fix taskId in json ( #5165 )
...
* modify checkDAGRing and ProcessService method
* merge
* modify dagRing
* modify process instance for project home page
* fix save process bug
* codeStyle
* Fix logical bug in saving process definition
* codeSytle
* Fix bug in interface of queryProcessDefinitionList
* codeSytle
* Fix api bug"
* fix taskId in processDefinitionJson
* fix json taskId
* codeStyle
Co-authored-by: JinyLeeChina <297062848@qq.com>
4 years ago
wangxj3
Squidyu
kyoty
zhuangchong
blackberrier
Kirs
Shiwen Cheng
QuakeWang
Yao WANG
ruanwenjun
lcdrs
JinyLeeChina
baoliang
bao liang
luoyuan
roi
didiaode18
xiaoyu