3026f04d85
[Improvement-5452][Task] ds flink task support submit a PyFlink job via the CLI ( #5453 )
...
* flink task support submit a PyFlink job via the CLI.
* optimize attribute name.
* Modify pyflink parameter judgment logic
3 years ago
67711442d5
[Improvement][SQL] Query return number In SQL should be configurable ( #5632 )
...
* [Improvement][SQL] Query return number should be configurable #5580
* Update SqlTaskTest.java
* Update sql.vue
4 years ago
71a44f8a57
[Fix-5483] [Bug][API] Can't view variables in the page of Process Instance ( #5631 )
4 years ago
053e548bf3
[Improvement-5539][Master] Check status of taskInstance from cache ( #5572 )
...
* improvement:check status of taskInstance from cache
* issue5572 use timer instead of while&sleep; consider concurrent modification
* use computeifpresent instead of lock
* simplify getByTaskInstanceId function
* add ut for TaskInstanceCacheManagerImpl; fix bug in TaskInstanceCacheManagerImpl
* add Apache license header;add test class in root pom
4 years ago
30c88032d3
[Feature-#3961][Registry]Registry-SPI ( #5562 )
...
[Feature#3961]Registry SPI
All the logical structure of the registry must be converted into a tree structure within the system, so some plug-ins must be converted internally, such as ETCD
The registry supports distributed locks.
todo: The specific information about the registration center of the API module needs to be adjusted.
4 years ago
d8f2aa3f20
[Fix-5468][Common] Fix obtaining IP is incorrect ( #5594 )
4 years ago
0d5037e7c3
[Fix-5483] [Bug][API] Can't view variables in the page of Process Instance ( #5631 )
4 years ago
79eb2e85d7
[Improvement-5539][Master] Check status of taskInstance from cache ( #5572 )
...
* improvement:check status of taskInstance from cache
* issue5572 use timer instead of while&sleep; consider concurrent modification
* use computeifpresent instead of lock
* simplify getByTaskInstanceId function
* add ut for TaskInstanceCacheManagerImpl; fix bug in TaskInstanceCacheManagerImpl
* add Apache license header;add test class in root pom
4 years ago
e2243d63be
[Feature-#3961][Registry]Registry-SPI ( #5562 )
...
[Feature#3961]Registry SPI
All the logical structure of the registry must be converted into a tree structure within the system, so some plug-ins must be converted internally, such as ETCD
The registry supports distributed locks.
todo: The specific information about the registration center of the API module needs to be adjusted.
4 years ago
281b5aea6b
[Fix-5468][Common] Fix obtaining IP is incorrect ( #5594 )
4 years ago
b537f4eb26
[Improvement][Docker/K8s] Support more configurations and service accesses, reduce the duplication configurations, improve image for python and the compatibility of python home ( #5393 )
...
* [Improvement][Docker] Support more configurations and improve image for python
* [Improvement][K8s] Support more configurations, more service accesses, and reduce the duplication configurations
* [Improvement][Python] Improve the compatibility of python home
* [Improvement][Install] Fix install config and install.sh
* [Improvement][Install] Fix workflow ut
* [Improvement][Docker] Optimize docker-swarm/check script
* [Improvement][DB] Update default username and password of database
* Update comments in master/worker.properties
* Specify version for all images
* [Improvement][Docker] Optimize PS1 and WORKDIR
* [Improvement][SQL] Reduce heap size to 64m in create-dolphinscheduler.sh and upgrade-dolphinscheduler.sh
* [Fix-5431][K8s] Fix master and worker cannot get the right address with custom DNS
4 years ago
9ba4ffbe48
[Improvement-5527][api-server] failed find any kerberos ( #5533 )
...
* fix failed find any kerberos.
* increase code coverage.
* update common utils test.
* update common utils test.
* update common utils test.
* fix exception type.
4 years ago
46660b58ed
[Test] Add SparkParameters test ( #5478 )
...
* Create SparkparametersTest.java
Add a test case
* Update and rename SparkparametersTest.java to SparkParametersTest.java
* Update pom.xml
add SparkParametersTest.java in pom file
4 years ago
bc22ae7c91
[Improvement][Task] Remove deprecated TaskRecordDao and simply the after() method in the AbstractTask class ( #5492 )
...
* remove the depreated data quality module
* fix lint
Co-authored-by: Yao <ywang46@paypal.com>
4 years ago
a925f64571
[Feature][api] schedule add timezone support #5259 ( #5465 )
...
* [Feature][api] schedule add timezone support #5259
* import moment-timezone
* fix code smell
4 years ago
68301db6b9
[Improvement][Api] Upload resource to remote failed, the local tmp file need to be cleared #5475 ( #5476 )
4 years ago
d04f4b6053
[Implement][Common] Modify the plug-in loading log to print messages
...
Co-authored-by: caoping <caoping@staff.weibo.com>
4 years ago
9c77faa8ac
[Improvement-5058][Master] The master-server creates the DB data source twice ( #5139 )
...
* reduce the number of data sources created twice by master server.
* update ProcessAlertManagerTest test class to increase coverage.
* add DolphinSchedulerPluginLoaderTest test ignore.
Co-authored-by: zhuang chong
4 years ago
f7b71fb9ca
[Feature][JsonSplit] Fix codeStyle for json_split ( #5432 )
...
* update taskParams/add task delayTime/fix conditionType bug
* update codeStyle for merge to dev
* fix process lineage bug
* fix codeStyle for json_split
Co-authored-by: JinyLeeChina <297062848@qq.com>
4 years ago
1646188027
fix code style
4 years ago
86dcddb32b
[Feature-4417]fix code style ( #5395 )
...
* fix code style
* fix ut
* remove unused ut
* remove unused ut
Co-authored-by: baoliang <baoliang@analysys.com.cn>
4 years ago
2a44cb9de6
[Feature][JsonSplit] update codeStyle for merge to dev ( #5392 )
...
* update taskParams/add task delayTime/fix conditionType bug
* update codeStyle for merge to dev
Co-authored-by: JinyLeeChina <297062848@qq.com>
4 years ago
c3558965c1
update taskParams/add task delayTime/fix conditionType bug ( #5385 )
...
Co-authored-by: JinyLeeChina <297062848@qq.com>
4 years ago
e6d8da484f
[Improvement][API] Create Datasource #5083 ( #5116 )
...
* [Improvement][API] Create Datasource #5083
* Refact create/ update datasource API
* fix Code Smells
* fix code smell
* resolve code smell
* use ConnectionParam to replace BaseDatasource
* solve license
* add ut
* code check
* add ut
* fix ut coverage
* fix ut
4 years ago
75d1ad645c
fix bug: 5349, work flow would running if task is killed by manual. ( #5362 )
...
Co-authored-by: baoliang <baoliang@analysys.com.cn>
4 years ago
e57ee658e8
[Improvement] Optimized close of IO ( #5336 )
...
* [improvement]modify all methods that refer to LogClientService in the code.
* delete unused code
* [Improvement] Optimized close of IO
4 years ago
feffd972b5
[Feature][JsonSplit] Fix task logger path ( #5331 )
...
* update SnowFlake
* update processDefinite from processInstance
* update processDefinite from processInstance
* Fix task logger path
Co-authored-by: JinyLeeChina <297062848@qq.com>
4 years ago
5f1fc462c9
[Bug][server-api] copy the node ,the preTasks is error #5261 ( #5264 )
4 years ago
49b234609a
update SnowFlake ( #5321 )
...
Co-authored-by: JinyLeeChina <297062848@qq.com>
4 years ago
837c9ba2cc
fix bug:when shell task raw script has $[${day} - 1],throw java.lang.IllegalArgumentException::Pattern includes reserved character:'{' ( #5313 )
4 years ago
83519bdfc3
[Improvement][Server] Optimize log display ( #5311 )
4 years ago
e92e29ef9a
[Fix-5309][Common] Fix the wrong memory ( #5312 )
...
* [Fix-5309][Common] Fix the wrong memory
* [Fix-5309][Common] Fix unit test and remove unused code
4 years ago
f7a06a033d
[Feature][JsonSplit] Fix master/worker about shellTask ( #5300 )
...
* Fix quoted bug about processDefineId of processInstance
* Fix master/worker about shellTask
* codeStyle
* codeStyle
* update taskType
* codeStyle
* update timeoutNotifyStrategy
* codeStyle
Co-authored-by: JinyLeeChina <297062848@qq.com>
4 years ago
f3dfaacca2
[Improvement][Service] Optimize query log ( #5205 )
...
* [Improvement][Service] Optimize query log
* remove IPUtils
4 years ago
1c1f6663a6
[Improvement][WorkerGroup] Optimize and reduce database and zookeeper queries and replace worker address input with multiple-select ( #5182 )
...
* [Improvement][Server] Optimize and reduce database and ZooKeeper query
* [Improvement][WorkerGroup] Replace worker address input with multiple-select
* [Improvement][WorkerGroup] Fix unit test
* [Improvement][API&UI] Optimize long host to short host and long host display in k8s
4 years ago
0eb8c0c234
[Improvement][common]Task status error
4 years ago
73f5a8e0a7
[Feature][JsonSplit] Fix master/worker server ( #5253 )
...
* Fix dependency failure
* Fix taskInstance
* task instance list page
* code review
* fix logger path
* Fix master/worker server
Co-authored-by: JinyLeeChina <297062848@qq.com>
4 years ago
31188ffca0
[Feature][JsonSplit] Fix taskInstance ( #5246 )
...
* Fix dependency failure
* Fix taskInstance
* task instance list page
* code review
* fix logger path
Co-authored-by: JinyLeeChina <297062848@qq.com>
4 years ago
73e917d3c1
Clean up useless files. ( #5252 )
4 years ago
8c88bfa222
Fix dependency failure ( #5239 )
...
Co-authored-by: JinyLeeChina <297062848@qq.com>
4 years ago
2f1f193ba8
Update common.properties ( #5223 )
4 years ago
86ce8f133a
[JsonSplit-4417][master/worker/api]json split- remove json in task instance. ( #5160 )
...
* [json split] refactor json in task instance
* add task_pramas in task_instance
* feature #4417 refactor json split in task instance
* code style
* code style
* code style
* code style
* code style
* update
* update
* update unit test
* update
4 years ago
dd36da8d1f
[Feature][JsonSplit] fix process bug ( #5193 )
...
* transform taskCode from long to string
* fix process bug
* code review
* code review
* code review
Co-authored-by: JinyLeeChina <297062848@qq.com>
4 years ago
e53369318b
[Fix-4721][worker]The shell background starts the YARN task scenario, and the kill function is abnormal ( #4722 )
...
* fix the shell starts the yarn task in the background
* update StringUtils code style.
* solve code smell.
* add method comment in StringUtils class.
* update AlertGroupMapper code style.
* update AlertGroupMapperTest
* update sql script test.
4 years ago
689106d114
transform taskCode from long to string ( #5174 )
...
Co-authored-by: JinyLeeChina <297062848@qq.com>
4 years ago
a467fffd7b
[Feature][JsonSplit] fix taskId in json ( #5165 )
...
* modify checkDAGRing and ProcessService method
* merge
* modify dagRing
* modify process instance for project home page
* fix save process bug
* codeStyle
* Fix logical bug in saving process definition
* codeSytle
* Fix bug in interface of queryProcessDefinitionList
* codeSytle
* Fix api bug"
* fix taskId in processDefinitionJson
* fix json taskId
* codeStyle
Co-authored-by: JinyLeeChina <297062848@qq.com>
4 years ago
a6a1b94df4
[Feature-#5128]Support turning off sudo permissions ( #5129 )
...
* [Feature-#5128]Support turning off sudo permissions
* [Feature-#5128] without sudo permission do not create tenant user
4 years ago
492b318bd3
[Fix][Server] Fix clear task execute path is related to master ( #5123 )
4 years ago
cd19507271
[feature][jsonsplit]fix copy/export/import processDefinition bugs ( #5146 )
...
* Modify Project and ProjectUser Mapper
* Modify Project and ProjectUser Mapper
* project_code is bigint(20)
* modify ERROR name
* modify saveProcessDefine, remove the duplicate code with createTaskAndRelation
* modify import/export processdefinition, add genProcessData
* fix ut and bug
* code style
* repalce project_id with code
* conflicts solve
* conflicts solve
* conflicts solve
* bugfix
* modify listResources mothod and remove getResourceIds mothod
* 1
* conflicts solve
* modify listResources mothod and remove getResourceIds mothod
* modify listResources mothod and remove getResourceIds mothod
* replace processDefinitionVersion with processDefinitionLog
* codestyle
* codestyle
* add mapper module ut
* codestyle
* fix ProcessInstanceMapperTest
* codestyle
* conflicts solve
* conflicts solve
* conflicts solve
* conflicts solve
* conflicts solve
* fix ProcessInstanceMapperTest
* fix ProjectMapperTest/ProjectUserMapperTest/ScheduleMapperTest
* fix ProjectMapperTest/ProjectUserMapperTest/ScheduleMapperTest
* fix TaskInstanceMapperTest
* add TaskDefinitionLogMapperTest/TaskDefinitionMapperTest and bugfix
* codestyle
* codestyle
* Refactor process lineage
* Refactor process lineage
* codestyle
* codestyle
* Refactor process lineage
* Refactor process lineage
* add WorkFlowLineageMapperTest/WorkFlowLineageServiceTest
* add WorkFlowLineageMapperTest/WorkFlowLineageServiceTest
* add ProcessServiceTest
* 1
* 1
* fix copy/export/import processDefinition bugs
* 1
* codestyle
4 years ago
1eaf1f6234
[Feature][JsonSplit] fix taskId in processDefinitionJson ( #5136 )
...
* modify checkDAGRing and ProcessService method
* merge
* modify dagRing
* modify process instance for project home page
* fix save process bug
* codeStyle
* Fix logical bug in saving process definition
* codeSytle
* Fix bug in interface of queryProcessDefinitionList
* codeSytle
* Fix api bug"
* fix taskId in processDefinitionJson
Co-authored-by: JinyLeeChina <297062848@qq.com>
4 years ago
zhuangchong
kyoty
blackberrier
Kirs
Shiwen Cheng
QuakeWang
Yao WANG
ruanwenjun
lcdrs
JinyLeeChina
baoliang
bao liang
luoyuan
roi
didiaode18
xiaoyu
guohaozhang
Simon