Jiajie Zhong
d3f087e29b
[feat][ci] Add pre-commit for easy spotless config ( #12192 )
...
* Use pre-commit to handle spotless check
* Migrate exists python pre-commit-config into dir root one
* Change related document
2 years ago
Eric Gao
d1e409e9a2
[Improvement][Test] Remove powermock in service and server modules ( #12164 )
...
* Remove powermock and refactor some related code in dolphinscheduler-service and dolphinscheduler-server modules
* Remove redundant comments
* Add null check
2 years ago
darkz
995c1480f9
[Document][Improvement] Polish docs for standalone deployment ( #12181 )
...
* Polish docs for standalone deployment
2 years ago
JieguangZhou
856083d591
fix ml group ( #12172 )
2 years ago
TyrantLucifer
4973b30efb
[Feature][doc] Add a guide to nominate new committer ( #12175 )
...
Co-authored-by: Kirs <ACM_China@yeah.net>
2 years ago
Stalary
aa5526ef5d
[Improvement][Test] Remove Powermock in dolphinscheduler-task-plugin ( #12153 )
...
* Remove the usage of powermock in task-plugin module
2 years ago
Jiajie Zhong
ad4f344283
[fix][test] Fix flaky test in CI ( #12017 )
2 years ago
Wenjun Ruan
d526dd89f6
[hotfix][UI] Remove SURVEIL and NEXT_LOOP in ui ( #12160 )
...
* Remove SURVEIL and NEXT_LOOP in ui
* Fix UT
2 years ago
Chris
7ed52c3ecb
[improve][python] Validate version of Python API at launch ( #11626 )
2 years ago
xuhhui
6466cc7c41
[Improvement][Master] Construct processInstance may NPE when master handling command ( #12056 )
...
* [Improvement][Master] Construct processInstance may NPE when master handling command
* use an enpty map
Co-authored-by: xuhaihui <xuhaihui@cmss.chinamobile.com>
2 years ago
Jiajie Zhong
b95db44130
[fix][doc] Do not change docsdev.js during releasing ( #12151 )
...
ref: https://github.com/apache/dolphinscheduler/pull/12146#discussion_r979708629
and https://github.com/apache/dolphinscheduler-website/pull/829
2 years ago
Devosend
87490a34cc
fix env config space bug ( #12147 )
2 years ago
Eric Gao
cc82206c33
Remove powermock in dolphinscheduler-master module ( #12143 )
...
* Remove powermock related code in dolphinscheduler-master module
* Remove redundant comments, useless code and unnecessary stubbings
2 years ago
Kerwin
4269fa7ea7
[release][doc] Add release 3.0.1 ( #12139 )
...
* add release 3.0.1
* add 30x version in the github bug report
2 years ago
冯剑
779a0b9c75
[Improvement-#11608][task-plugin] New time variables are added to facilitate business development ( #11667 )
...
Add new time expressions for users' convenience
Co-authored-by: 冯剑 Jian <jian.feng@jiduauto.com>
Co-authored-by: David <dailidong66@gmail.com>
2 years ago
caishunfeng
151c2d2c70
fix upgrade sql ( #12141 )
2 years ago
Tq
cf5a8894e2
[BUG][BE-12113]fix htrace dependency conflicts ( #12126 )
...
* fix htrace dependency conflicts
* replace htrace-core with hbase-noop-htrace
2 years ago
zhuxt2015
e6832220c3
[Improvement][SQL Task]use default sql segment separator ( #10869 )
2 years ago
labbomb
64f4cb4f3e
refactor: dag-menu refactor ( #11965 )
...
* refactor: dag-menu refactor
* feat: add i18n support for the dag-menu
* feat: add e2e class
Co-authored-by: devosend <devosend@gmail.com>
Co-authored-by: Tq <tianqitobethefirst@gmail.com>
2 years ago
Yann Ann
289e1ecdc6
[Bug] [Common] update IPv4 Pattern ( #11762 )
...
* [Bug] [Common] IPv4 Pattern is wrong. #11758
2 years ago
Yann Ann
ada7cf71d5
[fix#12000]Cannot remove the WorkerGroup from the master service ( #12050 )
...
* [Bug] [Master] Cannot remove the WorkerGroup from the master service. #12000
* remove unnecessary locks
* Update dolphinscheduler-master/src/main/java/org/apache/dolphinscheduler/server/master/registry/ServerNodeManager.java
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2 years ago
Eric Gao
064224696f
[Doc][Improvement] Add instructions for process execution type and data complement ( #12121 )
...
* Add instructions for process execution type and data complement
* Fix and polish the docs
2 years ago
Jiajie Zhong
82ddd72e4a
[Feature][API] New restful API for workflow and schedule ( #11912 )
...
* [feat] New restful API for workflow and schedule
CURD for workflow and schedule, different with exists
API, this new restful api only operate single resource
in each request, and return the latest. For example,
previous workflow should also need to post tasks definition
and tasks relation definition, but this patch will allow
you to create workflow without task relate information
* use checkProjectAndAuthThrowException, and fix CI error
* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/controller/ScheduleV2Controller.java
* change method name
from createProcessDefinitionV2 to createSingleProcessDefinition
from updateProcessDefinitionV2 to updateSingleProcessDefinition
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2 years ago
Jiajie Zhong
a86f4e2693
[fix][python] Task switch branch not show in webui ( #12120 )
...
when create task switch in python api, switch branch not show correctly,
due to we add some unnecessary attribute to switch task, this patch we
add `_task_ignore_attr` in class `Task` to ignore those unnecessary
attribute from `_task_default_attr`
2 years ago
Jiajie Zhong
2531c222de
[Fix] Also auto formatter workflow instance if location is null ( #12080 )
...
* [fix] Also auto formatter workflow instance if location is null
In #11535(096fae77
) and #11681(4dca488c
), we already formatter
workflow definition, but I find out we forget formatter workflow
instance with definition's location is null, this patch also
formatter workflow instance.
* remove console log
2 years ago
JieguangZhou
6eb1eb722a
fix python home conflict ( #12112 )
2 years ago
Amy0104
e11e129cda
[Improvement][UI] Add filterable for `src_table` and `target_table` in the data quality task. ( #12099 )
2 years ago
chenrj
b1b57c8fb7
[feat][python] new resource plugin GitHub and gitlab ( #11831 )
...
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
Co-authored-by: JieguangZhou <jieguang_zhou@163.com>
Co-authored-by: Devosend <devosend@gmail.com>
Co-authored-by: juzimao <578961953@qq.com>
2 years ago
jackfanwan
6e03a7e557
[BUG]Delete Setting ID ( #12096 )
...
* Delete Setting ID
* modify id
Co-authored-by: jackfanwan <fanwanlong@kezaihui.com>
2 years ago
Lyle Shaw
cc492c3e13
[Feature] Add CURD to the project/tenant/user section of the python-DS ( #11162 )
...
- Add CURD in project
- Add CURD in tenant
- Add CURD in user
- Add test in user
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2 years ago
Wenjun Ruan
fba5a8eaa0
Fix insert command error due to the id is not null ( #12092 )
2 years ago
冯剑
9b3b4e22b4
[Bug-#12057][task-plugin] fix when the sql query result is empty, the email fails to send the attachment, and an exception will be reported ( #12059 )
...
* [Bug-#12057][task-plugin] fix when the sql query result is empty, the email fails to send the attachment, and an exception will be reported
Co-authored-by: 冯剑 Jian <jian.feng@jiduauto.com>
2 years ago
rickchengx
08a4c7981f
[improve] Remove the spark version of spark task ( #11860 )
2 years ago
JieguangZhou
cf522e2fc0
[improve] Optimize MLFlow task plugin for easy of use ( #12071 )
...
optimize code
2 years ago
Eric Gao
b52da64001
[Improvement][UT] Upgrade jUnit to 5.+ ( #10976 ) ( #11332 )
...
* [Improvement][UT] Upgrade jUnit to 5.+ (#10976 )
* Refactor AlertServerTest with jUnit-5 as an example
2 years ago
jackfanwan
7d80ea34ac
[Improvement] Add Set cluster name ( #12074 )
2 years ago
limaiwang
ed1d1e8856
add(dependent node's add unprivileged project list): dependent node's add unprivileged project list ( #12073 )
2 years ago
Wenjun Ruan
cb4ef54a0e
Script cannot contains ''' in params ( #12067 )
2 years ago
Eric Gao
66958b91d7
[Feature][Resource Center] Add support for Alibaba Cloud OSS as storage of resource center ( #11708 )
...
* Add support for Alibaba Cloud OSS as storage of resource center
* Add dependency licenses
* Refactor code, add unit tests and related docs
2 years ago
Wenjun Ruan
26dad5e2a8
Fix update TaskDefinition error ( #12060 )
2 years ago
jackfanwan
0bf639b851
[improvement]Add Set cluster name ( #12058 )
...
* Add Set cluster name
* add unit test
Co-authored-by: fanwanlong <fanwanlong@kezaihui.com>
2 years ago
insist777
955e8ebe0f
[Improve] Fix support test tasks UT ( #12062 )
2 years ago
金鑫
649015bfff
[Bug][ApiServer] When modifying the task definition, inserting the task definition log table will report the bug of primary key conflict #12037
...
Co-authored-by: 金鑫 <jinyanhui@huansi.net>
2 years ago
Eric Gao
e1b55db72a
[Improvement][Test] Give an example on replacing Powermock with Mockito ( #11588 )
...
* Give an example on replacing powermock with mockito
* Remove redundant comments
* Refactoring related UTs for better readability.
2 years ago
rickchengx
b3bbf69b2e
[Improvement-11291][sql] Improvement the log output while executing multiple sql statements ( #11292 )
2 years ago
songjianet
8cddb10773
[Feat][UI] Update package. ( #12046 )
...
* [Feat][UI] Update package.
* [Feat][UI] Update package.
2 years ago
Kerwin
89d55bc9b7
Fix link errors in release documentation. ( #12049 )
2 years ago
juzimao
c8884e4f2f
and task instance date range search ( #11963 )
2 years ago
JieguangZhou
ad683c3c42
[feat][python] Support MLflow task in python api ( #11962 )
2 years ago
limfff
c24ad9adb6
[Fix] Fixed an error importing project Maven ( #12026 )
2 years ago