38b643f69b
make sure all failed task will save in errorTaskMap ( #12424 )
2 years ago
ba538067f2
[fix] Change the default unix shell executor from sh to bash ( #12180 )
...
Co-authored-by: Kerwin <37063904+zhuangchong@users.noreply.github.com>
2 years ago
3bef85f546
fix datax NPE issue ( #12388 )
2 years ago
fccbe5593a
When the workflow definition is copied, the operation user of the timed instance is changed to the current user. ( #12400 )
2 years ago
c7e6e827bd
Add Spotless step to check and block jUnit4 imports ( #12398 )
2 years ago
c02e08bb3d
[BUG-12396][Schedule] Fixed that the workflow definition scheduling that has been online after the version upgrade does not execute ( #12397 )
...
* Fixed that the workflow definition scheduling that has been online after the version upgrade does not execute.
2 years ago
4ea7eec750
Use temurin Java docker images instead of deprecated ones ( #12334 )
2 years ago
934d6d21eb
[Bug] [Service] Use MapUtils to judge globalParamsMap is empty. ( #12384 )
2 years ago
1d0d26a416
[fix#12170] If the worker's clock early than master node, will ignore dispatch time. ( #12219 )
...
* add doc to guide user configure synchronized clocks.
2 years ago
55004bebe0
[Improvement-12391][API] Workflow definitions that contain logical task nodes support the copy function ( #12392 )
...
* Workflow definitions that contain logical task nodes support the copy function.
2 years ago
b7bd8d7803
[Improvement] add presto in datax ( #12371 )
2 years ago
7aa8a77fb2
[Migrate][Test] Migrate other UT cases from jUnit 4 to 5, change @Ignore to @Disable
2 years ago
a725614429
[docs] change optional parameters --jar to --jars for Spark ( #12385 ) ( #12386 )
2 years ago
bc80f34056
[Migrate][Test] Migrate all UT cases from jUnit 4 to 5 in master, worker, and remote modules ( #12362 )
...
* migrate junit4 -> junit5 in master, worker, and remote modules
2 years ago
cd5fb12e46
[Bug][Python] Python class description error ( #12360 )
2 years ago
1e792186d0
[Fix][Worker] fix wrong env var name for alert in K8S ( #12369 )
2 years ago
7b44612f28
[Improvement-12372][k8s] Update the deprecated k8s api ( #12373 )
2 years ago
2f37da0dbc
[Improvement][Test] Block the usage of powermock and move mockito dependencies from sub-modules to root pom ( #12311 )
...
* move mockito dependencies from sub-modules to root pom
* Add check in CI to block the usage of powermock
2 years ago
b953cdc559
update english oracle.md ( #12332 )
2 years ago
b357781df2
[Migrate][Test] Migrate junit4 -> junit5 test cases in common, service, and spi modules ( #12363 )
2 years ago
c50cc997a8
[Doc][Bug] Fix dead link caused by markdown cross-files anchor ( #12357 )
2 years ago
ac845046e7
[Migrate][Test] Migrate all UT cases from jUnit 4 to 5 in datasource, registry and data-quality modules ( #12352 )
...
* Migrate all UT cases from jUnit 4 to 5 in datasource, registry and data-quality modules
* Fix etcd registry test
2 years ago
9652964c94
[python] Add resource plugin for python, dataX, CustomDataX and Sql ( #12135 )
2 years ago
22103f975e
[improvement] Migrate all UT cases from jUnit4 to jUnit5 in dao module ( #12328 )
...
* [improvement] Migrate all UT cases from jUnit4 to jUnit5 in dao module
Co-authored-by: Jackie <‘2875334588@qq.com’>
2 years ago
224508850e
[Migrate][Test] Migrate all UT cases from jUnit 4 to jUnit 5 in alert and api module ( #12337 )
...
* Migrate all UT cases from jUnit 4 to jUnit 5 in alert and api module
* Fix potential problems
2 years ago
db1d319159
Reorganize some classes in common module, remove duplicate classes ( #12321 )
2 years ago
17cd644506
[Fix-#11669][Workflow Instance Page] Fix the duration in Workflow Instance page. ( #12264 )
...
* fix process duration issue
* use processInstance.getState().isFinished() replace new isFinish function
* add WorkflowUtils
2 years ago
0e1c8d8153
[Feature][API] New restful API task and task relation ( #12116 )
2 years ago
6332fee2b5
[Improvement-12289][k8s] update the common.properties in values.yaml ( #12290 )
2 years ago
501119bbb6
[doc] Change release process base on new tool ( #12324 )
...
ref: #11478 we already have a new tool for releasing
2 years ago
2525545a41
[dev] Easier release: cherry-pick, changelog, contributor ( #11478 )
...
Add script for easier release including cherry pick,
generating changelog and contributor list
* Auto cherry-pick: `python release.py cherry-pick`
* Generate changelog: `python release.py changelog`
* Generate contributor: `python release.py contributor`
close : #11289
related: #12222
2 years ago
04e1b88c1c
[fix] Fix error problem on h2 startup data quality rule management page ( #12108 )
...
Co-authored-by: jegger <zhangbq3306@163.com>
2 years ago
05099bd8f7
[Improvement-12296][Test] Close static mock ( #12300 )
2 years ago
875682d267
[Improvement][Test] Migrate all UT cases from jUnit4 to jUnit5 in task-plugin module as an example ( #12299 )
...
* Migrate all UT cases from jUnit4 to jUnit5 in task-plugin module as an example
2 years ago
18ef0a66cb
Set the id to null when copying t_ds_schedules ( #12280 )
...
Co-authored-by: fanwanlong <fanwanlong@kezaihui.com>
2 years ago
98a8b5383e
[ fix : #11590 ][upgrade] Fix the bugs when I upgrade ds from v1.3.9 to v3.0.0 ,such as file cannot be found or column not found etc ( #11619 )
...
* fix the bugs which upgrade ds metabase from v1.3.9 to v3.0.0 with mysql
* [Fix-11590][upgrade] Fix the bugs when I upgrade ds from v1.3.9 to v3.0.0 ,such as file cannot be found or column not found etc
* fix : #11590 add process_instance_code_state_index with table t_ds_process_instance to improve query efficiency for the method of findLastProcessInterval
* Fix the bug that cannot find the files when upgrade ds version with postgresql
Co-authored-by: fan.wang <fan.wang@jiduauto.com>
2 years ago
e1ac0e2605
[python] Add new resource plugin: gitlab, OSS and S3 ( #12025 )
...
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2 years ago
a973054950
[ci] Milestone and Label are required before the PR merged ( #12222 )
...
To make our release process easier, I plan to mark milestone
and label is required before the PR merged, they use for
* label: In this path we required label with at least on with
'feature|bug|improvement|document|chore' to make our changelog
more convenient
* milestone: For easier to cherry-pick PR, currently some of
our milestone only exists in issue and not exists in related
PR, it may
2 years ago
ef328d9cea
Update ZooKeeper minimum version requirements ( #12284 ) ( #12288 )
2 years ago
d9ac1fa0f7
[Fix#12231][scheduler-plugin] fix the bug which some scheduled tasks are not triggered on time ( #12233 )
...
Co-authored-by: fan.wang <fan.wang@jiduauto.com>
2 years ago
c8bd106604
create oracle help.md ( #12218 )
...
* create oracle help.md
* Add files via upload
allow Oracle to choose schema
* move pic under img and add title for oracle.md
2 years ago
9ab79e064c
[Improvement][Test] Fully remove the usage of powermock from the whole project ( #12244 )
...
* Fully remove the usage of powermock from the whole project
* Upgrade org.reflections to 0.10.12
2 years ago
dec28b5c2e
[improve] Correct some log in scheduler ( #12278 )
2 years ago
9b1ee1516f
[doc] Correct descriptions in glossary.md ( #12282 )
2 years ago
b4947b471c
fix this issue ( #12281 )
2 years ago
7bf49a7179
delete useless exclusions ( #12273 )
...
delete software.amazon.awssdk datasync useless dependency exclusions
2 years ago
165b9a58de
[DS-12131][master] Optimize the log printing of the master module acc… ( #12152 )
...
* [DS-12131][master] Optimize the log printing of the master module according to the log specification.
2 years ago
a865be09b6
Remove powermock from DatasyncTaskTest ( #12270 )
2 years ago
c7435a51ac
[Feature][task-plugins] aws datasync task plugins ( #11865 )
...
* submit datasync task
* add aws software package license
2 years ago
2e4a9e6d53
Fix mysql registry doesn't support array ( #12255 )
2 years ago
Yann Ann
simsicon
Kerwin
Eric Gao
kezhenxu94
houshitao
fuchanghai
limaiwang
chenrj
司马琦昂
rickchengx
Chris-Arith
Jiajie Zhong
jegger
jackfanwan
Ivan
tuchg
calvin
Tq
sgw
Wenjun Ruan