Wenjun Ruan
af83c14298
Fix sonar cannot work ( #16307 )
6 months ago
Wenjun Ruan
2db80981ca
[DSIP-56] Refactor JDBC registry support session timeout and data change event ( #16287 )
...
* Support sessionTimeout in jdbc registry
* Add registry table to initialize sql
6 months ago
xiangzihao
761323f3e1
[DSIP-53] Suggest add process lineage parsing for dependent task ( #16288 )
...
* add dsip 53
6 months ago
xiangzihao
e8566818b0
[DSIP-50][UDF Manage] Remove unused udf manage function ( #16212 )
...
* Remove unused udf manage function
6 months ago
Wenjun Ruan
ec6a3e0727
[DSIP-46] Unify the logic task params data structure between front-end and back-end ( #16193 )
6 months ago
Wenjun Ruan
f0e0395b36
[Chore] Use testcontainer origin exposed port rather than generate random port ( #16195 )
6 months ago
Wenjun Ruan
edeb1b2458
[DSIP-45] Polish the Storage SPI ( #16141 )
6 months ago
Wenjun Ruan
3bc88e32c7
Rename dolphinscheduler-aop to dolphinscheduler-yarn-aop ( #16095 )
7 months ago
Wenjun Ruan
cb0b4fa52f
Deprecated 2.0.9/3.0.6 upgrade test ( #16012 )
7 months ago
Wenjun Ruan
e2c8b080f9
[DSIP-31] Reduce the thread pool size of hikari ( #15890 )
8 months ago
Wenjun Ruan
285c5a8eb5
[DSIP-28] Donnot scan whole bean under classpath ( #15874 )
8 months ago
Wenjun Ruan
163f8f01f0
Fix jdbc registry cannot work ( #15861 )
8 months ago
Wenjun Ruan
27d0563fe4
Bind processId to constructor CodeGenerator ( #15848 )
9 months ago
Wenjun Ruan
dcf69cad20
Fix PostgresqlDatabaseContainerProvider get Image is incorrect ( #15434 )
11 months ago
Wenjun Ruan
5b6b0ceb31
Fix resource file usage(Delete Resource/ResourceUser which is deprecated) ( #15355 )
1 year ago
Wenjun Ruan
9be81be328
Remove API Result in Service ( #15181 )
1 year ago
Wenjun Ruan
a5284e4024
Remove mapper usage in tools ( #15073 )
1 year ago
Wenjun Ruan
2350775272
Add IT for mysql5/postgresql16 initialize/upgrade ( #15063 )
1 year ago
Wenjun Ruan
b750db3c37
Add IT for dolphinscheduler-tools module ( #15043 )
1 year ago
Wenjun Ruan
020092ed1e
Set charset in upgrading tools to solve read upgrade sql mojibake ( #14955 )
1 year ago
Jay Chung
25e841a228
chore: Correct db upgrade and add ci avoid regression ( #14620 )
...
add atlasgo to ci
https://atlasgo.io/declarative/diff
related: https://github.com/apache/dolphinscheduler/issues/11286
BTW, it seems some ddl change only exist in 3.1.3、3.1.5、3.1.6 but do not exist in dev which will also cause an error when updating from those version
1 year ago
sleo
139f23040a
[Fix-14668][dolphinscheduler-tools] Modify the imported jar package. Use org.apache.commons.lang3.StringUtils. ( #14669 )
1 year ago
Kerwin
79cb707b57
[Improvement-13932][API] Tenant parameters and Worker group parameters are put together in the task startup parameters ( #13935 )
...
* [Improvement][API] Tenant parameters and Worker group parameters are put together in the task startup parameters
2 years ago
Bingchang Chen
75544025df
[Improvement] Fix typos in tools for demo ( #13538 )
2 years ago
Aaron Wang
f3134c7ce7
[Feature][Resource Center] One-time migration script for unmanaged resources ( #13512 )
2 years ago
seedscoder
8d12dc0702
[Improvement-13491] Use lombok @Slf4j annotation to generate logger ( #13509 )
2 years ago
Wenjun Ruan
ef47e7efeb
Use parallelStream to improve the performance of upgrade ( #13442 )
2 years ago
Wenjun Ruan
713fdbc444
Split the upgrade code ( #13436 )
...
1. Split the upgrade code into different version
2. Log the dml/ddl sql in origin friendly format
3. Fix ddl of 3.0.0 and 3.1.0
4. Fix search resource regular expression injection
2 years ago
Wenjun Ruan
483330273d
Remove entity in QueryWrapper constructor ( #13396 )
2 years ago
Wenjun Ruan
8a479927f3
Add projectCode in t_ds_process_instance and t_ds_task_instance to remove join ( #13284 )
2 years ago
Yann Ann
6ef74073cc
[Improve-13001]migrate commons-collections -> commons-collections4 ( #13002 )
2 years ago
amao
b71d4983dd
[Feature-6586][Server]add some ds process definition demo when init ( #11759 )
...
* [Feature-6586][Server]add some ds process definition demo when init
1.add some ds process definition demo when init, to display what task type can run and make user easy to
use ds.
2.need configure the JVM parameters (-Ddemo=true) to turn on the StandaloneServer service
3.need modify the tenant information in it
2 years ago
Aaron Wang
08335b1032
[Improvement][Task] Improved way to collect yarn job's appIds ( #12197 )
...
* Provide aop way as an optional way to collect yarn job's applicationId, and import new module `dolphinscheduler-aop` to place the aop code.
* Add user property `appId.collect` for user to decide how to collect applicationId.
* Add new environment configuration for each type of yarn tasks to support aop in `dolphinscheduler_env.sh`
* Update docs to declare how to use aop way.
* Update `LogUtils` to support fetch applicationId in different ways based on the user property.
Co-authored-by: gabrywu <gabrywu@apache.com>
2 years ago
caishunfeng
dedff70f90
[Improvement] Merge spi.utils into common.utils ( #12502 )
...
* improve JSONUtil
* merge spi.utils into common.utils
* split constants && remove some copy utils method
* remove StringUtils
2 years ago
Eric Gao
d46e4659d9
[Improvement][Style] Fix remaining style errors and wildcard imports ( #12412 )
...
* Fix remaining style errors and wildcard imports
* Upgrade spotless to the latest stable version, exclude .github folder from spotless check and fix dead link
* Fix spotless matching scope of markdown files
2 years ago
kezhenxu94
4ea7eec750
Use temurin Java docker images instead of deprecated ones ( #12334 )
2 years ago
Daniel Y
009cb68011
[Improvement-11834] Upgrade docker base image to support python3.9 ( #11835 )
...
* use openjdk:8-jre-slim-bullseye instead of buster to support python3.9
* use openjdk:8-jre-slim-bullseye instead of buster across all components
2 years ago
caishunfeng
2e61c76c22
[Improvement] Add remote task model ( #11767 )
2 years ago
kezhenxu94
efedc9a53c
Bump up dependencies to fix cves ( #11765 )
2 years ago
kezhenxu94
0b82755796
Fix some resource leak ( #11576 )
2 years ago
Wenjun Ruan
5e9c7dad23
Add dolphinscheduler-bom to manage the dependency version ( #11025 )
2 years ago
Eric Gao
42d4aba347
[Bug][Tools] Add datasource url for mysql profile in tools application.yaml ( #10399 )
3 years ago
kezhenxu94
d80cf21456
Clean up unused dependencies and packaging issues ( #9944 )
3 years ago
caishunfeng
4351148f36
[Bug] init docker compose DATABASE env ( #10244 )
...
skip source env if in docker
3 years ago
旺阳
aba5f8a40e
[improve] Change Mysql Driver ( #10220 )
3 years ago
旺阳
de5507fb19
[Fix-10103][k8s]Fix k8s Change DataSource Error ( #10128 )
3 years ago
caishunfeng
b1885c7a26
[Bug] fix run on docker and k8s ( #10026 )
...
* fix docker-compose init schema
* recovery depend on zk
* update doc and dockerfile
* fix run on k8s
* udpate doc
* add DOCKER flag & update doc
* remove repeat DOCKER env
3 years ago
xiangzihao
baf654cb47
[Feature-9474] [CI] Add cluster test script verify on shell script ( #9997 )
...
* cluster test
* fix init db failed
* fix init db failed
* fix init db failed
* fix init db failed
* fix init db failed
* add github actions
* add github actions
* add github actions
* add github actions
* add github actions
* add github actions
* add sudo
* add github actions
* add github actions
* add github actions
* add github actions
* add github actions
* add github actions
* add github actions
* add github actions
* add github actions
* add github actions
* add github actions
* add github actions
* add github actions
* add github actions
* add github actions
* remove cluster-test workflows
* add github actions
* add github actions
* refactor test to docker mode
* refactor test to docker mode
* refactor test to docker mode
* refactor test to docker mode
* remove create schema logic
* remove create schema logic
* remove create schema logic
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* fix runnint cluster test error
* add github actions
* add github actions
* add github actions
* add cluster test timeout
* add cluster start test loop check
* add cluster start test loop check
* optimize cluster start test loop check
3 years ago
Eric Gao
515c363148
[Feature][Deploy] Add missing default values in dolphinscheduler_env.sh ( #9733 )
...
* [Feature][Deploy] Add missing default values in dolphinscheduler_env.sh (#9675 )
* [Feature][Deploy] Restore dolphinscheduler_env.sh to avoid e2e failure (#9675 )
* [Feature][Deploy] Change mysql driver class name to com.mysql.cj.jdbc.Driver (#9675 )
* [Feature][Deploy] Remove redundant config file (#9675 )
3 years ago
Jiajie Zhong
de50f43de6
[common] Make dolphinscheduler_env.sh work when start server ( #9726 )
...
* [common] Make dolphinscheduler_env.sh work
* Change dist tarball `dolphinscheduler_env.sh` location
from `bin/` to `conf/`, which users could finish their
change configuration operation in one single directory.
and we only need to add `$DOLPHINSCHEDULER_HOME/conf`
when we start our sever instead of adding both
`$DOLPHINSCHEDULER_HOME/conf` and `$DOLPHINSCHEDULER_HOME/bin`
* Change the `start.sh`'s path of `dolphinscheduler_env.sh`
* Change the setting order of `dolphinscheduler_env.sh`
* `bin/env/dolphinscheduler_env.sh` will overwrite the `<server>/conf/dolphinscheduler_env.sh`
when start the server using `bin/dolphinsceduler_daemon.sh` or `bin/install.sh`
* Change the related docs
3 years ago