Shiwen Cheng
93f1d4df7d
[Improvement-5405][Docker/K8s] Adapt to registry SPI ( #5681 )
3 years ago
YulongZ
f7e551282a
docker-compose wrong env ( #5664 )
...
* docker-compose wrong env
3 years ago
Kirs
30c88032d3
[Feature-#3961][Registry]Registry-SPI ( #5562 )
...
[Feature#3961]Registry SPI
All the logical structure of the registry must be converted into a tree structure within the system, so some plug-ins must be converted internally, such as ETCD
The registry supports distributed locks.
todo: The specific information about the registration center of the API module needs to be adjusted.
4 years ago
Kirs
e2243d63be
[Feature-#3961][Registry]Registry-SPI ( #5562 )
...
[Feature#3961]Registry SPI
All the logical structure of the registry must be converted into a tree structure within the system, so some plug-ins must be converted internally, such as ETCD
The registry supports distributed locks.
todo: The specific information about the registration center of the API module needs to be adjusted.
4 years ago
Shiwen Cheng
b537f4eb26
[Improvement][Docker/K8s] Support more configurations and service accesses, reduce the duplication configurations, improve image for python and the compatibility of python home ( #5393 )
...
* [Improvement][Docker] Support more configurations and improve image for python
* [Improvement][K8s] Support more configurations, more service accesses, and reduce the duplication configurations
* [Improvement][Python] Improve the compatibility of python home
* [Improvement][Install] Fix install config and install.sh
* [Improvement][Install] Fix workflow ut
* [Improvement][Docker] Optimize docker-swarm/check script
* [Improvement][DB] Update default username and password of database
* Update comments in master/worker.properties
* Specify version for all images
* [Improvement][Docker] Optimize PS1 and WORKDIR
* [Improvement][SQL] Reduce heap size to 64m in create-dolphinscheduler.sh and upgrade-dolphinscheduler.sh
* [Fix-5431][K8s] Fix master and worker cannot get the right address with custom DNS
4 years ago
Shiwen Cheng
1cd62b4a5e
[Improvement][Datax] Re-assign DATAX_HOME to /opt/soft/datax instead of /opt/soft/datax/bin/datax.py ( #5019 )
4 years ago
游侠
2d8c4ec86b
[Improvement][Worker-Task] Python Command ( #5036 )
...
* create the interpreter for python command
* Update README.md
Co-authored-by: zhouhong <zhouhong@zhangyue.com>
4 years ago
wenjun
fd4b59ad6c
[Improvement][Worker] Rename worker.weight to worker.host.weight ( #4997 ) ( #5014 )
4 years ago
chengshiwen
d3afa1f93e
[Improvement][Docker] Support docker compose file 3.1+ version
4 years ago
chengshiwen
da6e1500cb
[Improvement][Docker] Add DOLPHINSCHEDULER_OPTS for docker compose/swarm
4 years ago
chengshiwen
4cab4095e9
[Improvement][Docker] Update environment variables
4 years ago
chengshiwen
6911a39b49
[Improvement][Docker] Add FAQ in readme
4 years ago
chengshiwen
3b562f557d
[Fix-4886][Docker] Fix invalid volume specification in Windows
4 years ago
wangdazhong001
73b2d5b7fc
[Fix-4843] Rename WORKER_GROUP to WORKER_GROUPS ( #4843 ) ( #4856 )
...
* [Fix-4843] docker yml
* [Fix-4843] k8s env
* [Fix-#4843] fix startup-init-conf.sh worker.properties.tpl WORK_GROUP change WORK_GROUPS
* [Fix-#4843] fix README.md README_zh_CN.md WORK_GROUP change WORK_GROUPS
Co-authored-by: wangdz50 <wangdz50@chinaunicom.cn>
4 years ago
Shiwen Cheng
149b0dab4d
[Improvement][Docker] Sync docker conf templates to the latest conf properties ( #4772 )
4 years ago
Shiwen Cheng
cbada7c16d
[Improvement][Docker] Reduce docker image size, remove frontend/nginx, remove stdout log, improve compose/swarm deployment and fix random PSQLException ( #4643 )
...
* [Improvement][Docker] Reduce docker image size, remove frontend/nginx, remove stdout log and improve compose/swarm deployment
* [Improvement][Docker] Fix random PSQLException
4 years ago
lgcareer
25bf49b074
[Fix-3238][docker]Fix that can not create folder in docker with standalone mode
4 years ago
lgcareer
1c07892fea
[Fix-3238][docker]Fix that can not create folder in docker with standalone mode ( #3741 )
4 years ago
CalvinKirs
d6a32ac652
[Feature#3234][cluster]enhanced load balancing ( #3235 )
...
* [Future#3234][cluster]enhanced load balancing
weight-based load balancing algorithm
this close # 3234
* remove useless parameter
* code smell
* load balancing according to work group
* add smooth weight round robin
* remove unused constants
* perfect unit test
* code smell
* code smell
* add work weight config
* fix config error
* add weight docs to readme.md
4 years ago
rockxsj
b6a0d55949
fix and update k8s deploy ( #3215 )
...
* Modify the AWS S3 request encryption method to V4.
* * update Dockerfile to add mysql-client for mysql database service test
* update wechat alert config replace placeholder from to {xx} because of the will be treat as env variable
* fix unit test of EnterpriseWeChatUtilsTest
* update values.yaml default config for helm deploy DS cluster
* update values.yaml default config for custom install
* update templates of helm for custom install
* update some name of env varibale, for example change from POSTGRESQL_HOST to DATABASE_HOST
* delele the redundancy requirements.yaml for heml
* update README* in the docker dir and subdir
* update startup scripts for support mysql as backend database
* * fix the ENV name wrong in docker-compose.yml and docker-stack.yml
* remove the didn't need port mapping in postgresql & zookeeper & dolphinscheduler-api
* * keep expose the port of postgresql & zk & api because of unit test needed
* * remove mysql-client package from dockerfile
Co-authored-by: rockxsj <junjun@mgtv.com>
4 years ago
xingchun-chen
e97b4707a5
[Test-2995][e2e] run workflow and timing testCase ( #3201 )
...
* add LoginTest license
* Delete useless packages
* e2e add project and workflow case
* e2e add project and workflow case
* e2e add project and workflow case
* e2e add project and workflow case
* e2e add project and workflow case
* e2e add project and workflow case
* e2e add project and workflow case
* e2e add project and workflow case
* e2e add project and workflow case
* e2e add project and workflow case
* e2e add project and workflow case
* e2e add project and workflow case
* Update worker_group_id to worker_group in init.sql
* Update worker_group_id to worker_group in init.sql
* Update worker_group_id to worker_group
* Increase dataX environment variable, sslTrust default value
* modify dataX environment variable
* update e2e chrome version
* add alert manage testcase and Optimize test case execution order
* add e2e to create and to edit queue
* update e2e chrome version
* add e2e token testcase
* add e2e token testcase
* add e2e to run workflow testcase
* add e2e timing testcase
* add e2e timing testcase
* add e2e timing testcase
* add e2e timing testcase
* Merge remote-tracking branch 'upstream/dev' into dev
# Conflicts:
# e2e/src/test/java/org/apache/dolphinscheduler/page/security/AlertManagePage.java
# e2e/src/test/java/org/apache/dolphinscheduler/page/security/QueueManagePage.java
* Merge remote-tracking branch 'upstream/dev' into dev
# Conflicts:
# e2e/src/test/java/org/apache/dolphinscheduler/page/security/AlertManagePage.java
# e2e/src/test/java/org/apache/dolphinscheduler/page/security/QueueManagePage.java
* Merge remote-tracking branch 'upstream/dev' into dev
# Conflicts:
# e2e/src/test/java/org/apache/dolphinscheduler/page/security/AlertManagePage.java
# e2e/src/test/java/org/apache/dolphinscheduler/page/security/QueueManagePage.java
* Merge remote-tracking branch 'upstream/dev' into dev
# Conflicts:
# e2e/src/test/java/org/apache/dolphinscheduler/page/security/AlertManagePage.java
# e2e/src/test/java/org/apache/dolphinscheduler/page/security/QueueManagePage.java
* Merge remote-tracking branch 'upstream/dev' into dev
# Conflicts:
# e2e/src/test/java/org/apache/dolphinscheduler/page/security/AlertManagePage.java
# e2e/src/test/java/org/apache/dolphinscheduler/page/security/QueueManagePage.java
* Merge remote-tracking branch 'upstream/dev' into dev
# Conflicts:
# e2e/src/test/java/org/apache/dolphinscheduler/page/security/AlertManagePage.java
# e2e/src/test/java/org/apache/dolphinscheduler/page/security/QueueManagePage.java
* Merge remote-tracking branch 'upstream/dev' into dev
# Conflicts:
# e2e/src/test/java/org/apache/dolphinscheduler/page/security/AlertManagePage.java
# e2e/src/test/java/org/apache/dolphinscheduler/page/security/QueueManagePage.java
* Merge remote-tracking branch 'upstream/dev' into dev
# Conflicts:
# e2e/src/test/java/org/apache/dolphinscheduler/page/security/AlertManagePage.java
# e2e/src/test/java/org/apache/dolphinscheduler/page/security/QueueManagePage.java
* Merge remote-tracking branch 'upstream/dev' into dev
# Conflicts:
# e2e/src/test/java/org/apache/dolphinscheduler/page/security/AlertManagePage.java
# e2e/src/test/java/org/apache/dolphinscheduler/page/security/QueueManagePage.java
* Merge remote-tracking branch 'upstream/dev' into dev
# Conflicts:
# e2e/src/test/java/org/apache/dolphinscheduler/page/security/AlertManagePage.java
# e2e/src/test/java/org/apache/dolphinscheduler/page/security/QueueManagePage.java
* Merge remote-tracking branch 'upstream/dev' into dev
# Conflicts:
# e2e/src/test/java/org/apache/dolphinscheduler/page/security/AlertManagePage.java
# e2e/src/test/java/org/apache/dolphinscheduler/page/security/QueueManagePage.java
* Merge remote-tracking branch 'upstream/dev' into dev
# Conflicts:
# e2e/src/test/java/org/apache/dolphinscheduler/page/security/AlertManagePage.java
# e2e/src/test/java/org/apache/dolphinscheduler/page/security/QueueManagePage.java
* Merge remote-tracking branch 'upstream/dev' into dev
# Conflicts:
# e2e/src/test/java/org/apache/dolphinscheduler/page/security/AlertManagePage.java
# e2e/src/test/java/org/apache/dolphinscheduler/page/security/QueueManagePage.java
* edit user
* edit user
* edit user
* edit user
* edit user
* Update TimingLocator.java
* modify ci log
* Update ci_e2e.yml
modify ci logs
* Update ci_e2e.yml
modify ci logs
* Update ci_e2e.yml
modify ci logs
* Update ci_e2e.yml
* Update ci_e2e.yml
modify ci logs
* Update ci_e2e.yml
modify ci logs
* Update ci_e2e.yml
modify ci logs
* Update ci_e2e.yml
modify ci logs
* Update ci_e2e.yml
modify artifact version
* Update ci_e2e.yml
* Update ci_e2e.yml
modify /var/lib/docker/volumes permissions
* Update ci_e2e.yml
modify ci logs
* Update ci_e2e.yml
Modify log file permissions
* Update ci_e2e.yml
modify logs
* Update ci_e2e.yml
modify logs
* Update ci_e2e.yml
modify logs
* modify ci logs
* modify ci logs
* modify ci logs
* modify ci logs
* Update ci_e2e.yml
modify ci logs
* modify ci logs
* modify ci logs
* modify ci logs
* modify ci logs
* modify ci logs
* modify ci logs
* modify ci logs
* Update ci_e2e.yml
modify ci logs
* modify ci logs
* modify ci logs
* modify ci logs
* modify ci logs
* modify ci logs
* modify ci logs
* modify ci logs
* modify ci logs
* modify ci logs
* modify ci logs
* modify tenant
* modify alert wait time
* modify queue wait time
* modify alert wait time
* modify alert wait time
* modify alert wait time
* modify alert wait time
* modify alert wait time
* modify alert wait time
* modify button xpath
* modify queue xpath
* Ignore edit user
* modify alert wait time
* print delete user log
* modify the xpath of delete user button
* modify timing wait time
Co-authored-by: chenxingchun <438044805@qq.com>
Co-authored-by: dailidong <dailidong66@gmail.com>
4 years ago
gaojun2048
58897aa2c5
merge 1.3.0-release branch code
4 years ago
gaojun2048
3cf9afc195
merge 1.3.0-release branch code
4 years ago
liwenhe1993
78f2fe253e
Modify docker-compose and kubernetes config
...
1. Move kubernetes to docker directory
2. Change docker-compose directory's name, and move docker-compose to docker directory
3. Modify docker-compose config and kubernetes config
4. Modify startup.sh in dockerfile
4 years ago
xiaochun.liu
c68785632f
merge from dev-1.3.0
5 years ago
liwenhe1993
29a353e689
Using docker/docker-swarm/docker-compose.yml to run pg and zk in ci_ut.yml ( #2692 )
...
* Using docker/docker-swarm/docker-compose.yml to run pg and zk in ci_ut.yml
1. add initdb volume for pg service in docker-compose.yml
2. modify ci_ut.yml
* add sudo in ci_ut.yml
* Query the metadata of indexes is not correct in postgresql/dolphinscheduler_ddl.sql
1. replace information_schema.STATISTICS to pg_stat_all_indexes
2. modify ProcessDefinitionMapperTest.java
* Remove inner zk and pg
* add inner pg
5 years ago
liwenhe1993
3c014c5a57
fix zookeeper health check and merge volumes into logs volume ( #2674 )
...
* fix zookeeper health check and merge volumes into logs volume
1. Fix zookeeper health check
2. Merge volumes into logs volume
3. Modify `dockerfile/hooks/build` script
* Modify ci_e2e and docker image registry
* Modify ci_e2e
* Modify ci_e2e
* Modify ci_e2e and move ./dockerfile/hooks/check to ./docker/docker-swarm/
5 years ago
liwenhe1993
4f9d8caeed
Use docker-compose for deployment . Failed to execute python script ( #2539 )
...
* Modify docker-compose and dockerfile
1. Add python3 in Dockerfile
2. Modify startup.sh file
3. Modify docker-compose.yml and add docker-stack.yml
4. Modify dolphinscheduler_env.sh
* Add logback-xx.xml and Modify Dockerfile
5 years ago
liwenhe1993
7eecfe45ea
Modify docker-compose and kubernetes config
...
1. Move kubernetes to docker directory
2. Change docker-compose directory's name, and move docker-compose to docker directory
3. Modify docker-compose config and kubernetes config
4. Modify startup.sh in dockerfile
5 years ago