* [Feature-#3828][server] Delete recipients and CCs in the process definition and select the associated alert group instead
* The specific alarm instance associated with the alert group
* The process definition only associates the alert group, and does not care about the specific alarm instance.
this closes#3828
* remove test cc
* remove test cc
* fix test error
* add sql upgrade script
delete alert column(show_type、alert_type、re、cc)
* code style
* update test
Note the statement to delete the column, and provide related instructions
* delete AlertGroup field(alert_type)
* fix ut error
* fix ut error
* fix ut error
* code style
* delete api-doc receiverCC
* delete UserAlertGroupMapper
* delete UserAlertGroup
* delete UserAlertGroupApi
* alert group add coulmn user_id
* alter user_id to create_user_id
* userinfo remove alert group info
* [Feature#4310][Alert-SPI] Plug-ins containing UI components provide display pages
*Some plugins (such as alert plugin) need to provide UI interfaces to users.
*We use from-creat to dynamically generate UI interfaces. Related parameters are mainly provided by pluginParams.
*From-create can generate dynamic ui based on this parameter.
this closes#4310
* add license head
* rename
* add ut
* add license
* add query plugin detail interface
* fix error
Update maven build, put the alert plugins in the ${install_dir}/lib/plugin/alert/${plugin_module_name} directory
(assembly build and rpm build).
Note: When adding a new plug-in, it must be reflected in provisio/dolphinscheduler.xml.
this closes#3252
* [feature-3665][ui]Add element-ui (#3666)
* [feature-3665][ui]Add element-ui
* add license
* Add form-create plug-in and alarm group management add sample demo
* Modify node version
* fix
* fix
* [feature][ui]Alert plugin design (#3734)
* [feature-3665][ui]Add element-ui (#3666)
* [feature-3665][ui]Add element-ui
* add license
* Add form-create plug-in and alarm group management add sample demo
* Modify node version
* fix
* fix
* [Feature-3682][ui]Add form-create plug-in and alarm group management add sample demo (#3683)
* Add form-create plug-in and alarm group management add sample demo
* Modify node version
* fix
* fix
* [feature][ui] Add alarm instance page
* [feature-3665][ui]Add element-ui (#3666)
* [feature-3665][ui]Add element-ui
* add license
* Add form-create plug-in and alarm group management add sample demo
* Modify node version
* fix
* fix
* [Feature-3189][alert,spi,dao,plugin-api] base code of dolphinscheduler spi and alert plugin implement (#3601)
* DS SPI
* Add DolphinScheduler SPI , and rebuilt the code of the Alert plug-in based on SPI
* Add DolphinScheduler SPI , and rebuilt the code of the Alert plug-in based on SPI
* add TODO
* delete
* compile
* spi commit
* Plugin Alert
* fix some bug
* add todo
* change web ui from alpacajs to form-create
* remove module
* add plugin schema
* add license header
* update alert and spi module version
* update the alert plugin sub module version
* comment the maven.local.repository param
* move utils from spi to common module
* add license header
* add license header and delete some chinese comment
* update spi packages
* delete no use alert_xx.properties
* update mysql.connector.version back to 5.1.34
* delete no use comment in pom.xml
* update email stmp password
* add license
* add semicolon to sql/upgrade/1.4.0_schema/mysql/dolphinscheduler_ddl.sql file
* format the code style
* format new clase file with checkstyle
* update plugin params to Builder model
* move JSONUtils to SPI because plugin can not dependency common module
* move JSONUtils to SPI because plugin can not dependency common module
* delete collection dependency
* replace PluginParamsTransfer to spi PluginParamsTransfer
* update dolphinscheduler-maven-plugin to 1.0.0
* update license
* update apache-rat-plugin add exclude '.iml' file
* check license
* ArtifactResolver only use in development and configPlugins is not empty
* ArtifactResolver only use in development and configPlugins is not empty
* ArtifactResolver only use in development and configPlugins is not empty
* default datasource should be postgresql
* add license files
* add license files
* postgresql port should be 5432
* postgresql test
* mv show_type to spi
add license header to AlertConstants
* check style fix
* copy check style file from branch dev
* alert show_type set by plugin
* alert show_type set by plugin
* add PluginDefineMapper to dolphinscheduler-server/src/test/java/org/apache/dolphinscheduler/server/registry/DependencyConfig.java
* add Bean to TaskCallbackServiceTestConfig
* add Bean to TaskCallbackServiceTestConfig
* fix check style
* check style fix
* [feature-3665][ui]Add element-ui (#3666)
* [feature-3665][ui]Add element-ui
* add license
* fix check style
* [Feature-3682][ui]Add form-create plug-in and alarm group management add sample demo (#3683)
* Add form-create plug-in and alarm group management add sample demo
* Modify node version
* fix
* fix
* check style fix
* rollback test change
* rollback test change
* rollback dao pom change
* [feature-3665][ui]Add element-ui (#3666)
* [feature-3665][ui]Add element-ui
* add license
* Add form-create plug-in and alarm group management add sample demo
* Modify node version
* fix
* fix
* add ut to pom.xml
* add upgrade schema to global schema
* fix ut failed
* fix ut failed
* fix ut failed
* fix ut failed
* add test EmailAlertPluginTest to pom.xml
* fix ut failed
* fix ut failed
* fix check style
* update license header to presto license header
* presto license header not check
* fix ut coverage
* fix ut coverage
* fix ut
* fix ut
* fix ut
* fix ut coverage
* fix ut coverage
* fix ut coverage
* fix ut coverage
* fix ut coverage
* fix ut coverage
Co-authored-by: break60 <790061044@qq.com>
* [feature#3356] alert-spi support DingTalk
this closes # 3356
* add test
* code style
* we chat alert
* support we chat alert
* support we chat alert
* support we chat alert,update ding talk alert
* code style
* add test
* code style
* clean old code
* clean old code
* code smell
* code style
* add test
* simple config
* code style
* code style
* code style
* delete old file
* fix log content error
Co-authored-by: break60 <790061044@qq.com>
Co-authored-by: gaojun2048 <32193458+gaojun2048@users.noreply.github.com>
* DS SPI
* Add DolphinScheduler SPI , and rebuilt the code of the Alert plug-in based on SPI
* Add DolphinScheduler SPI , and rebuilt the code of the Alert plug-in based on SPI
* add TODO
* delete
* compile
* spi commit
* Plugin Alert
* fix some bug
* add todo
* change web ui from alpacajs to form-create
* remove module
* add plugin schema
* add license header
* update alert and spi module version
* update the alert plugin sub module version
* comment the maven.local.repository param
* move utils from spi to common module
* add license header
* add license header and delete some chinese comment
* update spi packages
* delete no use alert_xx.properties
* update mysql.connector.version back to 5.1.34
* delete no use comment in pom.xml
* update email stmp password
* add license
* add semicolon to sql/upgrade/1.4.0_schema/mysql/dolphinscheduler_ddl.sql file
* format the code style
* format new clase file with checkstyle
* update plugin params to Builder model
* move JSONUtils to SPI because plugin can not dependency common module
* move JSONUtils to SPI because plugin can not dependency common module
* delete collection dependency
* replace PluginParamsTransfer to spi PluginParamsTransfer
* update dolphinscheduler-maven-plugin to 1.0.0
* update license
* update apache-rat-plugin add exclude '.iml' file
* check license
* ArtifactResolver only use in development and configPlugins is not empty
* ArtifactResolver only use in development and configPlugins is not empty
* ArtifactResolver only use in development and configPlugins is not empty
* default datasource should be postgresql
* add license files
* add license files
* postgresql port should be 5432
* postgresql test
* mv show_type to spi
add license header to AlertConstants
* check style fix
* copy check style file from branch dev
* alert show_type set by plugin
* alert show_type set by plugin
* add PluginDefineMapper to dolphinscheduler-server/src/test/java/org/apache/dolphinscheduler/server/registry/DependencyConfig.java
* add Bean to TaskCallbackServiceTestConfig
* add Bean to TaskCallbackServiceTestConfig
* fix check style
* check style fix
* [feature-3665][ui]Add element-ui (#3666)
* [feature-3665][ui]Add element-ui
* add license
* fix check style
* [Feature-3682][ui]Add form-create plug-in and alarm group management add sample demo (#3683)
* Add form-create plug-in and alarm group management add sample demo
* Modify node version
* fix
* fix
* check style fix
* rollback test change
* rollback test change
* rollback dao pom change
* [feature-3665][ui]Add element-ui (#3666)
* [feature-3665][ui]Add element-ui
* add license
* Add form-create plug-in and alarm group management add sample demo
* Modify node version
* fix
* fix
* add ut to pom.xml
* add upgrade schema to global schema
* fix ut failed
* fix ut failed
* fix ut failed
* fix ut failed
* add test EmailAlertPluginTest to pom.xml
* fix ut failed
* fix ut failed
* fix check style
* update license header to presto license header
* presto license header not check
* fix ut coverage
* fix ut coverage
* fix ut
* fix ut
* fix ut
* fix ut coverage
* fix ut coverage
* fix ut coverage
* fix ut coverage
* fix ut coverage
* fix ut coverage
Co-authored-by: break60 <790061044@qq.com>
* [Improvement][remote] improvement netty eventLoopGroup
If you are running on linux you can use EpollEventLoopGroup and so get better performance, less GC and have more advanced features that are only available on linux.
* reformat code
* utility classes should not have public constructors
* reformat code
* reformat code
* reformat code
* add test
* code style
* add test
* add test
* fix test error
* add test
* test
* test
* add test config
* add test config
* Fixed this bug "multiple threads creating folders will result in multiple identical folders" #3487
* 1. Improvement `DataSourceServiceTest` #3558
2. Get rid of some useless arguments to functions in the `DataSourceService` class
* The rollback `ResourceService.java`
* The rollback `ResourceService.java`
* The rollback `ResourceService.java`
* 1.Modify code styles.
2.Make improvement according to Yichao Yang's advice. Thank you very much for guidance.@Yichao Yang
* Modify code styles.
* Circumventing the checkConnection problem
* Modify code styles.
* * add presto datasource support
update .gitigonre to igonre some files
* * use another presto driver
* * add LICENSE files about presto-jdbc
* * just for test sonar
Co-authored-by: rockxsj <junjun@mgtv.com>
* fix bug #3165 get resource.storage.type value toUpperCase
* fix bug #3176 optimize Gets the value of this property “resource.storage.type”
* fix When you request the URL through applicationID to get the application status, you cannot get it if Kerberos authentication is enabled
* fix When you request the URL through applicationID to get the application status, you cannot get it if Kerberos authentication is enabled
* fix When you request the URL through applicationID to get the application status, you cannot get it if Kerberos authentication is enabled
* fix miss
* add KerberosHttpClient fix kerberos bug
* fix map init
* add juint test
* Extraction of public methods
* Extraction of public methods
* Fix code quality
* Fix code quality
* Fix code quality
* Fix code quality
* Fix code quality
* Fix code quality
* Fix code quality
* rebuild test
* rebuild test
* check style
* check style
* check style
* revert UT POM
* Kerberos judgment goes up to hadoopUtils
* fix merge
* Remove connection pool shutdown
Co-authored-by: dailidong <dailidong66@gmail.com>
* [Feature-3134]Refactor to use a shared singleton Curator Zookeeper Client
* autowire CuratorZookeeperClient to ZookeeperOperator
* [Improvement] Add the issue specifications reference (#3221)
* log zookeeper address when the connect state change
* resume the operation of add connect state listener in MasterRegistry
Co-authored-by: Yichao Yang <1048262223@qq.com>
* fix the bug #2923 (Hive JDBC connection parameter ignored) , the hive jdbc connection url ;
* fix the bug index out of bound and add some test case
* add the Licensed
* fix the checkstyle and import StringBuilder
* put HiveDataSourceTest.java to root pom maven-surefire-plugin to avoiding the sonar 0.0% Coverage.
* Update HiveDataSource.java
* fix the bug #3240 [worker] Cannot find a (Map) Key deserializer for type
* [DS-3245][fix] change toString use JsonString
- change the method of UdfFunc.toString use JsonString
This closes#3245
* [DS-3245][fix] change toString use JsonString
- fix the junit test for full
This closes#3245
* [DS-3245][fix] change toString use JsonString
- fix the sonarcloud merge error, Swap these 2 arguments so they are in the correct order: expected value, actual value.
This closes#3245
* [DS-3245][fix] move the Class UdfFuncDeserializer to UdfFunc.java
move the class UdfFuncDeserializer.java to UdfFunc.java
This closes#3245
* [DS-3245][fix] move the Class UdfFuncDeserializer to UdfFunc.java
add blank line
This closes#3245
* [DS-3245][fix] add the unit test of UdfFunc
add the unit test of UdfFunc.java
This closes#3245
* [DS-3245][fix] add the unit test of UdfFunc
remove the UdfFuncTest.java from maven-surefire-plugin list
This closes#3245
* [DS-3245][fix] add the unit test of UdfFunc
add the UdfFuncTest to the root pom maven-surefire-plugin
This closes#3245
Co-authored-by: dailidong <dailidong66@gmail.com>
* [Feature-2815][server] One worker can belong to different workergroups
* Feature: Add test cases
* Update MonitorService.java
* Update MonitorService.java
Co-authored-by: dailidong <dailidong66@gmail.com>
* merge from 1.3.1-release
* [bugfix] remove Conflicting configuration sudo and user (#3038)
Co-authored-by: zhangchunyang1024 <zhangchunyang0123@gamil.com>
* remove some standard notices in order to cut down the NOTICE file. (#3101)
* #3084 remove some standard notices in order to cut down the NOTICE file.
* update exclude element sql/soft_version of rat plugin
* update soft_version
* merge from 1.3.1-release
* fix 3112:download udf resource need find the tenant code of resource owner (#3114)
* fix 3112:download udf resource need find the tenant code of resource owner
* fix 2975:download resource need find the tenant code of resource owner
* remove useless code
* merge from 1.3.1-release
* remove some notes (#3127)
Co-authored-by: lenboo <baoliang@analysys.com.cn>
* fix Permission denied if not found dolphinscheder-env.sh on 1.3.1 (#3128)
* fix Permission denied if not found dolphinscheder-env.sh
* update some comments on method
* add PropertyPlaceholderHelper on license (#3129)
* update license header location
* add PropertyPlaceholderHelper on license
* merge from 1.3.1-release
* change from 1.3.0 to 1.3.2
* add Set import
Co-authored-by: dailidong <dailidong66@gmail.com>
Co-authored-by: zhangchunyang <zhangchunyang0123@gmail.com>
Co-authored-by: zhangchunyang1024 <zhangchunyang0123@gamil.com>
Co-authored-by: lgcareer <18610854716@163.com>
Co-authored-by: lenboo <baoliang@analysys.com.cn>
* fix the bug #2923 (Hive JDBC connection parameter ignored) , the hive jdbc connection url ;
* fix the bug index out of bound and add some test case
* add the Licensed
* fix the checkstyle and import StringBuilder
* put HiveDataSourceTest.java to root pom maven-surefire-plugin to avoiding the sonar 0.0% Coverage.
* Update HiveDataSource.java
Co-authored-by: dailidong <dailidong66@gmail.com>
* add DolphinScheduler slack channel
* Update README.md
Co-Authored-By: Jiajie Zhong <zhongjiajie955@hotmail.com>
* modify soft_version 1.2.2 to 1.3.0
* Repair worklist cannot be deleted
* update schema version (#2657)
* change schema version from 1.2.2 to 1.3.0
* change version value of table t_ds_version from 2.0.0 to 1.3.0
* fix bug: sub worker flow in complement data would run start date (#2581) (#2656)
Co-authored-by: baoliang <baoliang@analysys.com.cn>
* Fix conditions node save exception
* add unique key for t_ds_process_definition
* add unique key for t_ds_process_definition
* script variable has "processDefinitionId" is error #2664 (#2666)
Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>
* update filename
* Update dolphinscheduler_ddl.sql
* Delete dolphinscheduler_ddl.sql
* Delete dolphinscheduler_ddl.sql
* add unique key for t_ds_process_definition
add unique key for t_ds_process_definition
* add unique key for t_ds_process_definition
add unique key for t_ds_process_definition
* Modify the alert log file
* blank in eamil and left font align #2648 (#2673)
* script variable has "processDefinitionId" is error #2664
* blank in eamil and left font align #2648
Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>
* fix zookeeper health check and merge volumes into logs volume (#2674)
* fix zookeeper health check and merge volumes into logs volume
1. Fix zookeeper health check
2. Merge volumes into logs volume
3. Modify `dockerfile/hooks/build` script
* Modify ci_e2e and docker image registry
* Modify ci_e2e
* Modify ci_e2e
* Modify ci_e2e and move ./dockerfile/hooks/check to ./docker/docker-swarm/
* migrate docker composer and move dockerfile dir to docker/build
* ut docker
* alter dockerfile to docker/build dir
* delete docker-compose old
* delete dockerfile zk
* delete dockerfile zk
* delete dockerfile zk
* [bug fix] some bugs from 1.2.0 to 1.3.0 (#2676)
* fix bug: some bugs about worker group from 1.2.0 to 1.3.0
* fix bug: scheduler from 1.2.0 to 1.3.0 do not work
* fix bug: scheduler from 1.2.0 to 1.3.0 do not work
* fix ut bug
Co-authored-by: baoliang <baoliang@analysys.com.cn>
* add worker group config (#2681)
* update README about DolphinScheduler
* Update issue templates
* update
* regularize api pom xml
update rpc maven compile to 1.8
* regularize api pom xml
* change commons.lang3.StringUtils to common.utils.StringUtils
* update pom.xml
* update
* correct equals method
* jasper-runtime is needed when api server start
* jasper-runtime jar is needed when api server start
* combine logback config of master/worker/alert/api server to one logback.xml
* remove tomcat runtime jar
* add UT
* add license
* remove jasper-runtime jar, not need anymore
* sovle jar conflict， remove servlet-api 2.5 jar
* remove servlet 2.5
* add embedded database h2 and update embedded zookeeper
* delete logs
* add license
* change log level to INFO
* simplify and optimize config
* add development state
* simplify common config
* add worker group config
* add worker group config
Co-authored-by: lidongdai <escheduler@outlook.com>
Co-authored-by: dailidong <dolphinschedule@gmail.com>
* delete log files while deleting process instances #2463 (#2693)
* script variable has "processDefinitionId" is error #2664
* blank in eamil and left font align #2648
* delete log files while deleting process instances #2463
* delete log files while deleting process instances #2463
* delete log files while deleting process instances #2463
* delete log files while deleting process instances #2463
Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>
* Update dolphinscheduler_ddl.sql
* Using docker/docker-swarm/docker-compose.yml to run pg and zk in ci_ut.yml (#2692)
* Using docker/docker-swarm/docker-compose.yml to run pg and zk in ci_ut.yml
1. add initdb volume for pg service in docker-compose.yml
2. modify ci_ut.yml
* add sudo in ci_ut.yml
* Query the metadata of indexes is not correct in postgresql/dolphinscheduler_ddl.sql
1. replace information_schema.STATISTICS to pg_stat_all_indexes
2. modify ProcessDefinitionMapperTest.java
* Remove inner zk and pg
* add inner pg
* conditions The task node adds a background color to distinguish successful and failed connections
* add LoggerServerTest UT (#2713)
* add LoggerServerTest UT
* add LoggerServerTest UT
Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>
* add UT (#2717)
* add LoggerServerTest UT
* add LoggerServerTest UT
* add LoggerServerTest UT
add RemoveTaskLogRequestCommandTest UT
add RemoveTaskLogResponseCommandTest
Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>
* fix worker group config no effect (#2719)
* Conditional judgment adds text
* fix
* fix #2449:It's should successful to cancel authorize a resource of a user if all the online process definitions created by this user didn't use this resource. (#2725)
* Underline the list of workflow operations
* Modify HDFS/S3 path (#2736)
* Modify HDFS/S3 path
* Modify HDFS/S3 path
* Update common.properties
Co-authored-by: chenxingchun <438044805@qq.com>
Co-authored-by: dailidong <dailidong66@gmail.com>
* Modify ip configuration
* set worker group (#2743)
* simple config
* fix worker group config no effect
* fix #2598::allow to update resource suffix,but if it is authorized to other users,it is not allowed (#2732)
* fix #2598:allow to update resource suffix,but if it is authorized to other users,it is not allowed.
* add RESOURCE_IS_AUTHORIZED status
* verify whether the suffix is empty
* remove extra variables
* fix code smell
* Update known-dependencies.txt
* update worker group config (#2746)
* fix worker group config no effect
* remove codehaus janino jar
the license about janino maybe not compatiable with Apache v2
* Merge remote-tracking branch 'upstream/dev-1.3.0' into dev-1.3.0
# Conflicts:
# dolphinscheduler-server/src/main/resources/config/install_config.conf
* Update datasource.properties
* remove codehaus janino jar (#2742)
the license about janino maybe not compatiable with Apache v2
* [bug fix] fix bug:2634:Process shows success,when the task of the process is killed in the terminal (#2731)
* fix bug: some bugs about worker group from 1.2.0 to 1.3.0
* fix bug: scheduler from 1.2.0 to 1.3.0 do not work
* fix bug: scheduler from 1.2.0 to 1.3.0 do not work
* fix ut bug
* fix bug: Process shows success,when the task of the process is killed in the termina
* fix bug #2634: Process shows success,when the task of the process is killed in the terminal
Co-authored-by: baoliang <baoliang@analysys.com.cn>
* Update known-dependencies.txt (#2748)
* fix getWorkers bug on RunConfig (#2747)
* fix worker group config no effect
* remove codehaus janino jar
the license about janino maybe not compatiable with Apache v2
* Merge remote-tracking branch 'upstream/dev-1.3.0' into dev-1.3.0
# Conflicts:
# dolphinscheduler-server/src/main/resources/config/install_config.conf
* datasource config
* Update datasource.properties
* fix RunConfig bug
* master select worker filter high load worker #2704 (#2733)
* add LoggerServerTest UT
* add LoggerServerTest UT
* add LoggerServerTest UT
add RemoveTaskLogRequestCommandTest UT
add RemoveTaskLogResponseCommandTest
* master select worker filter high load worker #2704
* master select worker filter high load worker #2704
* master select worker filter high load worker #2704
* master select worker filter high load worker #2704
* master select worker filter high load worker #2704
* master select worker filter high load worker #2704
Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>
* Fix rename check parameter
* fix
* fix 2598:change getId to getUserId (#2757)
* fix #2598:allow to update resource suffix,but if it is authorized to other users,it is not allowed.
* add RESOURCE_IS_AUTHORIZED status
* verify whether the suffix is empty
* remove extra variables
* fix code smell
* change getId to getUserId
* Fix MySQL autoDeserialize bug (#2728)
* Fix MySQL autoDeserialize bug
* add MySQLDataSourceTest
* Fix workflow definition history node data cannot be opened
* fix
* delete normalize
* update e2e chrome version (#2775)
Co-authored-by: chenxingchun <438044805@qq.com>
* Modify the background color of conditions task node connection
* [BUF FIX]fix: the master would be blocked when worker group not exists (#2764)
* feature: add number configuration for master dispatch tasks
* fix bug(#2762) the master would be blocked when worker group not exists
* fix bug(#2762) the master would be blocked when worker group not exists
* fix ut
* fix ut
Co-authored-by: baoliang <baoliang@analysys.com.cn>
* [BUG FIX] fix bug: dependent task failed when conditions task exists (#2768)
* fix bug 2464: change dependent task for process.
* remove unused code
* add ut
* add ut
* update comments
Co-authored-by: baoliang <baoliang@analysys.com.cn>
* Hourly dependency configuration， 'currentHour' and 'last24Hours' (#2696)
* [feature] Add hourly dependency scenarios
* [Feature] #2680
add DependentUtilsTest UT
Co-authored-by: changqun.xu <changqun.xu@17zuoye.com>
Co-authored-by: xuchangqun <changqun.x@gmail.com>
* fix sql task bug #2739 (#2741)
* Solve the failure to execute non-query sql
* fix sql task bug
Co-authored-by: sunchaohe <sunzhaohe@linklogis.com>
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
Co-authored-by: lgcareer <18610854716@163.com>
* Worker group adds check
* fix
* Worker group adds check (#2787)
* Worker group adds check
* fix
* add not worker log and remove worker invalid property (#2784)
* add LoggerServerTest UT
* add LoggerServerTest UT
* add LoggerServerTest UT
add RemoveTaskLogRequestCommandTest UT
add RemoveTaskLogResponseCommandTest
* master select worker filter high load worker #2704
* master select worker filter high load worker #2704
* master select worker filter high load worker #2704
* master select worker filter high load worker #2704
* master select worker filter high load worker #2704
* master select worker filter high load worker #2704
* add not worker log and remove worker invalid property
Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>
* Modify the ambari-plugin readme for packing RPM packages and add a description of the replication plug-in directory (#2786)
* fixed#2788 resolve the bug #2788 (#2789)
* Modify the ambari-plugin readme for packing RPM packages and add a description of the replication plug-in directory
* fixed#2788
* [BUG FIX] fix bug:cannot pause work flow when task state is "submit success" (#2783)
* feature: add number configuration for master dispatch tasks
* fix bug(#2762) the master would be blocked when worker group not exists
* fix bug(#2762) the master would be blocked when worker group not exists
* fix ut
* fix ut
* fix bug(2781): cannot pause work flow when task state is "submit success"
* fix code smell
* add mysql other param blank judge
* test
* update comments
* update comments
* add ut
Co-authored-by: baoliang <baoliang@analysys.com.cn>
* fix bug:#2735 (#2770)
1. store process id in zk.
2. resolve host and port through zk path.
3. modify ui key.
* Modify startup parameter worker group value
* Fix [Bug] process definition json worker group convert #2794 (#2795)
* add LoggerServerTest UT
* add LoggerServerTest UT
* add LoggerServerTest UT
add RemoveTaskLogRequestCommandTest UT
add RemoveTaskLogResponseCommandTest
* master select worker filter high load worker #2704
* master select worker filter high load worker #2704
* master select worker filter high load worker #2704
* master select worker filter high load worker #2704
* master select worker filter high load worker #2704
* master select worker filter high load worker #2704
* add not worker log and remove worker invalid property
* process definition json worker group convert #2794
* process definition json worker group convert #2794
* process definition json worker group convert #2794
* process definition json worker group convert #2794
* process definition json worker group convert #2794
* process definition json worker group convert #2794
Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>
* [BUG FIX]fix bug: Restart the worker service again, the previously submitted successful tasks are not executed bug (#2800)
* feature: add number configuration for master dispatch tasks
* fix bug(#2762) the master would be blocked when worker group not exists
* fix bug(#2762) the master would be blocked when worker group not exists
* fix ut
* fix ut
* fix bug(2781): cannot pause work flow when task state is "submit success"
* fix code smell
* add mysql other param blank judge
* test
* update comments
* update comments
* add ut
* fix bug: Restart the worker service again, the previously submitted successful tasks are not executed
* update comments
* add sleep
Co-authored-by: baoliang <baoliang@analysys.com.cn>
* delete unnecessary configuration items (#2803)
* rename worker_group_id to worker_group and set the value of worker_group_name (#2801)
* process definition json worker group convert #2794 (#2809)
* add LoggerServerTest UT
* add LoggerServerTest UT
* add LoggerServerTest UT
add RemoveTaskLogRequestCommandTest UT
add RemoveTaskLogResponseCommandTest
* master select worker filter high load worker #2704
* master select worker filter high load worker #2704
* master select worker filter high load worker #2704
* master select worker filter high load worker #2704
* master select worker filter high load worker #2704
* master select worker filter high load worker #2704
* add not worker log and remove worker invalid property
* process definition json worker group convert #2794
* process definition json worker group convert #2794
* process definition json worker group convert #2794
* process definition json worker group convert #2794
* process definition json worker group convert #2794
* process definition json worker group convert #2794
* process definition json worker group convert #2794
* process definition json worker group convert #2794
Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>
* compatible old version host not port delete log file (#2811)
* add LoggerServerTest UT
* add LoggerServerTest UT
* add LoggerServerTest UT
add RemoveTaskLogRequestCommandTest UT
add RemoveTaskLogResponseCommandTest
* master select worker filter high load worker #2704
* master select worker filter high load worker #2704
* master select worker filter high load worker #2704
* master select worker filter high load worker #2704
* master select worker filter high load worker #2704
* master select worker filter high load worker #2704
* add not worker log and remove worker invalid property
* process definition json worker group convert #2794
* process definition json worker group convert #2794
* process definition json worker group convert #2794
* process definition json worker group convert #2794
* process definition json worker group convert #2794
* process definition json worker group convert #2794
* process definition json worker group convert #2794
* process definition json worker group convert #2794
* compatible old version host not port delete log file
Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>
* Added instructions for ambari to add and remove Dolphin Schdumer components on nodes (#2806)
* delete unnecessary configuration items
* Added instructions for ambari to add and remove Dolphin Schdumer components on nodes
* Added instructions for ambari to add and remove Dolphin Schdumer components on nodes
* fix oracle connect failure (#2812)
* use method getJdbcUrl of parent
* Remove the incorrect print message
* Modify process group workerGroup value display and filter child node duplicate values
* Repair process definition bulk delete function
* when init workflow, the tenantId linked by the tenantId of user
* dag download does not refresh, modify the task instance operation width value
* fix
* [bug fix]fix bug: After the master is fault-tolerant, it cannot resume operation (#2813)
* feature: add number configuration for master dispatch tasks
* fix bug(#2762) the master would be blocked when worker group not exists
* fix bug(#2762) the master would be blocked when worker group not exists
* fix ut
* fix ut
* fix bug(2781): cannot pause work flow when task state is "submit success"
* fix code smell
* add mysql other param blank judge
* test
* update comments
* update comments
* add ut
* fix bug: Restart the worker service again, the previously submitted successful tasks are not executed
* update comments
* add sleep
* add null point check
* fix bug:After the master is fault-tolerant, it cannot resume operation
* fix bug: do not failover the host is 'NULL' process
Co-authored-by: baoliang <baoliang@analysys.com.cn>
* When update the data source,the host and port show error (#2821)
* When update the data source,the host and port show error
* update DataSourceServiceTest
* update DataSourceServiceTest
* update DataSourceServiceTest
* Fix ORACLE service name value display
* Add tips for download workflow
* fix
* [bug fix] fix: The workflow is fault-tolerant and 2 task instances are generated (#2833)
* feature: add number configuration for master dispatch tasks
* fix bug(#2762) the master would be blocked when worker group not exists
* fix bug(#2762) the master would be blocked when worker group not exists
* fix ut
* fix ut
* fix bug(2781): cannot pause work flow when task state is "submit success"
* fix code smell
* add mysql other param blank judge
* test
* update comments
* update comments
* add ut
* fix bug: Restart the worker service again, the previously submitted successful tasks are not executed
* update comments
* add sleep
* add null point check
* fix bug:After the master is fault-tolerant, it cannot resume operation
* fix bug: do not failover the host is 'NULL' process
* fix bug:worker failover error.
Co-authored-by: baoliang <baoliang@analysys.com.cn>
* add maven Xmx to 5g
* fix bug: send task result to master until success. (#2839)
* fix bug: send task result to master until success.
* fix bug: send task result to master until success.
* add sleep
* set null if send result failed
* set null if send result failed
Co-authored-by: baoliang <baoliang@analysys.com.cn>
* Fix errors when running on win10 (#2842)
1. DS cant run bat script
2. DS cant run python script
3. DS cant run datax script
* Fix abnormal display of regular worker parameters
* add source license full text into source license (#2840)
* add source license full text into source license
* exclude ScriptRunner.java on rat check
* fix table not exist when init db metadata (#2838)
* fix table not exist when init db metadata
* fix db init error
* fix ds-1.3.0 init db
* init db modify process instance json
Co-authored-by: eights <yelli.hl@foxmail.com>
* change notice copyright date from 2019 to 2019-2020 (#2847)
* add source license full text into source license
* exclude ScriptRunner.java on rat check
* change notice copyright date from 2019 to 2019-2020
* fix [BUG] TaskExecutionContextCacheManagerImpl Do not execute removeByTaskInstanceId #2745 (#2754)
* mr resource display and create user username length cannot be less than 3
* fix
* fix
* fix
* fix table T_DS_ALERT (#2854)
* fix worker group config no effect
* remove codehaus janino jar
the license about janino maybe not compatiable with Apache v2
* Merge remote-tracking branch 'upstream/dev-1.3.0' into dev-1.3.0
# Conflicts:
# dolphinscheduler-server/src/main/resources/config/install_config.conf
* datasource config
* Update datasource.properties
* fix RunConfig bug
* remove param monitor server state
* fix table T_DS_ALERT
* fix
* fix
* modify t_ds_task_instance app_link change sql (#2861)
* change max length of user name to 39 (#2856)
* fix bug: send task result to master until success.
* fix bug: send task result to master until success.
* add sleep
* set null if send result failed
* set null if send result failed
* change max length of username to 39
Co-authored-by: baoliang <baoliang@analysys.com.cn>
* copy resources need get top directory first (#2866)
* copy resources need get top directory first
* copy resources need get top directory first
* fix #2860:copy files and create empty directory (#2876)
* copy resources need get top directory first
* copy resources need get top directory first
* fix #2860:copy files and create empty directory
* Fix bug:If user didn't set the value of tenant,release process definition fail (#2885)
* copy resources need get top directory first
* copy resources need get top directory first
* fix #2860:copy files and create empty directory
* Fix bug:If user didn't set the value of tenant,release process definition online fail
* merge method updateuser if and fix bug#2892
fix [BUG] When editing user information, clear the phone number, the database table t_ds_user.phone is not cleared #2892
* fix bug: sqoop mysql import params error (#2896)
* fix bug: sqoop mysql import params error
* fix bug: sqoop mysql import params error
* Fixed selection of tenant value and defalut changed to lower case
* update how to build and remove docs link (#2906)
* Fix tasks not execute in sub-process when rerun scheduled process. #2903 (#2908)
* fix create table sql exception (#2912)
fix create table sql exception
* fix#2910 master server will show exception for some time when it restart (#2913)
* fix worker group config no effect
* remove codehaus janino jar
the license about janino maybe not compatiable with Apache v2
* Merge remote-tracking branch 'upstream/dev-1.3.0' into dev-1.3.0
# Conflicts:
# dolphinscheduler-server/src/main/resources/config/install_config.conf
* datasource config
* Update datasource.properties
* fix RunConfig bug
* remove param monitor server state
* fix table T_DS_ALERT
* update h2 database
* fix#2910 master server will show exception for some time when it restart
* Fixbug datax task (#2909)
* fix: local param bug
* fix: UT bug
Co-authored-by: Rubik-W <whm_777@163.com>
* [license] add license and notice (#2916)
* fix bug: send task result to master until success.
* fix bug: send task result to master until success.
* add sleep
* set null if send result failed
* set null if send result failed
* change max length of username to 39
* test for gc
* change version to 1.3.0
* check and add some license files
* check and add some license files
* revert
Co-authored-by: baoliang <baoliang@analysys.com.cn>
* fix oom when no master is active in dev-1.3.0 (#2918)
* fix worker group config no effect
* remove codehaus janino jar
the license about janino maybe not compatiable with Apache v2
* Merge remote-tracking branch 'upstream/dev-1.3.0' into dev-1.3.0
# Conflicts:
# dolphinscheduler-server/src/main/resources/config/install_config.conf
* datasource config
* Update datasource.properties
* fix RunConfig bug
* remove param monitor server state
* fix table T_DS_ALERT
* update h2 database
* fix#2910 master server will show exception for some time when it restart
* fix oom when no master is active
* fix worker oom when master server restart
* fix oom
* fix
* add UT
* fix worker group config no effect
* Python, sql, sqoop,datax task node editor adds zoom function #2929 (#2933)
* Python, sql, sqoop task node editor adds zoom function
* fix
* change 1.3.0 to 1.3.0-snapshot
* add janino-3.0.12.jar
* delete duplicate codes
* add commons-compiler-3.0.12.jar
* change delete status according to delete action result
* Delete the pom files animation.scss, _normalize.scss and _animation.scss under the common folder
* Change email to default (#2981)
* add mybatis-3 notice in the top-level notice (#3003)
* fix download resource file that under the directory error (#3007)
* add mybatis-3 notice in the top-level notice
* fix download resource file that under the directory error
* Fix unfiltered jar files in resource directory and UDF upload resource parameters (#3008)
* Change email to default
* Fix unfiltered jar files in resource directory and UDF upload resource parameters
* fix singe resource manager will NPE (#3013)
* fix worker group config no effect
* remove codehaus janino jar
the license about janino maybe not compatiable with Apache v2
* Merge remote-tracking branch 'upstream/dev-1.3.0' into dev-1.3.0
# Conflicts:
# dolphinscheduler-server/src/main/resources/config/install_config.conf
* datasource config
* Update datasource.properties
* fix RunConfig bug
* remove param monitor server state
* fix table T_DS_ALERT
* update h2 database
* fix#2910 master server will show exception for some time when it restart
* fix oom when no master is active
* fix worker oom when master server restart
* fix oom
* fix
* add UT
* fix worker group config no effect
* fix singe resource manager will NPE
* Update HadoopUtilsTest.java
* merge from dev-1.3.0
* update ut
* remove duplicate code
* remove exception ut
* remove exception ut
* remove exception ut
* remove exception ut
* remove exception ut
* [bugfix] remove Conflicting configuration sudo and user (#3038)
Co-authored-by: zhangchunyang1024 <zhangchunyang0123@gamil.com>
* [bugfix] 1. fix alert.json includes repeated tag 'DOLPHIN_ALERT' 2. metainfo.xml The version number of the RPM package is no longer specified in the metainfo.xml (#3032)
Co-authored-by: zhangchunyang1024 <zhangchunyang0123@gamil.com>
* [feature] readme.md adds instructions for changing environment variables (#3031)
Co-authored-by: zhangchunyang1024 <zhangchunyang0123@gamil.com>
* merge from dev
* Change favicon.ico icon introduction method and package compilation to increase version number (#3030)
Co-authored-by: Jiajie Zhong <zhongjiajie955@hotmail.com>
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
Co-authored-by: chenxingchun <438044805@qq.com>
Co-authored-by: break60 <790061044@qq.com>
Co-authored-by: lgcareer <18610854716@163.com>
Co-authored-by: bao liang <29528966+lenboo@users.noreply.github.com>
Co-authored-by: baoliang <baoliang@analysys.com.cn>
Co-authored-by: Simon <3656562@qq.com>
Co-authored-by: xingchun-chen <55787491+xingchun-chen@users.noreply.github.com>
Co-authored-by: 张世鸣 <zhangshiming@cvte.com>
Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>
Co-authored-by: liwenhe1993 <liwenhe@apache.org>
Co-authored-by: xiaochun.liu <xiaochun.liu@centurygame.com>
Co-authored-by: lidongdai <escheduler@outlook.com>
Co-authored-by: dailidong <dolphinschedule@gmail.com>
Co-authored-by: Tboy <guo.jiwei@immomo.com>
Co-authored-by: xuchangqun <58328021+xuchangqun@users.noreply.github.com>
Co-authored-by: changqun.xu <changqun.xu@17zuoye.com>
Co-authored-by: xuchangqun <changqun.x@gmail.com>
Co-authored-by: zixi0825 <649790970@qq.com>
Co-authored-by: sunchaohe <sunzhaohe@linklogis.com>
Co-authored-by: zhangchunyang <zhangchunyang0123@gmail.com>
Co-authored-by: tlhhup <137273278@qq.com>
Co-authored-by: yelli.hl@foxmail.com <amarantine@my.com>
Co-authored-by: eights <yelli.hl@foxmail.com>
Co-authored-by: yaoyao <42244568+1445103710@users.noreply.github.com>
Co-authored-by: 小清 <62982788+597365581@users.noreply.github.com>
Co-authored-by: gabry.wu <gabrywu@apache.org>
Co-authored-by: t1mon <178317391@qq.com>
Co-authored-by: Rubik-W <39549317+Rubik-W@users.noreply.github.com>
Co-authored-by: Rubik-W <whm_777@163.com>
Co-authored-by: zhangchunyang1024 <zhangchunyang0123@gamil.com>
Kirs
samz406
zhuangchong
gaojun2048
zhuangchong
gaojun2048
bao liang
guyinyou
felix.wang
Hsu Pu
Hsu Pu
Yichao Yang
easycode
vanilla111
rockxsj
LiemLin
tswstarplanet
LEI SHENG
dailidong
Jave-Chen
lenboo
743294668
break60
Simon