1e812ca078
add finally block to close channel ( #1951 )
...
* move datasource classes to dao module
* fix send4LetterWord bug
* exclude jasper-compiler in case of runtime conflict
* add finally block to close channel
5 years ago
44b76468a8
Adapting partial code(file name start with C) to the sonar cloud rules ( #1918 )
...
* Adapting partial code(file name start with C) to the sonar cloud rules
* add some UT
* add some UT(rollback JSONUtils.checkJsonVaild)
* add some UT(fix OSUtils.exeCmd UT)
5 years ago
d3f8bb0a2b
Refactor architecture ( #1936 )
...
* move datasource classes to dao module
* fix send4LetterWord bug
5 years ago
e0a5a15d49
dolphinscheduler-common remove spring ( #1931 )
...
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
5 years ago
29f2b41ed0
Refactor architecture ( #1926 )
...
* move version to parent pom
* move version properties to parent pom for easy management
* remove freemarker dependency
* delete CombinedApplicationServer
* #1871 correct spelling
* #1873 some updates for TaskQueueZkImpl
* #1875 remove unused properties in pom
* #1878
1. remove tomcat dependency
2. remove combined_logback.xml in api module
3. format pom.xml for not aligning
* #1885 fix api server startup failure
1. add jsp-2.1 dependency
2. remove jasper-runtime dependency
* add stringutils ut (#1921 )
* add stringutils ut
* Newfeature for #1675 . (#1908 )
Continue to finish the rest works, add the cache feature for dependence,mr,python,sub_process,procedure and shell.
* Add modify user name for process definition (#1919 )
* class overrides equals() and should therefore also override hashCode()
* #1862 add modify user in process difinition list
* #1862 add pg-1.2.2 ddl.sql
* modify ScriptRunnerTest
* add updateProessDifinition UT
* modify updateProcessDifinition UT
* modify updateProcessDifinition UT
* modify mysql 1.2.2 ddl.sql&dml.sql
* add scope test to mysql in pom
* modify pg-1.2.2 ddl.sql
* refactor module
* updates
Co-authored-by: khadgarmage <khadgar.mage@outlook.com>
Co-authored-by: zhukai <boness@qq.com>
Co-authored-by: Yelli <amarantine@my.com>
5 years ago
9a70e77955
1，remove dolphinscheduler-rpc module 2，add dolphinscheduler-remote module 3，add dolphinscheduler-service module 4，refactor LoggerServer module ( #1925 )
...
* 1，remove dolphinscheduler-rpc module
2，add dolphinscheduler-remote module
3，add dolphinscheduler-service module
4，refactor LoggerServer module
* ProcessUtils modify
5 years ago
515255b919
ut
5 years ago
fccbcc8d7d
fix: The constructor has passed in an taskAppId, no need to get from taskAppId. ( #1906 )
5 years ago
9d944d3f76
Optimize duplicate code
...
Use public methods to simplify duplicate code
5 years ago
662233e0dd
Remove ScheduleUtil，use the existing CronUtils
...
CronUtils is a public quartz tools, then the project dolphinscheduler-api can remove dolphinscheduler-server
5 years ago
c63cd3e237
combine logback config of master/worker/alert/api server to one ( #1898 )
...
* combine logback config of master/worker/alert/api server to one logback.xml
5 years ago
f942e5ced3
[feature] data synchronization function ( #1881 )
...
* feature：data synchronization function
* feature：data synchronization function
* feature：data synchronization function
* fix：add license
* fix：resource close bug
* fix：remove class author
* fix：Improve test coverage
* fix：add UT
* fix：add UT
* fix：data sync node renamed to datax
* fix：add UT
* fix: UT bug
* fix：Optimize variable name
* fix：pom
* fix：Variable name error
* fix：optimize the code
5 years ago
78bfe918d0
change datasource null check position ( #1883 )
5 years ago
5169689c35
class overrides equals() and should therefore also override hashCode() ( #1882 )
5 years ago
0712ccc342
#1871 correct spelling ( #1872 )
...
* move version to parent pom
* move version properties to parent pom for easy management
* remove freemarker dependency
* delete CombinedApplicationServer
* #1871 correct spelling
5 years ago
30db5c1467
Api module relp server module/1756 ( #1766 )
...
* Remove server module on api module
1. Remove server module and add dao module.
2. Move quartz in server module to dao module.
3. Update config and class.
to resolve conflicts，I deleted CombinedApplicationServer.java
Co-authored-by: dailidong <dailidong66@gmail.com>
5 years ago
d371745ddf
Fix bug: Use try-with-resources or close this "Socket" in a "finally" clause. ( #1716 )
...
* #1714
5 years ago
abe80fc538
[Feature] python task logs print delayed ( #1844 )
...
* [Feature] python task logs print delayed
#1843
5 years ago
aa91572def
fix Misspelled words ( #1841 )
...
* modify UdfFuncServiceTest UT
* fix get tenantCode my NPE
* add ResourcesServiceTest
* add error log
* add BaseServiceTest BaseServiceTest UT
* update
* fix word spelling
* Revert "fix word spelling"
This reverts commit 19bde51350
5 years ago
9ebe177e11
fix Misspelled words
5 years ago
55923016b4
Revert "fix word spelling"
...
This reverts commit 19bde51350
5 years ago
19bde51350
fix word spelling
5 years ago
1c77708a89
Supplementary data by schedule ( #1830 )
...
* Supplementary data by schedule
* fix sonar check bug
* fix code duplicated blocks
* ut
* loop by day
* MasterExecThread test
* test add licene
Co-authored-by: dailidong <dailidong66@gmail.com>
5 years ago
c531c88e7e
[Feature] AbstractCommandExecutor.commandType difficult to understand ( #1833 )
...
issue: https://github.com/apache/incubator-dolphinscheduler/issues/1831
5 years ago
779672ec2a
[Fix issue #1770 ]check udf and data source in order to fix issue 1770 ( #1826 )
...
* check udf and data source in order to fix issue 1770
* check udf and data source in order to fix issue 1770
* update testListAuthorizedUdfFunc
5 years ago
68f736953b
fix typos ( #1821 )
5 years ago
b9ac6d66f1
fix #1775 bug，delete process definition when process instance is running ( #1776 )
...
* remove LogViewServiceGrpc.java file and pom modify
* remove kazoo
* remove kazoo
* remove kazoo
* remove common monitor package
* add license
* remove kazoo modify
* remove kazoo modify
* remove kazoo modify
* remove kazoo modify
* remove kazoo modify
* remove kazoo modify
* install.sh remove python kazoo
* add system param whether repeat running
* remove kazoo modify
* BusinessTimeUtils remove whther repeat running inner param
* add AccessTokenMapperTest UT
* CI UT yml modify，start postgresql and zookeeper by default
* add AlertGroupMapperTest UT in github action
* Conflicts reslove
* AlertMappert UT modify
* AlertMappert UT modify
* AlertMappert UT modify
* CommandMapperTest UT modify
* DataSourceMapperTest UT modify
* fix #1775 bug，delete process definition when process instance is running
* verifyTenantIsNull remove process definnition id print log
5 years ago
88b022cb57
ITaskQueue should have "hasTask" function ( #1744 )
...
* issue https://github.com/apache/incubator-dolphinscheduler/issues/1742
* remove unnecessary catch
* fix exception type
* fix bad code smell
* remove log exceptions
* catch exception
5 years ago
aa715e17bf
remove lombok dependency(last) ( #1771 )
5 years ago
e0e0696b4f
add out put log when master/worker server start ( #1769 )
...
* merge hadoop.properties into common.properties
* merge hadoop,zookeeper.properties into common.properties
remove combined.properties/master.properties/worker.properties
* change db user/pwd to test/test
* rename .dolphinscheduler_en.sh to dolphinscheduler_env.sh
remove some unused in install.sh
* add out put log when master/worker server start...
* add start log when servers start
5 years ago
963ed4a8c6
ds.server & ds.common.zk regularize log print ( #1754 )
5 years ago
0a39f1a4dd
why not invoke checkWorkerGroup in advance ( #1747 )
...
* issue https://github.com/apache/incubator-dolphinscheduler/issues/1743
* issue https://github.com/apache/incubator-dolphinscheduler/issues/1743
5 years ago
8125974c61
ds.server regularize log print ( #1751 )
...
* ds.server regularize log print
* log print modify
* log print modify
* modify lang3 to lang
5 years ago
7762a62270
add null check in SubProcessTaskExecThread ( #1737 )
...
* modify FileUtils.readFile2Str
* #1300 Add right alignment function in sql email content
* cancel formatted for alert_mail_template.ftl
* #747 sql task password Log desensitization
* cancel mail_temple
* edit ExcelUtils
* modify test method name
* #747 sql task password Log desensitization
* #1544 workflow import
* Constants add DATASOURCE_PASSWORD_REGEX
* #747 sql task password Log desensitization
* deal with import project have sub process
* modify export process addTaskNodeParam method name
* add testAddTaskNodeSpecialParam UT
* add ProcessDefinitionServiceTest-ut to pom
* add testImportSubProcess in ProcessDefinitionServiceTest
* add testImportSubProcess in ProcessDefinitionServiceTest
* add testImportProcessDefinition
* fix sonar bug: not enough arguments
* fix sonar bug: change condition & not enough arguments
* fix bug sonar: add null check in daghelper && add hashcode method in ProcessData
* fix bug sonar: add null check in daghelper
* CollectionUtils.isEmpty()
* add hashcode() && null check
* merge if
* remove hashcode
* remove e.getMessage
5 years ago
7ecd38f7d6
fix sonar bug: change condition & not enough arguments ( #1692 )
...
* modify FileUtils.readFile2Str
* #1300 Add right alignment function in sql email content
* cancel formatted for alert_mail_template.ftl
* #747 sql task password Log desensitization
* cancel mail_temple
* edit ExcelUtils
* modify test method name
* #747 sql task password Log desensitization
* #1544 workflow import
* Constants add DATASOURCE_PASSWORD_REGEX
* #747 sql task password Log desensitization
* deal with import project have sub process
* modify export process addTaskNodeParam method name
* add testAddTaskNodeSpecialParam UT
* add ProcessDefinitionServiceTest-ut to pom
* add testImportSubProcess in ProcessDefinitionServiceTest
* add testImportSubProcess in ProcessDefinitionServiceTest
* add testImportProcessDefinition
* fix sonar bug: not enough arguments
* fix sonar bug: change condition & not enough arguments
5 years ago
884237487c
remove commons-lang3 dependancy, using common-module instead for server module ( #1698 )
...
* remove commons-lang3 dependancy
* remove commons-lang3 and commons-lang dependancy
* remove commons-collections4/commons-logging/commons-io dependancy
* tmp add commons-lang3 for compile
* remove commons-lang3 dependancy, using common-module instead
* remove common StringUtils instead of lang3
* add tmp lang3 for compile
5 years ago
0e66c71f38
remove commons-collections4/commons-logging/commons-io dependancy for API module ( #1693 )
...
* remove commons-lang3 dependancy
* remove commons-lang3 and commons-lang dependancy
* remove commons-collections4/commons-logging/commons-io dependancy
* tmp add commons-lang3 for compile
5 years ago
bb414b0794
delete bytes file ( #1669 )
5 years ago
f311c966ab
Fix bug in #1634 ,replace the current datetime with a fixed time ( #1665 )
5 years ago
b471119443
Add ParamUtilsTest which is the UT of ParamUtils ( #1634 )
...
1. Add ParamUtilsTest.
2. Add a null check in the method convert.
3. Add the UT path to the root pom.
5 years ago
d16500e8be
[Feature] merge some configurations #1635 ( #1636 )
...
* merge hadoop.properties into common.properties
* merge hadoop,zookeeper.properties into common.properties
remove combined.properties/master.properties/worker.properties
* change db user/pwd to test/test
5 years ago
2a0dab14ee
we should insert alert DB once , and trigger this type of alert 3 times ( #1622 )
5 years ago
cfd3266ca2
we should insert alert DB once , and trigger this type of alert 3 times
5 years ago
04df353b4c
refactor getKillProcessThread method
5 years ago
63f396b61f
refactor zk tree cache ( #1577 )
...
* refactor zk tree cache
* refactor zk tree cache
5 years ago
8b2b5ba684
refactor TaskQueueZkImpl ( #1591 )
...
* fix #1515
* sleep when resource in not satisfy. fix #1522
* add sleep 1s for no command
* fix MasterBaseTaskExecThread submit method bug
* updates
* add log
* delete lombok
* remove duplicate code
* refactor TaskQueueZkImpl
* ignore First , we have to rewrite
* updates
5 years ago
3b653328ef
'#1595'
5 years ago
eefb71855d
#747 Worker Log desensitization(日志脱敏) ( #1568 )
...
* modify FileUtils.readFile2Str
* #1300 Add right alignment function in sql email content
* cancel formatted for alert_mail_template.ftl
* #747 sql task password Log desensitization
* cancel mail_temple
* edit ExcelUtils
* modify test method name
* #747 sql task password Log desensitization
* Constants add DATASOURCE_PASSWORD_REGEX
5 years ago
f59bb10c2c
refactor TaskQueueZkImpl
5 years ago
e4edf3e4d0
remove duplicate code ( #1587 )
...
* fix #1515
* sleep when resource in not satisfy. fix #1522
* add sleep 1s for no command
* fix MasterBaseTaskExecThread submit method bug
* updates
* add log
* delete lombok
* remove duplicate code
5 years ago
Tboy
gabry.wu
qiaozhanwei
zhangzy
Rubik
dailidong
Yelli
liwenhe1993
Jave-Chen
samz406
lilin
老佛爷
lgcareer
ZHAOLIPAN
DK.Pino
bao liang
Yelli
khadgarmage
zhukai
Technoboy-
DK.Pino
JinyLeeChina