github
/
DolphinScheduler
mirror of https://gitee.com/dolphinscheduler/DolphinScheduler.git
1
0
Fork 0
Code Issues Releases Wiki Activity
Browse Source

#2627: [Fix-9251] [WORKER] reslove the sql task about of add the udf resource failed (#9319) 

* feat(resource  manager): extend s3 to the storage of ds

1.fix some spell question
2.extend the type of storage
3.add the s3utils
to manager resource
4.automatic inject the storage in addition to your
config

* fix(resource  manager): update the dependency

* fix(resource  manager): extend s3 to the storage of ds

fix the constant of hadooputils

* fix(resource  manager): extend s3 to the storage of ds

1.fix some spell question
2.delete the import *

* fix(resource  manager):

merge  the unitTest:
1.TenantServiceImpl
2.ResourceServiceImpl
3.UserServiceImpl

* fix(resource  manager): extend s3 to the storage of ds

merge the resourceServiceTest

* fix(resource  manager): test  cancel the test method

createTenant verifyTenant

* fix(resource  manager): merge the code  follow the check-result of sonar

* fix(resource  manager): extend s3 to the storage of ds

fit the spell question

* fix(resource  manager): extend s3 to the storage of ds

revert the common.properties

* fix(resource  manager): extend s3 to the storage of ds

update the storageConfig with None

* fix(resource  manager): extend s3 to the storage of ds

fix the judge of resourceType

* fix(resource  manager): extend s3 to the storage of ds

undo the compile-mysql

* fix(resource  manager): extend s3 to the storage of ds

delete hadoop aws

* fix(resource  manager): extend s3 to the storage of ds

update the know-dependencies to delete aws 1.7.4
update the e2e
file-manager common.properties

* fix(resource  manager): extend s3 to the storage of ds

update the aws-region

* fix(resource  manager): extend s3 to the storage of ds

fix the storageconfig init

* fix(resource  manager): update e2e docker-compose

update e2e docker-compose

* fix(resource  manager): extend s3 to the storage of ds

revent the e2e common.proprites

print the resource type in propertyUtil

* fix(resource  manager): extend s3 to the storage of ds
1.println the properties

* fix(resource  manager): println the s3 info

* fix(resource  manager): extend s3 to the storage of ds

delete the info  and upgrade the s3 info to e2e

* fix(resource  manager): extend s3 to the storage of ds

add the bucket init

* fix(resource  manager): extend s3 to the storage of ds

1.fix some spell question
2.delete the import *

* fix(resource  manager): extend s3 to the storage of ds

upgrade the s3 endpoint

* fix(resource  manager): withPathStyleAccessEnabled(true)

* fix(resource  manager): extend s3 to the storage of ds

1.fix some spell question
2.delete the import *

* fix(resource  manager): upgrade the  s3client builder

* fix(resource  manager): correct  the s3 point to s3client

* fix(resource  manager): update the constant BUCKET_NAME

* fix(resource  manager): e2e  s3 endpoint -> s3:9000

* fix(resource  manager): extend s3 to the storage of ds

1.fix some spell question
2.delete the import *

* style(resource  manager): add info to createBucket

* style(resource  manager): debug the log

* ci(resource  manager): test

test s3

* ci(ci): add INSERT INTO dolphinscheduler.t_ds_tenant (id, tenant_code, description, queue_id, create_time, update_time) VALUES(1, 'root', NULL, 1, NULL, NULL); to h2.sql

* fix(resource  manager): update the h2 sql

* fix(resource  manager): solve to delete the tenant

* style(resource  manager): merge the style end delete the unuse s3 config

* fix(resource  manager): extend s3 to the storage of ds

UPDATE the rename resources when s3

* fix(resource  manager): extend s3 to the storage of ds

1.fix the code style of QuartzImpl

* fix(resource  manager): extend s3 to the storage of ds

1.impoort restore_type to CommonUtils

* fix(resource  manager): update the work thread

* fix(resource  manager): update  the baseTaskProcessor

* fix(resource  manager): upgrade dolphinscheduler-standalone-server.xml

* fix(resource  manager): add  user Info to dolphinscheduler_h2.sql

* fix(resource  manager): merge  the resourceType to NONE

* style(upgrade the log level to info):

* fix(resource  manager): sysnc the h2.sql

* fix(resource  manager): update the merge the user tenant

* fix(resource  manager): merge the resourcesServiceImpl

* fix(resource  manager):

when the storage is s3 ,that the directory can't be renamed

* fix(resource  manager): in s3 ,the directory cannot be renamed

* fix(resource  manager): delete the deleteRenameDirectory in E2E

* fix(resource  manager): check the style and  recoverd the test

* fix(resource  manager): delete the log.print(LoginUser)

* fix(server): fix the  udf serialize

* fix(master  task): update the udfTest to update the json string

* fix(test): update the udfFuncTest

* fix(common): syn the common.properties

* fix(udfTest): upgrade the udfTest

* fix(common): revent the common.properties
git-as-svn/v1/dev
nobolity 3 years ago committed by GitHub
parent
fc7a4027cb 037692517a
commit
d6d3d62f65
2 changed files with 105 additions and 33 deletions
Whitespace
Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL
Split View
Diff Options
Show Stats Download Patch File Download Diff File
  1. 2
      commit.ref
  2. 136
      commit.yml

2
commit.ref

@ -1 +1 @@
Subproject commit fea9ce391b778f554d0404ea46bc6b357625508d
Subproject commit 037692517ac661344dd86d178d6ca5e367cb1fcb

136
commit.yml
Unescape View File

@ -2,37 +2,109 @@
branches: {
}
fileChange:
/dolphinscheduler-api:
newFile: !uuid '4065cea9d97683895bed26950dbc9a14b6548fe3'
oldFile: !uuid 'f67a7e599deffdb93527948834cb9480c86a91ae'
/dolphinscheduler-api/src:
newFile: !uuid '909f610c8a56d2c94d2be111bc95cd54b6ac8b9f'
oldFile: !uuid 'b762312fb1a5f17521ecc298202c95f1af5bd7d3'
/dolphinscheduler-api/src/test:
newFile: !uuid 'c43fbd12ee5511f386a1fcfd33a52b0409b5e778'
oldFile: !uuid '602c14e10be1c7d18aba5be10fb98f85b7e78070'
/dolphinscheduler-api/src/test/java:
newFile: !uuid '6154d7416749037c80ec3c546fa4d0e6e64745ac'
oldFile: !uuid 'cf3bd44e155c6cfc28232fc4bfaa5c4bbf708a1a'
/dolphinscheduler-api/src/test/java/org:
newFile: !uuid '58a132b645b607b6b0047f4f9f0803895fe22cd7'
oldFile: !uuid '0425d68826c5141cafd9cf6603fc1d9539c4d895'
/dolphinscheduler-api/src/test/java/org/apache:
newFile: !uuid '65819969801f5d89dd095b4c97db020e2b2f7a18'
oldFile: !uuid 'd713447e2fc869ed86a908d2ba9a14374e189ea9'
/dolphinscheduler-api/src/test/java/org/apache/dolphinscheduler:
newFile: !uuid '47dcede8e9f65f8c03a6b904a16159dd4d60d0c3'
oldFile: !uuid '1ff5ab97eab64f582d4b34dbda4f964102742677'
/dolphinscheduler-api/src/test/java/org/apache/dolphinscheduler/api:
newFile: !uuid '757a35f8da5cbb125aec437c957bd432d1a3894c'
oldFile: !uuid '936eaadd01e858f79e96f192f729f693618edd39'
/dolphinscheduler-api/src/test/java/org/apache/dolphinscheduler/api/controller:
newFile: !uuid '5c87dd2308f755a62d4c992c4494c90e9e125cb6'
oldFile: !uuid '226c9207a75c648a1bc181f351ead3e7a32d0db4'
/dolphinscheduler-api/src/test/java/org/apache/dolphinscheduler/api/controller/AlertGroupControllerTest.java:
newFile: !uuid 'a40ec4996dcef1a4a7c963715f2f334947aa081a'
oldFile: !uuid '6b38bfaf1a0e19332cd010c0ac4dafff21249a4d'
gitCommitId: !uuid 'fea9ce391b778f554d0404ea46bc6b357625508d'
/dolphinscheduler-dao:
newFile: !uuid 'f4b81d0a71f3f7b08a20886543b7f08e0c3fd3bb'
oldFile: !uuid 'd262784b2384c982fa0e7d6612f85d8c6555d0a4'
/dolphinscheduler-dao/src:
newFile: !uuid '82ea54e3641cb57ab037d39702382a2f352b513b'
oldFile: !uuid '79ecc190ab7baaf45e63fed743443b6cd6bc3b66'
/dolphinscheduler-dao/src/main:
newFile: !uuid '0f5ca5295e0c4e1669a66883f8803438c18aa28d'
oldFile: !uuid '58d3cdd51be842a47662968d9a2bd2efdfc5b44e'
/dolphinscheduler-dao/src/main/java:
newFile: !uuid 'adb9f92cccb71f53bb5f001664b37167784a2c5d'
oldFile: !uuid '489d9c64cc3c54fbbab8bbfe389a806af77337cc'
/dolphinscheduler-dao/src/main/java/org:
newFile: !uuid 'ddb22b11297ebfe3bc5779963595424750002646'
oldFile: !uuid 'cc9c32933a1d1770a1972edb0159b5f7caf8c57b'
/dolphinscheduler-dao/src/main/java/org/apache:
newFile: !uuid 'fa50fbd9f8b43b237f07e5df78d504014dfe4525'
oldFile: !uuid 'c4ef992d5d79095cea89568e3ecb4d0081181973'
/dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler:
newFile: !uuid '3f78ececc54cc139d0372ecdbcfba23447666f7c'
oldFile: !uuid '7a4510443ee9b16b6ada0deddf2dc90c7b19c5a0'
/dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao:
newFile: !uuid '313ef1dc6a70dea8bc79d260a3d3e2cbdcab051d'
oldFile: !uuid '232eb257a87de0647fb197bed1a286a3ab6b32e3'
/dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/entity:
newFile: !uuid 'c00a431a5cc5abce04ed365128f049d2708ca8df'
oldFile: !uuid '26e9804d74f22fecdcacb8ae690d3c32d3276672'
/dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/entity/UdfFunc.java:
newFile: !uuid '949499d1e8058fba41e9c1f5cefc0be226265d34'
oldFile: !uuid '2a389b9bd5eb9e74673116d4ae3554fdf52afdbc'
/dolphinscheduler-dao/src/test:
newFile: !uuid '8c3b6276c8307c36da65b8d1710cba03ce974ee4'
oldFile: !uuid '76f880dc4abe773a95a82b3f5df288f420151e00'
/dolphinscheduler-dao/src/test/java:
newFile: !uuid 'f70484579378ce02ba11d70dc16fed96c6611851'
oldFile: !uuid '6017643e3480116b16cae0861402f13ce7769fda'
/dolphinscheduler-dao/src/test/java/org:
newFile: !uuid 'ea93730057bfbd73f148b5ffae98049fadf49b64'
oldFile: !uuid '916ccc5ce4b6c5898525e42c4e135464cd043f10'
/dolphinscheduler-dao/src/test/java/org/apache:
newFile: !uuid '14b12a4cb8b06981014556547e625dc19d1c7ba2'
oldFile: !uuid '4c950ecfec335105fcb83febf6d4ead7183a3624'
/dolphinscheduler-dao/src/test/java/org/apache/dolphinscheduler:
newFile: !uuid '8fa9c83d329979eab162d2d57dee4ebd2c73ecd4'
oldFile: !uuid '025ebfec2a38e7abb0c367b57029f02d01089011'
/dolphinscheduler-dao/src/test/java/org/apache/dolphinscheduler/dao:
newFile: !uuid '30047d6b3733804998dd103e51c271e8f75d9806'
oldFile: !uuid '34e8d4063c5ae61f91737bfc42b30eed0b5719f7'
/dolphinscheduler-dao/src/test/java/org/apache/dolphinscheduler/dao/entity:
newFile: !uuid '8e11eb46a924470c3d99c81137848204ea1af13e'
oldFile: !uuid '5be3f33e43a2950732c184e404204c8c58050880'
/dolphinscheduler-dao/src/test/java/org/apache/dolphinscheduler/dao/entity/UdfFuncTest.java:
newFile: !uuid '4231ba35f6f5f5006da28fe2a8d1569a6eb9e5e1'
oldFile: !uuid '5d0fbe86d440848aef09ae016d169a8abe34cef7'
/dolphinscheduler-task-plugin:
newFile: !uuid 'd835a0dd2d3648851ce8041a5117bae33cdd6337'
oldFile: !uuid 'fd6a76851f57eb93653dfb3bd40fd03596841350'
/dolphinscheduler-task-plugin/dolphinscheduler-task-api:
newFile: !uuid 'caf2b8df924843179e80bed236e560295cc34176'
oldFile: !uuid '3110f5512166f0293d490bead752ff48502d9701'
/dolphinscheduler-task-plugin/dolphinscheduler-task-api/src:
newFile: !uuid 'dfe56da2a44b1b34cd0b15ed25631edc8588d7bf'
oldFile: !uuid 'fca7e97e9db565eac2656994f90b3371335dcbef'
/dolphinscheduler-task-plugin/dolphinscheduler-task-api/src/main:
newFile: !uuid '9afb19db3e112323bcba491af81cedc997936d5a'
oldFile: !uuid 'c805c523698b5940749c96ce5f77f35a37464508'
/dolphinscheduler-task-plugin/dolphinscheduler-task-api/src/main/java:
newFile: !uuid 'f9b9d853fa73945e3109de73bebc94bc2d6e33b3'
oldFile: !uuid 'c9d0854b92114ac843117f52d0da75652d1df954'
/dolphinscheduler-task-plugin/dolphinscheduler-task-api/src/main/java/org:
newFile: !uuid '0a9a594880d011d417f9e8732647c591cd0eff66'
oldFile: !uuid 'e9e1ac1f40bab103c589345f142254d14ed12acb'
/dolphinscheduler-task-plugin/dolphinscheduler-task-api/src/main/java/org/apache:
newFile: !uuid 'a08500ae8fc145a92713cd0167b443a6cba36f5c'
oldFile: !uuid 'e874b2d9214eb6652bcb9043d1f7e8ddcd7484b7'
/dolphinscheduler-task-plugin/dolphinscheduler-task-api/src/main/java/org/apache/dolphinscheduler:
newFile: !uuid '9eaeb6a544d5f5a5525c2467b3b18eb5317d98df'
oldFile: !uuid '52911fbe93387cbc0168c2022444c55265ad6c5e'
/dolphinscheduler-task-plugin/dolphinscheduler-task-api/src/main/java/org/apache/dolphinscheduler/plugin:
newFile: !uuid '5834460240cc05cf5ab1fec0d39bcb3a0af6e1b0'
oldFile: !uuid 'adfc5ce1c864451d21ea0d9bc2dd38c415212fb8'
/dolphinscheduler-task-plugin/dolphinscheduler-task-api/src/main/java/org/apache/dolphinscheduler/plugin/task:
newFile: !uuid 'd10f8eaa63814e023a8b95a3062975891e5af120'
oldFile: !uuid 'b548affea96ec80a6efc2438e5cc6a789d2c69fe'
/dolphinscheduler-task-plugin/dolphinscheduler-task-api/src/main/java/org/apache/dolphinscheduler/plugin/task/api:
newFile: !uuid '7db6e41b38e83fa68fda4d7c60b227974fb91d29'
oldFile: !uuid 'b4263480e8a380eafe3662bb88dfcdea3f4f5774'
? /dolphinscheduler-task-plugin/dolphinscheduler-task-api/src/main/java/org/apache/dolphinscheduler/plugin/task/api/parameters
: newFile: !uuid '7776c11ca7c9d47fd64fefa651f0cc17076e5a4b'
oldFile: !uuid '54c165519f55ac61172518b434c477b2a3e0f8f6'
? /dolphinscheduler-task-plugin/dolphinscheduler-task-api/src/main/java/org/apache/dolphinscheduler/plugin/task/api/parameters/resource
: newFile: !uuid '143f67186de92ebd505a37b2050dd6cdf118f43e'
oldFile: !uuid '2459e93192eab916f9a81b529a46fb573e731050'
? /dolphinscheduler-task-plugin/dolphinscheduler-task-api/src/main/java/org/apache/dolphinscheduler/plugin/task/api/parameters/resource/AbstractResourceParameters.java
: newFile: !uuid 'b719f95b4edb86802a96149ded7f2e2a9a9010f3'
oldFile: !uuid '39193c8f2e4f228d0e7eb7b8d4f02ab2c6efe2f1'
? /dolphinscheduler-task-plugin/dolphinscheduler-task-api/src/main/java/org/apache/dolphinscheduler/plugin/task/api/parameters/resource/DataSourceParameters.java
: newFile: !uuid 'ea9cb7ae5a4fef58ef958187753aec8316824d9e'
oldFile: !uuid '71d0dc0dad91a005521dd0dd919ea4b408b35597'
? /dolphinscheduler-task-plugin/dolphinscheduler-task-api/src/main/java/org/apache/dolphinscheduler/plugin/task/api/parameters/resource/UdfFuncParameters.java
: newFile: !uuid 'f0ce7729350f126f2b4070dd8c1bf7ed58730a84'
oldFile: !uuid 'd1b1f36e479a680be5bd5ae7636513a2e0429004'
gitCommitId: !uuid '037692517ac661344dd86d178d6ca5e367cb1fcb'
renames: {
}
revisionId: 2626
revisionId: 2627

Write Preview
Loading…
Cancel
Save