Wenjun Ruan
edeb1b2458
[DSIP-45] Polish the Storage SPI ( #16141 )
5 months ago
小可耐
7a55adeae9
[Improvement-15919][datasource] Improvement datasource get name ( #15920 )
6 months ago
songwenyong
5d8808dda4
[Fix-15760][datasource-plugin] fix sql task split error ( #15760 ) ( #15794 )
...
* Fix the bug in SQL splitting by completing the task in two steps: 1. removeComment 2. split
* Add a unit test for Hive SQL splitting.
7 months ago
zuo
e498116025
Fix Hive jdbc url ( #15627 )
8 months ago
Wenjun Ruan
bf2cdc5300
Use Druid to split sql ( #15367 )
10 months ago
Wenjun Ruan
4aab0b234f
Use AdHoc datasource client in sqlTask ( #14631 )
...
* Use AdHoc datasource client in sqlTask
* Add method in DataSourceChannel to create PooledDataSourceClient and AdHocDataSourceClient
1 year ago
Wenjun Ruan
6617e3fb72
Revert "datasource test and sql task Remove connection pool issues is #14179 ( #14193 )" ( #14626 )
...
This reverts commit e4fb5b30a4
.
1 year ago
xuhui1231
e4fb5b30a4
datasource test and sql task Remove connection pool issues is #14179 ( #14193 )
...
* datasource test and sql task Remove connection pool issues is #14179
* datasource test and sql task Remove connection pool issues is #14179 uniform style
* datasource test and sql task Remove connection pool issues is #14179 uniform style by 20230720
* datasource test and sql task Remove connection pool issues is #14179 uniform style by 20230720
---------
Co-authored-by: xuhui <xuhui@3h1china.com>
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
1 year ago
seedscoder
8d12dc0702
[Improvement-13491] Use lombok @Slf4j annotation to generate logger ( #13509 )
2 years ago
Wenjun Ruan
b11431db95
Use single thread to refresh kerberos ( #13456 )
2 years ago
Wenjun Ruan
ab96a3d0c0
Fix datasource jdbc url param doesn't work ( #13098 )
2 years ago
caishunfeng
dedff70f90
[Improvement] Merge spi.utils into common.utils ( #12502 )
...
* improve JSONUtil
* merge spi.utils into common.utils
* split constants && remove some copy utils method
* remove StringUtils
2 years ago
Eric Gao
d46e4659d9
[Improvement][Style] Fix remaining style errors and wildcard imports ( #12412 )
...
* Fix remaining style errors and wildcard imports
* Upgrade spotless to the latest stable version, exclude .github folder from spotless check and fix dead link
* Fix spotless matching scope of markdown files
2 years ago
Eric Gao
2f37da0dbc
[Improvement][Test] Block the usage of powermock and move mockito dependencies from sub-modules to root pom ( #12311 )
...
* move mockito dependencies from sub-modules to root pom
* Add check in CI to block the usage of powermock
2 years ago
Eric Gao
ac845046e7
[Migrate][Test] Migrate all UT cases from jUnit 4 to 5 in datasource, registry and data-quality modules ( #12352 )
...
* Migrate all UT cases from jUnit 4 to 5 in datasource, registry and data-quality modules
* Fix etcd registry test
2 years ago
kezhenxu94
db1d319159
Reorganize some classes in common module, remove duplicate classes ( #12321 )
2 years ago
rickchengx
05099bd8f7
[Improvement-12296][Test] Close static mock ( #12300 )
2 years ago
Wenjun Ruan
0a44107bf9
Fix hive datasource connection leak ( #12226 )
2 years ago
Eric Gao
585efe3ad5
[Improvement][Test] Remove the usage of powermock in datasource-plugin module ( #12194 )
...
* Remove the usage of powermock in datasource-plugin module
* Switch datasource-plugin module to use PropertyUtils in common module
2 years ago
Tq
cf5a8894e2
[BUG][BE-12113]fix htrace dependency conflicts ( #12126 )
...
* fix htrace dependency conflicts
* replace htrace-core with hbase-noop-htrace
2 years ago
Wenjun Ruan
71cf7e1baa
[Fix-10918] Close datasource when expire from guava cache ( #11120 )
...
* Close datasource when expire from guava cache
* Remove duplicate datasource in HiveDataSourceClient
2 years ago
Wenjun Ruan
5e9c7dad23
Add dolphinscheduler-bom to manage the dependency version ( #11025 )
2 years ago
Wenjun Ruan
516757cc74
[Fix] [Worker] Fix worker will hang if fails to start ( #10342 )
...
* Fix worker will hang if fails to start
* Add .run to ignore
2 years ago
Wenjun Ruan
0bf4043d5f
Move datasource params to datasouce plugin module ( #10353 )
...
* Move datasource params to datasouce plugin module
2 years ago
kezhenxu94
d80cf21456
Clean up unused dependencies and packaging issues ( #9944 )
2 years ago
zhuxt2015
206b7c1c51
[Fix-9352][datasource-api]data source client uses a cache with an expiration time ( #9353 )
...
* datasource client cache with expiration time
* remove unused import
* fixed unit test
* fix
* fix
* fix
* fix
* fix
* fix
* fix
3 years ago
Eric Gao
fd6b43bc81
[Dev] Switch version in pom.xml to dev-SNAPSHOT ( #9223 ) ( #9299 )
3 years ago
sparklezzz
934d0ad063
[Feat]Restore presto and spark sql datasource in datasource plugin module ( #7619 )
...
* feat(datasource-plugin): restore presto and spark sql datasource
* feat(datasource-plugin): restore presto and spark sql datasource
* feat(datasource for spark/presto): fix pom and simplify code
Co-authored-by: xudong.zhang <xudong.zhang@nio.com>
3 years ago
Kerwin
a1bef43981
[Feature-8579][Task] Task back-end plugin optimization, new plugins only need to modify the plugin's own module ( #8584 )
...
* Task plug-in optimization, task-related classes are migrated to the task plugin module
* remove tasktype enum class.
* fix code style.
* fix code style
* fix code style
* fix ProcessServiceTest.testUpdateResourceInfo test class
* fix code style
* fix test task plugin manager check parameters null
* fix test ut
* update aws license
* change TaskTimeoutStrategy class
3 years ago
Kerwin
103ccb01da
change version to 2.0.4-SNAPSHOT ( #8188 )
3 years ago
wangbowen
85beb50f03
[Fix-7485][datasource-plugin] Fix create hive datasource using ZooKeeper way in 2.0.1 ( #7489 )
3 years ago
SbloodyS
a17a8d777a
[Fix-7392][dolphinscheduler-datasource] Add hive datasource failed ( #7393 )
...
* fix bug_7392
* fix bug_7392
* fix bug_7392
Co-authored-by: SbloodyS <sbloodys@qq.com>
3 years ago
Zonglei Dong
7e0010de35
[Refactor] Rename class file, unified word spelling. ( #7261 )
3 years ago
mask
8e62dd8246
[Fix-7291][datasource] Compatible with different versions of MySQL data source loading ( #7291 ) ( #7305 )
3 years ago
kezhenxu94
67cc260d52
Split the components into individual package, refactor configurations to use Spring properties ( #7160 )
...
* Split the components into individual package
A follow-up PR will be made to build dedicated Docker images for each
component, so that every component Docker image has minimal jars, which
is easy to maintain and good for security fixes.
* Split the components into individual package
A follow-up PR will be made to build dedicated Docker images for each
component, so that every component Docker image has minimal jars, which
is easy to maintain and good for security fixes.
* Split the components into individual package
A follow-up PR will be made to build dedicated Docker images for each
component, so that every component Docker image has minimal jars, which
is easy to maintain and good for security fixes.
3 years ago
mask
8d68cf48dd
[Fix-7277][datasource] Support Kerberos auto renewal ( #7277 ) ( #7278 )
3 years ago
kezhenxu94
2ed3c0c3a7
Recover unit tests that have not been run for some time ( #7054 )
3 years ago
kezhenxu94
4114cb07f6
Add actuator and enable metrics, add Grafana configs ( #6840 )
3 years ago
mask
a998415afe
[Feature][datasource] Change DataSource Connection Pool from Druid to HiKariCP ( #6490 ) ( #6828 )
...
* [Feature][datasource] Change DataSource Connection Pool from Druid to HiKariCP (#6490 )
* fix pom dep scope
* filter alert
* filter alert
* filter alert
* fix checkstyle
* remove hikaricp version
* update pom
* add properties
* add properties
* rename properties
* fix e2e fail
* rename properties
3 years ago
kezhenxu94
11844415b0
Refactor datasource and task plugins and simplify its usage ( #6767 )
3 years ago
mask
0aea5ae11a
[feature-6071][plugin] add datasource plugin. ( #6071 ) ( #6361 )
...
* [feature-6071][plugin] add datasource plugin. (#6071 )
* remove the dependency of datasource in common and task-plugin module.
* the new datasource-api module provides data source connection acquisition.
* add sqlserver data source plug-in.
* add ds license
* fix check style
* update spi pom
* frx conflict resolution
* fix check style
* fix datasource ut
* fix code check style
* fix code check style
* fix datasource ut
* add pg hive mysql oracle clickhouse db2 datasource
* fix datasource package
* update datasource pom
* update datasource pom
* update datasource pom
* update datasource pom
* update pom
* update pom dep
* update pom dep
* fix license
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* add oracle package
* modify comments
* conflict resolution
* rename log comment
* rename log comment
3 years ago