5d8808dda4
[Fix-15760][datasource-plugin] fix sql task split error ( #15760 ) ( #15794 )
...
* Fix the bug in SQL splitting by completing the task in two steps: 1. removeComment 2. split
* Add a unit test for Hive SQL splitting.
7 months ago
e498116025
Fix Hive jdbc url ( #15627 )
8 months ago
91d56f4860
fix: data quality may fail in docker mode ( #15563 )
9 months ago
8efaa9fa1f
fix: data quality can not use ( #15551 )
...
* fix: data quality can not use
fix : #15468 , #15249 , #14858
---------
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
9 months ago
cb5317f7ca
[bug] Exception when using host in ipv6 format ( #14040 )
...
* DB2 edit again, no username.
* [bug] db2's jdbcUrl should be like this "jdbc:db2://localhost:50000/sample:currentSchema=DB2INST1;characterEncoding=UTF-8;".should be ":"
* Update Db2DataSourceProcessor.java
* Update Db2DataSourceProcessorTest.java
* 【Bug】OracleSource edit again, ConnectionType is null
* when user inputs ipv6,checkhost will return "!IPV4_PATTERN.matcher(host).matches()";
I think we should use isInetAddress to check the host is isValid
* Update AbstractDataSourceProcessor.java
* Update DatabendDataSourceProcessorTest.java
last week other modified this
* Update MySQLDataSourceProcessorTest.java
* Update DataSourceUtilsTest.java
* Update MySQLDataSourceProcessorTest.java
* Update KyuubiDataSourceProcessorTest.java
* Update AbstractDataSourceProcessor.java
if host is ipv6 or ipv4 will OK; if not check other
* Update AbstractDataSourceProcessor.java
* Update AbstractDataSourceProcessor.java
* Update DataSourceUtilsTest.java
增加ipv6数据源验证
* [Bug] [dolphinscheduler-api] queryDataSource'password should be hidden.
---------
Co-authored-by: xiangzihao <460888207@qq.com>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
10 months ago
309c8c97a9
[Enhancement][API]Enhance mysql connection properties ( #15433 )
10 months ago
bf2cdc5300
Use Druid to split sql ( #15367 )
10 months ago
921253109a
[Bug] Close SSH session after remote shell finish ( #15348 )
...
* Close SSH session after remote shell finish
---------
Co-authored-by: David Zollo <davidzollo365@gmail.com>
10 months ago
b73194bd35
Fix check value rather than key in AbstractDataSourceProcessor#checkOther ( #15351 )
10 months ago
0feb144180
[Improvement-15260][dolphinscheduler-datasource-hana] add hana related dependencies ( #15260 )
...
* add hana related dependencies
* optimizing HANA data source bugs
* run mvn spotless:apply
* Fix hana datasource getValidationQuery()
* Fix hana datasource testGetJdbcUrl()
---------
Co-authored-by: xujiaqiang <“xujiaqiangwz@163.com”>
Co-authored-by: David Zollo <dailidong66@gmail.com>
11 months ago
5e135ba041
fix: execute sql error: datasource plugin 'doris' is not found。 ( #15123 )
...
Co-authored-by: xiangzihao <460888207@qq.com>
1 year ago
8665951981
[fix-#11726] fix error when set connection proerty both in the URL and an argument ( #15093 )
...
Co-authored-by: zhangying14 <zhangying14@zuoyebang.com>
Co-authored-by: xiangzihao <460888207@qq.com>
1 year ago
c532fea00e
[Improvement] Refactoring K8S task plugin with connections managed in connection center ( #14977 )
1 year ago
5a3827eef4
[DSIP-19] Support sagemaker connections in the connection center, as well as external connections to the connection center in sagemaker tasks ( #14976 )
...
* Refactoring `Sagemaker` task plugin with connections managed in connection center.
---------
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
1 year ago
e99c5950b9
[DSIP-19] Support zeppelin connections in the connection center, as well as external connections to the connection center in zeppelin tasks ( #14434 )
...
* Refactoring zeppelin task plugin with connections managed in connection center
---------
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
1 year ago
bc4326125d
Fix session/thread leak at ssh datasource ( #14859 )
1 year ago
9ce8871158
Support get property from env/jvm/common.properties ( #14645 )
1 year ago
4aab0b234f
Use AdHoc datasource client in sqlTask ( #14631 )
...
* Use AdHoc datasource client in sqlTask
* Add method in DataSourceChannel to create PooledDataSourceClient and AdHocDataSourceClient
1 year ago
6617e3fb72
Revert "datasource test and sql task Remove connection pool issues is #14179 ( #14193 )" ( #14626 )
...
This reverts commit e4fb5b30a4
1 year ago
e4fb5b30a4
datasource test and sql task Remove connection pool issues is #14179 ( #14193 )
...
* datasource test and sql task Remove connection pool issues is #14179
* datasource test and sql task Remove connection pool issues is #14179 uniform style
* datasource test and sql task Remove connection pool issues is #14179 uniform style by 20230720
* datasource test and sql task Remove connection pool issues is #14179 uniform style by 20230720
---------
Co-authored-by: xuhui <xuhui@3h1china.com>
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
1 year ago
1d0d85b988
[Feature] doris add datasource ( #14391 )
...
* Added doris data source plug-in
* Update DbType.java
* XML configuration
* doc and ui
* Missing catch of NumberFormatException
* code format
---------
Co-authored-by: xiangzihao <460888207@qq.com>
1 year ago
68a3a75211
[Improvement-14457][UT] Improve the expected and actual value of Assertions ( #14459 )
1 year ago
7a24be0672
[Feature-14404][datasource-plugin] add HANA datasource ( #14404 )
...
---------
Co-authored-by: WeiJian Kong <>
Co-authored-by: xujiaqiang <Xjq634828243>
1 year ago
221df4a278
revert: Datasource need test binding to create prod ( #14381 )
...
We should keep our step as less as possible, for now, we have to
test datasource and binding it to the prod datasource, I think it will
make our users do not thing to use datasource, so I do like to revert
it and keep step as less as possible
related to https://github.com/apache/dolphinscheduler/pull/11670
1 year ago
18d176c5f4
feat: Introduce new datasource vertica ( #14232 )
...
Co-authored-by: Zinway Liu <zinway.liu@ucloud.cn>
1 year ago
f1e78627fc
[feature][plugin] Add snowflake datasource in datasource plugin ( #13729 )
...
---------
Co-authored-by: weitong <weitong@cisco.com>
2 years ago
db6c061c8b
[Feature][plugin] Add databend datasource in datasource plugin ( #13866 )
...
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
2 years ago
dcf0109db3
【Bug】 OracleSouce edited again, ConnectionType is null ( #13881 )
2 years ago
c0126b7f30
[Feature][plugin] Support Kyuubi datasource ( #13642 )
...
---------
Co-authored-by: weitong <weitong@cisco.com>
Co-authored-by: Rick Cheng <38122586+rickchengx@users.noreply.github.com>
2 years ago
273a5e78eb
[FEATURE][Task Plugin]Add remote-shell task plugin ( #13801 )
2 years ago
ad7ce2db56
fix: DB2 username can not be save ( #13764 )
...
db2's jdbcUrl should be like this "jdbc:db2://localhost:50000/sample:currentSchema=DB2INST1;characterEncoding=UTF-8;".should be ":"
2 years ago
3630b00c9f
Fix Bug [Athena Datasource] datasource other params illegal ( #13032 )
2 years ago
35d8e8ac17
[Feature][DataSource] add oceanbase datasource ( #13675 )
...
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
2 years ago
8d12dc0702
[Improvement-13491] Use lombok @Slf4j annotation to generate logger ( #13509 )
2 years ago
b11431db95
Use single thread to refresh kerberos ( #13456 )
2 years ago
3a6e10397f
[feature][api-datasource]add redshift auth mode to get connection by access key ( #13379 )
...
* submit redshift auth mode
* add front end
* add doc and fix frontend
Co-authored-by: devosend <devosend@gmail.com>
2 years ago
bcf03ad4d1
[Feature-9467] add DAMENG DataSource ( #12860 )
...
* [Feature-9467][DataSource] add DAMENG （达梦） data source
* [Feature-9467] add DM datasource doc (Issue #9467 )
* [Feature-9467] add DM IDataBaseOptionKeys
* [Feature-9467] add DM DataSource: DmDataSourceChannelFactoryTest remove testGetDmConnection method
* [Feature-9467] modification package dm to dameng;
* [Feature-9467] add Dameng DmJdbcDriver18 License
* [Feature-9467] add DM DataSource: remove DruidDataSourceClient
Co-authored-by: lenian <yuenian@mananacare.com>
2 years ago
14ec4a2398
Remove dao module in worker ( #13242 )
2 years ago
b2336b0ce9
Remove datasource in procedure task ( #13198 )
2 years ago
f0dd4f081f
[Feature][task-plugins-12820] azure azure-sql datasource plugins ( #13209 )
...
* submit azure sql code
* change mssql-jdbc version
* merge changes to delete other
* merge changes to delete other
* add dependencies
2 years ago
5c75d312fa
Add StarRocks datasource ( #13204 )
2 years ago
ab96a3d0c0
Fix datasource jdbc url param doesn't work ( #13098 )
2 years ago
b40c63f02d
[Feature][DataSource]Add trino datasource plugin ( #12911 )
2 years ago
43d69ae157
Upgrade clickhouse jdbc driver ( #12639 )
2 years ago
dedff70f90
[Improvement] Merge spi.utils into common.utils ( #12502 )
...
* improve JSONUtil
* merge spi.utils into common.utils
* split constants && remove some copy utils method
* remove StringUtils
2 years ago
d46e4659d9
[Improvement][Style] Fix remaining style errors and wildcard imports ( #12412 )
...
* Fix remaining style errors and wildcard imports
* Upgrade spotless to the latest stable version, exclude .github folder from spotless check and fix dead link
* Fix spotless matching scope of markdown files
2 years ago
2f37da0dbc
[Improvement][Test] Block the usage of powermock and move mockito dependencies from sub-modules to root pom ( #12311 )
...
* move mockito dependencies from sub-modules to root pom
* Add check in CI to block the usage of powermock
2 years ago
ac845046e7
[Migrate][Test] Migrate all UT cases from jUnit 4 to 5 in datasource, registry and data-quality modules ( #12352 )
...
* Migrate all UT cases from jUnit 4 to 5 in datasource, registry and data-quality modules
* Fix etcd registry test
2 years ago
db1d319159
Reorganize some classes in common module, remove duplicate classes ( #12321 )
2 years ago
05099bd8f7
[Improvement-12296][Test] Close static mock ( #12300 )
2 years ago
songwenyong
zuo
Jay Chung
AliceXiaoLu
lgcareer
Wenjun Ruan
xujiaqiang
Xinxing
izualzhy
chenrj
xuhui1231
Rick Cheng
IT-Kwj
Zinway
He Zhao
Jeremy
JieguangZhou
Jrebel-i
He Wang
seedscoder
Tq
lenian
insist777
simsicon
caishunfeng
Eric Gao
kezhenxu94
rickchengx