DolphinScheduler

Commit Graph

Author	SHA1	Message	Date
sparklezzz	934d0ad063	[Feat]Restore presto and spark sql datasource in datasource plugin module (#7619 ) * feat(datasource-plugin): restore presto and spark sql datasource * feat(datasource-plugin): restore presto and spark sql datasource * feat(datasource for spark/presto): fix pom and simplify code Co-authored-by: xudong.zhang <xudong.zhang@nio.com>	3 years ago
Kevin.Shin	af9aedfd2d	fix https://github.com/apache/dolphinscheduler/issues/8889 (#8921 )	3 years ago
Kerwin	a1bef43981	[Feature-8579][Task] Task back-end plugin optimization, new plugins only need to modify the plugin's own module (#8584 ) * Task plug-in optimization, task-related classes are migrated to the task plugin module * remove tasktype enum class. * fix code style. * fix code style * fix code style * fix ProcessServiceTest.testUpdateResourceInfo test class * fix code style * fix test task plugin manager check parameters null * fix test ut * update aws license * change TaskTimeoutStrategy class	3 years ago
ronyang1985	7b66b66e8f	[Feature-8527][Datasource] Add dataSource for Amazon Redshift (#8564 ) Co-authored-by: Wenjun Ruan <wenjun@apache.org>	3 years ago
zhuxt2015	2a1406073a	fix jdbc connect parameters can not input '@' and '.' character (#8293 ) * fix jdbc connect parameters can not input '@' and '.' character This closes #8135 * add AbstractDataSourceProcessor class unit test * add license header * remove class comment * optimize unit tests * modify the variable name Co-authored-by: 朱学通 <zhuxuetong@gridsum.com>	3 years ago
zixi0825	4ba6d667fc	[Feature][DataQuality] Add Data quality Module #4283 (#6718 ) * add data quality module * add license * add package configuration in dist pom * fix license and jar import bug * replace apache/skywalking-eyes@9bd5feb SHA * refacotr jbdc-connector and writer * modify parameter name in HiveConnector * fix checkstyle error * fix checkstyle error in dolphinschesuler-dist * fix checkstyle error in dolphinschesuler-dist * fix checkstyle error in dolphinschesuler-dist * fix duplicate code bug * fix code style bug * fix code smells * add dq relevant enums and parameter * replace apache/skywalking-eyes@9bd5feb SHA * fix Constants bug * remove the unused class * add unit test * fix code style error * add unit test * refactor data quality common entity * fix code style error * add unit test * close e2e test * fix code smell bug * modify dataquality enum value to 14 in TaskType * add data qualtiy task * update * add getDatasourceOptions interface * fix checkstyle * close e2e test * add data quality task ui * update skywalking-eyes SHA * fix style * fix eslint error * fix eslint error * test e2e * add unit test and alter dataquality task result * fix checkstyle * fix process service test error * add unit test and fix code smells * fix checkstyle error * fix unit test error * fix checkstyle error * change execute sql type name * revert ui pom.xml * fix data quality task error * fix checkstyle error * fix dq task src_connector_type ui select bug * fix spark rw postgresql bug * change mysql driver scope * fix form-create json bug * fix code smell * fix DolphinException Bug * fix ui validate rule and Alert title * fix target connection param bug * fix threshold validate change * add rule input entry index * change statistic_comparison_check logic * remove check type change * add DateExpressionReplaceUtil * fix null point expetion * fix null point expetion * fix test error * add more sql driver * fix test error and remove DateExprReplaceUtil * add get datasource tables and columns * add get datasource tables and columns * remove hive-jdbc in pom.xml * fix code smells * update sql * change the pom.xml * optimize multi_table_accuracy ui * fix v-show error * fix code smells * update sql * [Feature][DataQuality] Add data quality task ui (#5054) * add data quality task ui * update skywalking-eyes SHA * fix style * fix eslint error * fix eslint error * test e2e * fix dq task src_connector_type ui select bug * fix threshold validate change * remove check type change * add get datasource tables and columns * optimize multi_table_accuracy ui * fix v-show error * fix code smells Co-authored-by: sunchaohe <sunzhaohe@linklogis.com> * [Feature][DataQuality] Add data quality module (#4830) * add data quality module * add license * add package configuration in dist pom * fix license and jar import bug * replace apache/skywalking-eyes@9bd5feb SHA * refacotr jbdc-connector and writer * modify parameter name in HiveConnector * fix checkstyle error * fix checkstyle error in dolphinschesuler-dist * fix checkstyle error in dolphinschesuler-dist * fix checkstyle error in dolphinschesuler-dist * fix duplicate code bug * fix code style bug * fix code smells * update * close e2e test * fix spark rw postgresql bug * change mysql driver scope * add more sql driver * remove hive-jdbc in pom.xml * change the pom.xml Co-authored-by: sunchaohe <sunzhaohe@linklogis.com> * [Feature][DataQuality] Add data quality task backend (#4883) * add dq relevant enums and parameter * replace apache/skywalking-eyes@9bd5feb SHA Co-authored-by: sunchaohe <sunzhaohe@linklogis.com> * refactor data_quality_module * add header license * data quality module refactor * fix unit test error * fix checkstyle error * fix unit test error * fix checkstyle error * fix unit test error * fix code smell * fix check style * fix unit test error * task statistics value add unique code * fix unit test error * fix checkstyle error * fix checkstyle * fix security hotspot * fix unit test error * fix security hotspot * fix check * add data quality task error handling * fix unit test error * add unit test * add unit test * optimize data quality result alert * fix unit test * fix sql script error * fix bug * update sql script * fix checkstyle * add license * fix checkstyle * fix checkstyle * fix unit test * add jacoco dependencies * fix unit test * fix unit test * add jacoco dependencies * add unit test * add unit test * add license * fix checkstyle * fix pom * fix checkstyle * fix checkstyle * merge dev * fix ui error * fix pom error * fix pom error * fix test error * fix test error * mssql-jdbc exclude azure-keyvault * fix test error * merge dev and add unit test * add notes * rollback the CollectionUtils * fix * update sql * fix * fix * fix query rule page error * change dq.jar path * fix sql error * fix ui error * fix(dq): jar path&task enum description * add notes on DataQualityApplication * fix dq result jump error * fix(ui): page condition * feat(ui): add show error output path * change version * remove all chinese word in sql * merge Co-authored-by: sunchaohe <sunzhaohe@linklogis.com>	3 years ago
Kerwin	103ccb01da	change version to 2.0.4-SNAPSHOT (#8188 )	3 years ago
mask	898727709f	[fix-7671][plugin] Supports whether SQL is placed in the same session for configuration(fix-7671) (#7675 ) -Supports whether SQL is placed in the same session for configuration	3 years ago
X&Z	57f000ed1f	[BUG] Repair JDBC connection of Oracle (#7883 )	3 years ago
wangxj3	9e763ad0d1	[Feature-#6422] [api-server] task group queue (#7491 ) * add task group * modify task group * pull dev * add license header * modify code style * fix code style * fix sql error * fix error * fix test * fix test * fix test * fix test * fix code style * fix ut * code style * fix unit test * test ut * ut * add unittest * test ut * modify back ut * majorization code * fix conflict * fix ut * add task group api * reset file * fix ut * fix lost column * fix ut * fix ut * fix ut * fix ut * delete duplicate code * fix code style 、name * fix ut * fix mapper Co-authored-by: wangxj <wangxj31>	3 years ago
wangbowen	85beb50f03	[Fix-7485][datasource-plugin] Fix create hive datasource using ZooKeeper way in 2.0.1 (#7489 )	3 years ago
SbloodyS	a17a8d777a	[Fix-7392][dolphinscheduler-datasource] Add hive datasource failed (#7393 ) * fix bug_7392 * fix bug_7392 * fix bug_7392 Co-authored-by: SbloodyS <sbloodys@qq.com>	3 years ago
Zonglei Dong	7e0010de35	[Refactor] Rename class file, unified word spelling. (#7261 )	3 years ago
mask	8e62dd8246	[Fix-7291][datasource] Compatible with different versions of MySQL data source loading (#7291 ) (#7305 )	3 years ago
mask	8c3fa47903	[Fix-7375][datasource] remove excess hive jdbc principal (#7375 ) (#7381 ) * [Fix-7375][datasource] remove excess hive jdbc principal (#7375) * fix ut	3 years ago
kezhenxu94	67cc260d52	Split the components into individual package, refactor configurations to use Spring properties (#7160 ) * Split the components into individual package A follow-up PR will be made to build dedicated Docker images for each component, so that every component Docker image has minimal jars, which is easy to maintain and good for security fixes. * Split the components into individual package A follow-up PR will be made to build dedicated Docker images for each component, so that every component Docker image has minimal jars, which is easy to maintain and good for security fixes. * Split the components into individual package A follow-up PR will be made to build dedicated Docker images for each component, so that every component Docker image has minimal jars, which is easy to maintain and good for security fixes.	3 years ago
mask	8d68cf48dd	[Fix-7277][datasource] Support Kerberos auto renewal (#7277 ) (#7278 )	3 years ago
mask	deefc8e98a	[Fix-7235][datasource] unable to confige the multi-hosts (#7235 ) (#7253 )	3 years ago
Zonglei Dong	0b9792db76	[Refactor]Rename class file, DatasourceUtil to DataSourceUtils. (#7181 ) * Rename class file, DatasourceUtil to DataSourceUtils.	3 years ago
kezhenxu94	2ed3c0c3a7	Recover unit tests that have not been run for some time (#7054 )	3 years ago
sparklezzz	42e20cbf60	fix(kerboros): set correct classloader for kerboros conf load in plugin tasks (#7027 ) Co-authored-by: xudong.zhang <xudong.zhang@nio.com>	3 years ago
yihong	861aaaf971	[FIX-#6505][Dao] upgrade the MySQL driver package for building MySQL jdbcUrl (#6708 ) * replace com.mysql.jdbc.Driver everywhere with com.mysql.cj.jdbc.Driver	3 years ago
kezhenxu94	4114cb07f6	Add actuator and enable metrics, add Grafana configs (#6840 )	3 years ago
mask	a998415afe	[Feature][datasource] Change DataSource Connection Pool from Druid to HiKariCP (#6490 ) (#6828 ) * [Feature][datasource] Change DataSource Connection Pool from Druid to HiKariCP (#6490) * fix pom dep scope * filter alert * filter alert * filter alert * fix checkstyle * remove hikaricp version * update pom * add properties * add properties * rename properties * fix e2e fail * rename properties	3 years ago
Jiajie Zhong	6045728428	[ci] Add checkstyle prohibit rule System.out.println (#6778 ) * [ci] Add checkstyle prohibit rule System.out.println * Correct RegexpSingleline place	3 years ago
kezhenxu94	11844415b0	Refactor datasource and task plugins and simplify its usage (#6767 )	3 years ago
mask	0aea5ae11a	[feature-6071][plugin] add datasource plugin. (#6071 ) (#6361 ) * [feature-6071][plugin] add datasource plugin. (#6071) * remove the dependency of datasource in common and task-plugin module. * the new datasource-api module provides data source connection acquisition. * add sqlserver data source plug-in. * add ds license * fix check style * update spi pom * frx conflict resolution * fix check style * fix datasource ut * fix code check style * fix code check style * fix datasource ut * add pg hive mysql oracle clickhouse db2 datasource * fix datasource package * update datasource pom * update datasource pom * update datasource pom * update datasource pom * update pom * update pom dep * update pom dep * fix license * fix ut * fix ut * fix ut * fix ut * fix ut * fix ut * fix ut * fix ut * fix ut * fix ut * fix ut * fix ut * fix ut * add oracle package * modify comments * conflict resolution * rename log comment * rename log comment	3 years ago

1 2

77 Commits (ca10898c53f1e7ae78806ac20a6cc078a3cf2f1a)