DolphinScheduler

Commit Graph

Author	SHA1	Message	Date
Wenjun Ruan	b11431db95	Use single thread to refresh kerberos (#13456 )	2 years ago
Wenjun Ruan	12dd60fa46	Fix task wake up failed will block the event (#13466 )	2 years ago
Jay Chung	78e5569afd	[feat] Add type local turn on resource center by default (#13303 )	2 years ago
Tq	78ba71bdbd	[Feature][task]add azure datafactory task type (#13417 ) * init data factory * add task-type-config.yaml * add data factory ui * submit doc * submit license --------- Co-authored-by: devosend <devosend@gmail.com>	2 years ago
Wenjun Ruan	713fdbc444	Split the upgrade code (#13436 ) 1. Split the upgrade code into different version 2. Log the dml/ddl sql in origin friendly format 3. Fix ddl of 3.0.0 and 3.1.0 4. Fix search resource regular expression injection	2 years ago
qianli2022	8be32d4145	[Feature][Api] When use api to run a process we want get processInstanceId (#13184 ) * add sql * add mapper * add dao * add excutor Co-authored-by: qianl4 <qianl4@cicso.com>	2 years ago
Tq	3a6e10397f	[feature][api-datasource]add redshift auth mode to get connection by access key (#13379 ) * submit redshift auth mode * add front end * add doc and fix frontend Co-authored-by: devosend <devosend@gmail.com>	2 years ago
Wenjun Ruan	6634ff98af	Add source env list in common.properties (#13317 )	2 years ago
lenian	bcf03ad4d1	[Feature-9467] add DAMENG DataSource (#12860 ) * [Feature-9467][DataSource] add DAMENG （达梦） data source * [Feature-9467] add DM datasource doc (Issue #9467) * [Feature-9467] add DM IDataBaseOptionKeys * [Feature-9467] add DM DataSource: DmDataSourceChannelFactoryTest remove testGetDmConnection method * [Feature-9467] modification package dm to dameng; * [Feature-9467] add Dameng DmJdbcDriver18 License * [Feature-9467] add DM DataSource: remove DruidDataSourceClient Co-authored-by: lenian <yuenian@mananacare.com>	2 years ago
Aaron Wang	ccad56e88e	[Improvement][Master] Validate same content of input file when using task cache (#13298 ) * support file content checksum * fix inject null storageOperate bug	2 years ago
Wenjun Ruan	fd3afd84ad	Remove alert when delete workflow instance (#13281 )	2 years ago
Wenjun Ruan	14ec4a2398	Remove dao module in worker (#13242 )	2 years ago
Tq	f0dd4f081f	[Feature][task-plugins-12820] azure azure-sql datasource plugins (#13209 ) * submit azure sql code * change mssql-jdbc version * merge changes to delete other * merge changes to delete other * add dependencies	2 years ago
JieguangZhou	66e20271ad	[Feature][Master] Add task caching mechanism to improve the running speed of repetitive tasks (#13194 ) * Supports task instance cache operation * add task plugin cache * use SHA-256 to generate key * Update dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_mysql.sql Co-authored-by: Jay Chung <zhongjiajie955@gmail.com> * Update dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_postgresql.sql Co-authored-by: Jay Chung <zhongjiajie955@gmail.com> * Optimizing database Scripts * Optimize clear cache operation Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>	2 years ago
JieguangZhou	e4b9b67255	Allow execute task in workflow instance (#13103 )	2 years ago
Wenjun Ruan	70ccffeee2	Format task parameter as pretty json (#13173 )	2 years ago
Yann Ann	6ef74073cc	[Improve-13001]migrate commons-collections -> commons-collections4 (#13002 )	2 years ago
insist777	1064680ded	[feat][API] New restful API for workflow state (#13031 )	2 years ago
rickchengx	38b876733c	[Feature-10498] Mask the password in the log of sqoop task (#11589 )	2 years ago
insist777	b40c63f02d	[Feature][DataSource]Add trino datasource plugin (#12911 )	2 years ago
simsicon	43d69ae157	Upgrade clickhouse jdbc driver (#12639 )	2 years ago
Wenjun Ruan	ff59acd02f	Splite cpu/memory info in OSUtils#isOverload (#12663 )	2 years ago
Wenjun Ruan	9e0c9af1a5	Fix the waiting strategy cannot recovery if the serverstate is already in running (#12651 )	2 years ago
amao	b71d4983dd	[Feature-6586][Server]add some ds process definition demo when init (#11759 ) * [Feature-6586][Server]add some ds process definition demo when init 1.add some ds process definition demo when init, to display what task type can run and make user easy to use ds. 2.need configure the JVM parameters (-Ddemo=true) to turn on the StandaloneServer service 3.need modify the tenant information in it	2 years ago
Aaron Wang	08335b1032	[Improvement][Task] Improved way to collect yarn job's appIds (#12197 ) * Provide aop way as an optional way to collect yarn job's applicationId, and import new module `dolphinscheduler-aop` to place the aop code. * Add user property `appId.collect` for user to decide how to collect applicationId. * Add new environment configuration for each type of yarn tasks to support aop in `dolphinscheduler_env.sh` * Update docs to declare how to use aop way. * Update `LogUtils` to support fetch applicationId in different ways based on the user property. Co-authored-by: gabrywu <gabrywu@apache.com>	2 years ago
Wenjun Ruan	a0d37fc7ae	Set tenantDir permission (#12486 )	2 years ago
caishunfeng	dedff70f90	[Improvement] Merge spi.utils into common.utils (#12502 ) * improve JSONUtil * merge spi.utils into common.utils * split constants && remove some copy utils method * remove StringUtils	2 years ago
fuchanghai	f0a34cddec	[improvement-#12416] Use CollectionUtils.isEmpty judge the collection isEmpty to avoid NPE (#12449 )	2 years ago
Eric Gao	d46e4659d9	[Improvement][Style] Fix remaining style errors and wildcard imports (#12412 ) * Fix remaining style errors and wildcard imports * Upgrade spotless to the latest stable version, exclude .github folder from spotless check and fix dead link * Fix spotless matching scope of markdown files	2 years ago
Eric Gao	2f37da0dbc	[Improvement][Test] Block the usage of powermock and move mockito dependencies from sub-modules to root pom (#12311 ) * move mockito dependencies from sub-modules to root pom * Add check in CI to block the usage of powermock	2 years ago
Yann Ann	b357781df2	[Migrate][Test] Migrate junit4 -> junit5 test cases in common, service, and spi modules (#12363 )	2 years ago
kezhenxu94	db1d319159	Reorganize some classes in common module, remove duplicate classes (#12321 )	2 years ago
Yann Ann	17cd644506	[Fix-#11669][Workflow Instance Page] Fix the duration in Workflow Instance page. (#12264 ) * fix process duration issue * use processInstance.getState().isFinished() replace new isFinish function * add WorkflowUtils	2 years ago
Eric Gao	9ab79e064c	[Improvement][Test] Fully remove the usage of powermock from the whole project (#12244 ) * Fully remove the usage of powermock from the whole project * Upgrade org.reflections to 0.10.12	2 years ago
calvin	b4947b471c	fix this issue (#12281 )	2 years ago
Yann Ann	c87f6d89a4	[fix#12195] Change date to timestamp to support cross diff time zones (#12239 ) * fix DS support cross time zone, use timestamp replace date	2 years ago
Tq	cf5a8894e2	[BUG][BE-12113]fix htrace dependency conflicts (#12126 ) * fix htrace dependency conflicts * replace htrace-core with hbase-noop-htrace	2 years ago
Yann Ann	289e1ecdc6	[Bug] [Common] update IPv4 Pattern (#11762 ) * [Bug] [Common] IPv4 Pattern is wrong. #11758	2 years ago
rickchengx	08a4c7981f	[improve] Remove the spark version of spark task (#11860 )	2 years ago
JieguangZhou	cf522e2fc0	[improve] Optimize MLFlow task plugin for easy of use (#12071 ) optimize code	2 years ago
Eric Gao	66958b91d7	[Feature][Resource Center] Add support for Alibaba Cloud OSS as storage of resource center (#11708 ) * Add support for Alibaba Cloud OSS as storage of resource center * Add dependency licenses * Refactor code, add unit tests and related docs	2 years ago
insist777	5b384f3fab	[Feature-11473][Task]Support test task (#11670 ) * [improve] support test tasks * [improve] support test tasks * [improve] support test tasks * [improve] support test tasks * [improve] support test tasks * Update TaskExecuteThread.java * try solve e2e q * try solve e2e q * try solve e2e q * try solve e2e q * try solve e2e q * try solve e2e q * try solve e2e q * try solve e2e q * try solve e2e q * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * Update DataSource.java * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * Update messages_zh_CN.properties * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * Update messages.properties * Update messages_en_US.properties * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks	2 years ago
Wenjun Ruan	d833a28b2e	Fix cannot save processDefinition (#11931 )	2 years ago
jackfanwan	71b4087421	Example Change the regular expression of the data source password (#11459 )	2 years ago
Wenjun Ruan	9813ded981	Add debug logs for properties read from `common.properties` (#11910 )	2 years ago
LiuBodong	3ca9680b20	[Fix][Monitor]Monitor UI not show DisakAvailable and MemoryUsage correctly (#11870 )	2 years ago
Kengo Seki	3664d85143	[Improve] Upgrade Hadoop to 3.2.4 (#11832 )	2 years ago
caishunfeng	2e61c76c22	[Improvement] Add remote task model (#11767 )	2 years ago
kezhenxu94	efedc9a53c	Bump up dependencies to fix cves (#11765 )	2 years ago
xiangzihao	ebcffb04aa	fix hdfs defaultFs not working (#11823 )	2 years ago

1 2 3 4 5 ...

814 Commits (b11431db9565093a766e27dc12240a27e44f2f4c)