You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
37 lines
1.5 KiB
37 lines
1.5 KiB
2 years ago
|
.. Licensed to the Apache Software Foundation (ASF) under one
|
||
|
|
or more contributor license agreements. See the NOTICE file
|
||
|
|
distributed with this work for additional information
|
||
|
|
regarding copyright ownership. The ASF licenses this file
|
||
|
|
to you under the Apache License, Version 2.0 (the
|
||
|
|
"License"); you may not use this file except in compliance
|
||
|
|
with the License. You may obtain a copy of the License at
|
||
|
|
|
||
|
|
.. http://www.apache.org/licenses/LICENSE-2.0
|
||
|
|
|
||
|
|
.. Unless required by applicable law or agreed to in writing,
|
||
|
|
software distributed under the License is distributed on an
|
||
|
|
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
||
|
|
KIND, either express or implied. See the License for the
|
||
|
|
specific language governing permissions and limitations
|
||
|
|
under the License.
|
||
|
|
|
||
|
|
S3
|
||
|
|
==
|
||
|
|
|
||
|
|
`S3` is a Amazon S3 resource plugin for pydolphinscheduler.
|
||
|
|
|
||
|
|
When using a Amazon S3 resource plugin, you only need to add the `resource_plugin` parameter in the task subclass or workflow definition,
|
||
|
|
such as `resource_plugin=S3(prefix="xxx")`, if the file is publicly readable.
|
||
|
|
|
||
|
|
When the file is private, using `resource_plugin=S3(prefix="xxx", access_key_id="xxx", access_key_secret="xxx")`
|
||
|
|
|
||
|
|
You can view this `document <https://docs.aws.amazon.com/general/latest/gr/aws-access-keys-best-practices.html>`_
|
||
|
|
when creating a pair `AccessKey`.
|
||
|
|
|
||
|
|
For the specific use of resource plugins, you can see `How to use` in :doc:`resource-plugin`
|
||
|
|
|
||
|
|
Dive Into
|
||
|
|
---------
|
||
|
|
|
||
|
|
.. automodule:: pydolphinscheduler.resources_plugin.S3
|