mirror of https://github.com/tektoncd/catalog.git synced 2024-11-22 06:02:51 +00:00

History

Cory Cross 28667d230d Parallelize calls to copy from/to GCS The -m flag copies from multiple threads and makes a huge performance difference for large trees.		2020-09-11 13:16:16 +01:00
..
samples	Modifies directory names based on the proposal	2020-07-14 19:01:58 +01:00
gcs-upload.yaml	Parallelize calls to copy from/to GCS	2020-09-11 13:16:16 +01:00
README.md	This patch splits gcs-upload task from the gcs directory	2020-07-13 13:41:58 +01:00

README.md

Google Cloud Storage Tasks

These Tasks are for copying to and from GCS buckets from Pipelines.

These Tasks do a similar job to the GCS PipelineResource and are intended as its replacement. This is part of our plan to offer replacement Tasks for Pipeline Resources as well as document those replacements.

`gcs-upload`

A Task that uploads files or directories from a Workspace to a GCS bucket.

Workspaces

credentials: A workspace that contains a service account key as a JSON file. This workspace should be populated from a Secret in your TaskRuns and PipelineRuns.
source: A workspace where files will be uploaded from.

Parameters

path: The path to files or directories relative to the source workspace that you'd like to upload. (required)
location: The address (including "gs://") where you'd like to upload files to. (required)
serviceAccountPath: The path to the service account credential file in your credentials workspace. (default: "service_account.json")

Usage

`gcs-upload`

This TaskRun uses the gcs-upload Task to upload a file from a ConfigMap.

kind: ConfigMap
apiVersion: v1
metadata:
  name: test-input-data
data:
  test_file.txt: "Hello, world!"
---
apiVersion: tekton.dev/v1beta1
kind: TaskRun
metadata:
  name: upload-configmap-file-to-gcs
spec:
  taskRef:
    name: gcs-upload
  workspaces:
  - name: credentials
    secret:
      secretName: my-gcs-credentials
      defaultMode: 0400
  - name: source
    configMap:
      name: test-input-data