ESC
All(0)
Kestra, Open source declarative data orchestrationKestra, Open source declarative data orchestration
  • Product

    • Platform Overview
      Powerful capabilities from the UI

    • Open Source
      Explore Kestra's Core Capabilities

    • Enterprise Edition
      Security and Governance for Enterprise Needs

    • Cloud EditionPrivate Alpha
      Register for the Cloud Edition

    • Platform Overview

      Platform overview

  • Solutions

      Features

    • Declarative Orchestration
      Infrastructure as Code for All Your Workflows

    • Automation Platform
      Scheduling and Automation Made Easy

    • API-First
      Learn more about Kestra’s API features

    • Language Agnostic
      Separate your Business Logic from Orchestration Logic

    • Kestra's Terraform Provider
      Deploy and manage all Kestra resources with Terraform

      • Use Cases

    • For Data Engineers
      Orchestrate your Data Pipelines, Automate Processes, and Harness the Power of Your Data

    • For Software Engineers
      Boost Productivity, Simplify Processes, and Accelerate Microservice Deployment

    • For Platform Engineers
      Automate, Scale, Provision and Optimize Your Infrastructure

      • Industries

    • For Retail
      Empowers retail businesses with an event-driven, language-agnostic orchestration platform that scales

    • For Healthcare
      Streamline data processing, accelerate research, and enhance collaboration in healthcare

    • For Automotive
      Ensure seamless operations and optimized performance across all processes.

  • Docs
  • Plugins
  • Resources

    • Blog
      Company news, product updates, and engineering deep dives

    • Video Tutorials
      Get started with our video tutorials

    • Community Overview
      Ask any questions and share your feedback

    • Customers Stories
      Learn how Enterprises orchestrate their business-critical workflows

    • Partners
      Use our partner ecosystem to accelerate your Kestra adoption

    • FAQ
      FAQ about the product and the company

    • Platform blueprints

      Explore blueprints

    • About Us
      Read about our story and meet our team

    • Careers
      Join a remote-first company

    • Contact us
      Get in touch with us

  • Pricing
  • Star
    Talk to Us Get Started Talk to Us

Search

Ctrl + K
  • Core
    • Tasks
      • Debug
        • Echo
        • Return
      • Execution
        • Count
        • Fail
        • Labels
        • PurgeExecutions
        • Resume
      • Flow
        • AllowFailure
        • Dag
        • EachParallel
        • EachSequential
        • ForEach
        • ForEachItem
        • If
        • Parallel
        • Pause
        • Sequential
        • Sleep
        • Subflow
        • Switch
        • Template
        • WaitFor
        • WorkingDirectory
      • Http
        • Download
        • Request
      • Kv
        • Delete
        • Get
        • GetKeys
        • Set
      • Log
        • Fetch
        • Log
        • PurgeLogs
      • Namespace
        • DeleteFiles
        • DownloadFiles
        • UploadFiles
      • Output
        • OutputValues
      • State
        • Delete
        • Get
        • Set
      • Storage
        • Concat
        • DeduplicateItems
        • Delete
        • FilterItems
        • LocalFiles
        • PurgeCurrentExecutionFiles
        • Reverse
        • Size
        • Split
      • Templating
        • TemplatedTask
      • Trigger
        • Toggle
    • Triggers
      • Trigger
      • Flow
      • Schedule
      • ScheduleOnDates
      • Webhook
    • Conditions
      • DateTimeBetweenCondition
      • DayWeekCondition
      • DayWeekInMonthCondition
      • ExecutionFlowCondition
      • ExecutionLabelsCondition
      • ExecutionNamespaceCondition
      • ExecutionOutputsCondition
      • ExecutionStatusCondition
      • ExpressionCondition
      • FlowCondition
      • FlowNamespaceCondition
      • HasRetryAttemptCondition
      • MultipleCondition
      • NotCondition
      • OrCondition
      • PublicHolidayCondition
      • TimeBetweenCondition
      • WeekendCondition
    • Task Runners
      • Docker
      • Process
  • Actian Vector
    • Tasks
      • Batch
      • Queries
      • Query
    • Triggers
      • Trigger
  • Airbyte
    • Tasks
      • CloudJobs
        • Reset
        • Sync
      • Connections
        • CheckStatus
        • Sync
  • Airflow
    • Tasks
      • Dags
        • TriggerDagRun
  • Amazon Redshift
    • Tasks
      • Queries
      • Query
    • Triggers
      • Trigger
  • AMQP
    • Tasks
      • Consume
      • CreateQueue
      • DeclareExchange
      • Publish
      • QueueBind
    • Triggers
      • RealtimeTrigger
      • Trigger
  • Ansible
    • Tasks
      • Cli
        • AnsibleCLI
  • Apache Cassandra
    • Tasks
      • Astradb
        • Query
      • Standard
        • Query
    • Triggers
      • Astradb
        • Trigger
      • Standard
        • Trigger
  • Apache Druid
    • Tasks
      • Queries
      • Query
    • Triggers
      • Trigger
  • Apache Kafka
    • Tasks
      • Consume
      • Produce
    • Triggers
      • RealtimeTrigger
      • Trigger
  • Apache Pinot
    • Tasks
      • Queries
      • Query
    • Triggers
      • Trigger
  • Apache Pulsar
    • Tasks
      • Consume
      • Produce
      • Reader
    • Triggers
      • RealtimeTrigger
      • Trigger
  • Apache Spark
    • Tasks
      • JarSubmit
      • PythonSubmit
      • RSubmit
      • SparkCLI
  • Apache Tika
    • Tasks
      • Parse
  • Arrow Flight SQL
    • Tasks
      • Queries
      • Query
    • Triggers
      • Trigger
  • AS400
    • Tasks
      • Queries
      • Query
    • Triggers
      • Trigger
  • Atlassian Jira
    • Tasks
      • Issues
        • Create
        • CreateComment
        • UpdateFields
  • AWS
    • Tasks
      • Athena
        • Query
      • Auth
        • EksToken
      • Cli
        • AwsCLI
      • Dynamodb
        • DeleteItem
        • GetItem
        • PutItem
        • Query
        • Scan
      • Ecr
        • GetAuthToken
      • Eventbridge
        • PutEvents
      • Kinesis
        • PutRecords
      • Lambda
        • Invoke
      • S3
        • Copy
        • CreateBucket
        • Delete
        • DeleteList
        • Download
        • Downloads
        • List
        • Upload
      • Sns
        • Publish
      • Sqs
        • Consume
        • Publish
    • Triggers
      • S3
        • Trigger
      • Sqs
        • RealtimeTrigger
        • Trigger
  • AWS (EE)
    • Task Runners
      • Runner
        • Batch
  • Azure
    • Tasks
      • Auth
        • OauthAccessToken
      • BatchJob
        • Create
      • BatchPool
        • Resize
      • Cli
        • AzCLI
      • Datafactory
        • CreateRun
      • Eventhubs
        • Consume
        • Produce
      • Function
        • HttpFunction
      • StorageBlob
        • Copy
        • Delete
        • DeleteList
        • Download
        • Downloads
        • List
        • SharedAccess
        • Upload
      • StorageTable
        • Bulk
        • Delete
        • Get
        • List
    • Triggers
      • Eventhubs
        • RealtimeTrigger
        • Trigger
      • StorageBlob
        • Trigger
  • Azure (EE)
    • Tasks
      • BatchJob
        • Create
      • StorageBlob
        • List
        • SharedAccess
    • Task Runners
      • Runner
        • Batch
  • ClickHouse
    • Tasks
      • BulkInsert
      • ClickHouseLocalCLI
      • Queries
      • Query
    • Triggers
      • Trigger
  • CloudQuery
    • Tasks
      • CloudQueryCLI
      • Sync
  • Compression
    • Tasks
      • ArchiveCompress
      • ArchiveDecompress
      • FileCompress
      • FileDecompress
  • Couchbase
    • Tasks
      • Query
    • Triggers
      • Trigger
  • Cryptography
    • Tasks
      • Openpgp
        • Decrypt
        • Encrypt
  • Databricks
    • Tasks
      • Cluster
        • CreateCluster
        • DeleteCluster
      • Dbfs
        • Download
        • Upload
      • Job
        • CreateJob
        • SubmitRun
      • Sql
        • Query
  • Dataform
    • Tasks
      • Cli
        • DataformCLI
  • DataHub
    • Tasks
      • Ingestion
  • DB2
    • Tasks
      • Queries
      • Query
    • Triggers
      • Trigger
  • Dbt
    • Tasks
      • Cli
        • Build
        • Compile
        • DbtCLI
        • Deps
        • Freshness
        • List
        • Run
        • Seed
        • Setup
        • Snapshot
        • Test
      • Cloud
        • CheckStatus
        • TriggerRun
  • Debezium DB2
    • Tasks
      • Capture
    • Triggers
      • RealtimeTrigger
      • Trigger
  • Debezium Microsoft SQL Server
    • Tasks
      • Capture
    • Triggers
      • RealtimeTrigger
      • Trigger
  • Debezium MongoDB
    • Tasks
      • Capture
    • Triggers
      • RealtimeTrigger
      • Trigger
  • Debezium MySQL
    • Tasks
      • Capture
    • Triggers
      • RealtimeTrigger
      • Trigger
  • Debezium Oracle
    • Tasks
      • Capture
    • Triggers
      • RealtimeTrigger
      • Trigger
  • Debezium PostgreSQL
    • Tasks
      • Capture
    • Triggers
      • RealtimeTrigger
      • Trigger
  • Docker
    • Tasks
      • Build
      • Run
  • Dremio
    • Tasks
      • Queries
      • Query
    • Triggers
      • Trigger
  • DuckDB
    • Tasks
      • Queries
      • Query
    • Triggers
      • Trigger
  • Elasticsearch
    • Tasks
      • Bulk
      • Get
      • Load
      • Put
      • Request
      • Scroll
      • Search
  • File system
    • Tasks
      • Ftp
        • Delete
        • Download
        • Downloads
        • List
        • Move
        • Upload
        • Uploads
      • Ftps
        • Delete
        • Download
        • Downloads
        • List
        • Move
        • Upload
        • Uploads
      • Sftp
        • Delete
        • Download
        • Downloads
        • List
        • Move
        • Upload
        • Uploads
      • Smb
        • Delete
        • Download
        • Downloads
        • List
        • Move
        • Upload
        • Uploads
      • Ssh
        • Command
    • Triggers
      • Ftp
        • Trigger
      • Ftps
        • Trigger
      • Sftp
        • Trigger
      • Smb
        • Trigger
  • Fivetran
    • Tasks
      • Connectors
        • Sync
  • Git
    • Tasks
      • Clone
      • Push
      • PushFlows
      • PushNamespaceFiles
      • Sync
      • SyncFlows
      • SyncNamespaceFiles
  • GitHub
    • Tasks
      • Code
        • Search
      • Commits
        • Search
      • Issues
        • Comment
        • Create
        • Search
      • Pulls
        • Create
        • Search
      • Repositories
        • Search
      • Topics
        • Search
      • Users
        • Search
  • Google Cloud
    • Tasks
      • Auth
        • OauthAccessToken
      • Bigquery
        • Copy
        • CopyPartitions
        • CreateDataset
        • CreateTable
        • DeleteDataset
        • DeletePartitions
        • DeleteTable
        • ExtractToGcs
        • Load
        • LoadFromGcs
        • Query
        • StorageWrite
        • TableMetadata
        • UpdateDataset
        • UpdateTable
      • Cli
        • GCloudCLI
      • DataprocBatches
        • PySparkSubmit
        • RSparkSubmit
        • SparkSqlSubmit
        • SparkSubmit
      • DataprocClusters
        • Create
        • Delete
      • Firestore
        • Delete
        • Get
        • Query
        • Set
      • Function
        • HttpFunction
      • Gcs
        • Compose
        • Copy
        • CreateBucket
        • CreateBucketIamPolicy
        • Delete
        • DeleteBucket
        • DeleteList
        • Download
        • Downloads
        • List
        • UpdateBucket
        • Upload
      • Gke
        • ClusterMetadata
      • Pubsub
        • Consume
        • Publish
      • Vertexai
        • ChatCompletion
        • CustomJob
        • MultimodalCompletion
        • TextCompletion
    • Triggers
      • Bigquery
        • Trigger
      • Gcs
        • Trigger
      • Pubsub
        • RealtimeTrigger
        • Trigger
  • Google Cloud (EE)
    • Task Runners
      • Runner
        • Batch
        • CloudRun
  • Google Workspace
    • Tasks
      • Drive
        • Create
        • Delete
        • Download
        • Export
        • List
        • Upload
      • Sheets
        • CreateSpreadsheet
        • DeleteSpreadsheet
        • Load
        • Read
        • ReadRange
  • Grok
    • Tasks
      • FormGrok
        • TransformItems
        • TransformValue
  • Groovy
    • Tasks
      • Eval
      • FileTransform
  • Hightouch
    • Tasks
      • Sync
  • Hubspot
    • Tasks
      • Tickets
        • Create
  • JBang
    • Tasks
      • Commands
      • Script
  • JSONata
    • Tasks
      • FormJsonata
        • TransformItems
        • TransformValue
  • Julia
    • Tasks
      • Commands
      • Script
  • Jython
    • Tasks
      • Eval
      • FileTransform
  • Kubernetes
    • Tasks
      • PodCreate
      • Kubectl
        • Apply
  • Kubernetes (EE)
    • Task Runners
      • Runner
        • Kubernetes
  • LDAP
    • Tasks
      • Add
      • Delete
      • IonToLdif
      • LdifToIon
      • Modify
      • Search
  • Linear
    • Tasks
      • Issues
        • Create
  • Malloy CLI
    • Tasks
      • CLI
  • Meilisearch
    • Tasks
      • DocumentAdd
      • DocumentGet
      • FacetSearch
      • Search
  • Microsoft SQL Server
    • Tasks
      • Batch
      • Queries
      • Query
    • Triggers
      • Trigger
  • MinIO
    • Tasks
      • Copy
      • CreateBucket
      • Delete
      • DeleteList
      • Download
      • Downloads
      • List
      • Upload
    • Triggers
      • Trigger
  • Modal
    • Tasks
      • Cli
        • ModalCLI
  • MongoDB
    • Tasks
      • Bulk
      • Delete
      • Find
      • InsertOne
      • Load
      • Update
    • Triggers
      • Trigger
  • MQTT
    • Tasks
      • Publish
      • Subscribe
    • Triggers
      • RealtimeTrigger
      • Trigger
  • MySQL
    • Tasks
      • Batch
      • Queries
      • Query
    • Triggers
      • Trigger
  • Nashorn
    • Tasks
      • Eval
      • FileTransform
  • NATS
    • Tasks
      • Consume
      • Produce
      • Kv
        • CreateBucket
        • Delete
        • Get
        • Put
    • Triggers
      • RealtimeTrigger
      • Trigger
  • Neo4j
    • Tasks
      • Batch
      • Query
  • Node
    • Tasks
      • Scripts
        • Node
      • Commands
      • Script
  • Notifications
    • Tasks
      • Discord
        • DiscordExecution
        • DiscordIncomingWebhook
      • Google
        • GoogleChatExecution
        • GoogleChatIncomingWebhook
      • Mail
        • MailExecution
        • MailSend
      • Opsgenie
        • OpsgenieAlert
        • OpsgenieExecution
      • Pagerduty
        • PagerDutyAlert
        • PagerDutyExecution
      • Sendgrid
        • SendGridMailExecution
        • SendGridMailSend
      • Sentry
        • SentryAlert
        • SentryExecution
      • Slack
        • SlackExecution
        • SlackIncomingWebhook
      • Teams
        • TeamsExecution
        • TeamsIncomingWebhook
      • Telegram
        • TelegramExecution
        • TelegramSend
      • Twilio
        • TwilioAlert
        • TwilioExecution
      • Whatsapp
        • WhatsAppExecution
        • WhatsAppIncomingWebhook
      • Zenduty
        • ZendutyAlert
        • ZendutyExecution
      • Zulip
        • ZulipExecution
        • ZulipIncomingWebhook
  • OpenAI
    • Tasks
      • ChatCompletion
      • CreateImage
  • Oracle
    • Tasks
      • Batch
      • Queries
      • Query
    • Triggers
      • Trigger
  • PostgreSQL
    • Tasks
      • Batch
      • CopyIn
      • CopyOut
      • Queries
      • Query
    • Triggers
      • Trigger
  • Power BI
    • Tasks
      • RefreshGroupDataset
  • PowerShell
    • Tasks
      • Commands
      • Script
  • Python
    • Tasks
      • Scripts
        • Python
      • Commands
      • Script
  • Redis
    • Tasks
      • List
        • ListPop
        • ListPush
      • Pubsub
        • Publish
      • String
        • Delete
        • Get
        • Set
    • Triggers
      • List
        • RealtimeTrigger
        • Trigger
  • Rockset
    • Tasks
      • Query
    • Triggers
      • Trigger
  • RScript
    • Tasks
      • Commands
      • Script
  • Ruby
    • Tasks
      • Commands
      • Script
  • Serialization
    • Tasks
      • Avro
        • AvroToIon
        • IonToAvro
      • Csv
        • CsvToIon
        • IonToCsv
      • Excel
        • ExcelToIon
        • IonToExcel
      • Json
        • IonToJson
        • JsonToIon
      • Parquet
        • IonToParquet
        • ParquetToIon
      • Xml
        • IonToXml
        • XmlToIon
  • ServiceNow
    • Tasks
      • Post
  • Shell
    • Tasks
      • Scripts
        • Bash
      • Commands
      • Script
  • Singer
    • Tasks
      • Taps
        • BigQuery
        • BingAds
        • ChargeBee
        • ExchangeRateHost
        • FacebookAds
        • Fastly
        • GenericTap
        • GitHub
        • Gitlab
        • GoogleAdwords
        • GoogleAnalytics
        • GoogleSearchConsole
        • HubSpot
        • Marketo
        • Netsuite
        • PipelinewiseMongoDb
        • PipelinewiseMysql
        • PipelinewiseOracle
        • PipelinewisePostgres
        • PipelinewiseSqlServer
        • Quickbooks
        • Recharge
        • SageIntacct
        • Salesforce
        • Shopify
        • Slack
        • Stripe
        • Zendesk
        • Zoom
      • Targets
        • AdswerveBigQuery
        • Csv
        • DatamillCoPostgres
        • GenericTarget
        • Json
        • MeltanoSnowflake
        • Oracle
        • PipelinewisePostgres
        • PipelinewiseRedshift
        • PipelinewiseSnowflake
        • SqlServer
  • Snowflake
    • Tasks
      • Download
      • Queries
      • Query
      • Upload
    • Triggers
      • Trigger
  • Soda
    • Tasks
      • Scan
  • Solace
    • Tasks
      • Consume
      • Produce
    • Triggers
      • Trigger
  • SQLite
    • Tasks
      • Queries
      • Query
    • Triggers
      • Trigger
  • SQLMesh
    • Tasks
      • Cli
        • SQLMeshCLI
  • SurrealDB
    • Tasks
      • Query
    • Triggers
      • Trigger
  • Sybase
    • Tasks
      • Queries
      • Query
    • Triggers
      • Trigger
  • Template
    • Tasks
        • Bulk
        • Get
        • Load
        • Put
        • Request
        • Scroll
        • Search
  • Terraform
    • Tasks
      • Cli
        • TerraformCLI
  • Trino
    • Tasks
      • Query
    • Triggers
      • Trigger
  • Vertica
    • Tasks
      • Batch
      • Queries
      • Query
    • Triggers
      • Trigger
  • Weaviate
    • Tasks
      • BatchCreate
      • Delete
      • Query
      • SchemaCreate
  • Zendesk
    • Tasks
      • Tickets
        • Create
PluginsDataHub

DataHub​Data​Hub

Table of Contents
  • DataHub
    • Tasks
Contribute
  • Join us on Slack
  • YouTube
  • GitHub
  • Twitter
  • LinkedIn

DataHub

Plugin DataHub for Kestra

DataHub

This sub-group of plugins contains tasks for interacting with DataHub.

Tasks

  • Ingestion

Was this page helpful?

Kestra's logo

Open Source Declarative Data Orchestration

Product
  • Platform Overview
  • Open Source
  • Enterprise Edition
  • Kestra Cloud
  • Pricing
Solutions
  • Use Cases
  • Declarative Orchestration
  • Automation Platform
  • API First
  • Code in Any Language
  • Terraform Provider
  • Airflow vs Kestra
  • Prefect vs Kestra
  • Dagster vs Kestra
Community
  • Community Overview
  • Blog
  • Write for Us
  • Slack
  • GitHub
Docs
  • Documentation
  • Plugins
  • Blueprints
  • Getting Started
  • Administrator Guide
  • FAQ
Company
  • About Us
  • Careers Hiring!
  • Contact Us
  • Customer Stories
  • Partners Ecosystem

© 2024 Kestra Technologies. Developed with on 🌎.

Privacy Policy / Cookie Policy

Slack