Pipedream serves as a robust integration platform tailored specifically for software developers.

We offer a complimentary, managed environment designed for architecting event-driven automation and linking disparate applications. This ecosystem boasts more than 1,000 pre-configured application connectors, enabling rapid deployment of functionalities such as dispatching notifications to Slack or inserting records into Google Sheets using ready-made modules. Furthermore, users retain the flexibility to execute arbitrary code written in Node.js, Python, Golang, or Bash when bespoke logic is required. Pipedream maintains SOC 2 compliance, and the Type 2 report is obtainable upon formalized request via support@pipedream.com.

This repository furnishes:

The source code for all readily available integration components
The official product development roadmap
The comprehensive Pipedream documentation suite
Various other source artifacts pertaining to the Pipedream service.

This README provides an overview of the platform's core capabilities and guides for initial setup.

For technical assistance, kindly navigate to https://pipedream.com/support.

Core Capabilities

Workflows - These define automation sequences. A workflow consists of discrete steps—either leveraging pre-built actions or executing custom code in Node.js, Python, Golang, or Bash—all initiated by a triggering event (e.g., an HTTP invocation, a scheduled timer, or a new entry in a connected service like Google Sheets).
Event Sources - These components initiate workflows by emitting data events originating from external services such as GitHub, Slack, Airtable, RSS feeds, and many others. If a third-party service generates data you wish to act upon, an event source is employed.
Actions - These are encapsulated, pre-written code units designed for executing conventional operations across Pipedream's extensive library of over 1,000 API integrations. Examples include dispatching electronic mail or programmatically updating rows within Google Sheets.
Custom Code Execution - When intricate logic is mandated, custom scripting provides the optimal solution. Pipedream facilitates the execution of virtually any Node.js, Python, Golang, or Bash code within a workflow. You can readily import external packages via respective language package managers, interact with any Pipedream-integrated application, and more. Pipedream embodies "low-code" principles advantageously: routine tasks utilize standardized modules, while complex requirements are addressed via expressive custom scripting.
Destinations - These abstract the complexities of asynchronous data transmission, facilitating the routing of events to common endpoints such as Amazon S3 storage, Snowflake data warehousing, arbitrary HTTP endpoints, or email.
Pricing Model - The platform features a highly accommodating tier for individual developers (refer to limits for specifics), ensuring no initial expenditure.

Demonstration

Access a concise video demonstration via YouTube by clicking the image below.

Workflows in Detail

Workflows represent a series of sequential operations, or steps, triggered by an initiating event (e.g., an incoming HTTP payload or a new record in a spreadsheet). Users can rapidly engineer sophisticated automation sequences by assembling workflows and integrating with the 1,000+ supported applications.

Review our workflow quickstart guide to begin building.

Event Sources Explained

Event Sources actively monitor services such as GitHub, Slack, Airtable, or RSS feeds for novel data occurrences. Upon detection of a relevant event, the source emits a signal that activates any associated workflows.

You also possess the capability to ingest events emitted by sources directly through Pipedream's REST API or a dedicated, low-latency SSE stream.

Should a suitable pre-built source not exist, you are empowered to construct your own. The simplest custom event source exposes an HTTP endpoint designed to accept any incoming request and log its contents upon execution:

javascript export default { name: "http", version: "0.0.1", props: { http: "$.interface.http", }, run(event) { console.log(event); // event contains the method, payload, etc. }, };

The codebase for all standard event sources resides within the components directory. For defect reporting or feature contribution, consult our contribution guidelines.

Actions Detail

Actions function as modular, pre-written execution steps within a workflow, facilitating standard operations across Pipedream's expansive catalog of over 500 integrated APIs. For instance, they can be used to dispatch emails or append data to a Google Sheet, among other capabilities.

Users can author custom actions for internal reuse across multiple workflows, or elect to publish them to the wider Pipedream community for collective benefit.

This example action accepts a 'name' input and outputs it to the workflow execution log:

javascript export default { name: "Action Demo", description: "This is a demo action", key: "action_demo", version: "0.0.1", type: "action", props: { name: { type: "string", label: "Name", }, }, async run() { return hello ${this.name}!; }, };

All official action code is located in the components directory. Refer to our contribution process documentation for reporting issues or submitting enhancements.

Extensibility via Custom Code

Complex integration scenarios frequently necessitate bespoke logic. Pipedream supports embedding custom code execution directly into workflows using the following runtimes:

You can pull in any dependency from the language's standard package manager simply by declaring the import statements directly within your script; Pipedream handles the dependency resolution and downloading.

javascript // Node.js import axios from "axios";

python

Python

import pandas as pd

golang // Go import ( "fmt" pd "github.com/PipedreamHQ/pipedream-go" )

Furthermore, custom code steps permit seamless interaction with any configured Pipedream application credentials. For example, authenticating with Slack to post a message:

javascript import { WebClient } from "@slack/web-api";

export default defineComponent({ props: { // Establishes an app connection reference named "slack". slack: { type: "app", app: "slack", }, }, async run({ steps, $ }) { const web = new WebClient(this.slack.$auth.oauth_access_token);

return await web.chat.postMessage({
  text: "Hello, world!",
  channel: "#general",
});

}, });

Data Delivery Destinations

Destinations, analogous to Actions, abstract away the complex logic associated with connection management, data batching, and reliable transmission to external systems like Amazon S3 or custom HTTP endpoints.

For instance, sending data securely to an Amazon S3 bucket is achieved via a straightforward function call, $send.s3():

javascript $send.s3({ bucket: "your-bucket-here", prefix: "your-prefix/", payload: event.body, });

Pipedream currently furnishes integrations for the following delivery targets:

Contributors

Our sincere gratitude to every individual who has enhanced the Pipedream source repository. Your contributions are highly valued!

Financial Structure

Pipedream offers a robust complimentary tier. Users can execute workflows and sources without charge, provided they remain within the specified free-tier operational constraints. Should these limits be exceeded, users may transition to one of our subscription-based tiers.

Operational Constraints

The Pipedream execution environment imposes certain runtime limitations on both sources and workflows. Detailed information regarding these constraints is available in our official documentation.

Reporting Defects or Suggesting Enhancements

Before submitting a new issue, please thoroughly search the existing issue tracker or contact our support team to confirm if a similar request has already been documented.

If a matching issue is found, we request that you either add a supportive reaction or post a comment elaborating on your unique scenario.

If no prior record exists, please utilize the defined issue templates when filing a new report.

Security Posture

Information regarding our platform's security protocols and data privacy standards can be accessed via this document.

To confidentially disclose a potential vulnerability or security concern, or for any security-related inquiries, please communicate directly with our dedicated security team at security@pipedream.com.