You can use on-demand ingestion to trigger a flow run iteration of an existing dataflow using the sources workspace in the Adobe Experience Platform user interface.
This document provides you with steps on how to create dataflows on demand for sources, as well as how to retry flow runs that have been processed or have failed.
What is a flow run?
Flow runs represent an instance of dataflow execution. For example, if a dataflow is scheduled to run hourly at 9:00 AM, 10:00 AM, and 11:00 AM, then you would have three instances of a flow run. Flow runs are specific to your particular organization.
In order to create a flow run, you must first have the flow ID of a dataflow that is scheduled for one-time ingestion.
This document requires a working understanding of the following components of Experience Platform:
Navigate to the Dataflows tab of the sources workspace. From here, find the dataflow that you want to run on demand, and then select the ellipses (...
) beside your dataflow name.
Next, select Run on-demand from the dropdown menu that appears.
Configure the schedule of your on-demand ingestion. Select the Ingestion start time, the Date range start time, and the Date range end time.
Scheduling configuration | Description |
---|---|
Ingestion start time | The scheduled time of when the on-demand flow run will begin. |
Date range start time | The earliest date and time that data will be retrieved from. |
Date range end time | The date and time that data will be retrieved up to. |
Select Schedule and allow a few moments for your on-demand dataflow to trigger.
Select your dataflow name to view your dataflow activity. Here you will see a list of your dataflow runs that have been processed. Select a dataflow run, then select Retry from the right rail to retry ingestion for a selected dataflow run iteration.
Select Scheduled to see a list of dataflow runs that are scheduled for future ingestion.
By reading this document, you have learned how to create flow runs on demand for existing sources dataflows. For more information on sources, read the sources overview