End-of-life for full processing data sources

Full processing data sources have historically enabled organizations to submit hit-level data to Adobe Analytics. This data was processed in the same way as data collected through traditional data collection means, such as AppMeasurement. In 2020, Adobe released the Bulk data insertion API, which performs the same functions as full processing data sources, but with additional features. This page provides details about additional functionality provided by the Bulk data insertion API and outlines differences in file formats.

On 25 March 2021, Adobe prevented new full processing data sources connections from being created. On 31 January 2022, all full processing data services were deactivated.

Key differences between full processing data sources and the Bulk data insertion API

• Bulk data insertion allows you to submit multiple files for parallel processing. Visitor Groups ensure visitor continuity and eVar attribution.
• Bulk data insertion has data validation and error handling capabilities, removing some of the administrative work of submitting hit data.
• Bulk data insertion supports multiple visitor ID identification methods.
• Bulk data insertion has some additional required fields: A visitor identification column, a pageName (or link equivalent), reportSuiteID, timestamp, and userAgent.
• To ensure visitor continuity and attribution, Bulk data insertion requires rows within files to be sorted in chronological order. See Visitor Groups to learn about the ordering of Visitor activity across files.
• Bulk data insertion requires files to be .csv compressed in .gzip format.
• BDIA uses timestamp instead of date.

Variable comparison between BDIA and full processing data sources

The following variables were introduced to Bulk data insertion, previously unavailable in full processing data sources:

• aamlh: Adobe Audience Manager location hint.
• contextData.key: Context data variables.
• customerID: Experience Cloud ID service variables. Includes id, authState, and isMCSeed.
• hints: Client hint variables. Includes bitness, brands, mobile, model, platform, platformversion, and wow64.
• ipaddress: The visitor’s IP address.
• language: The Language dimension.
• list1 - list3: List variables.
• marketingCloudVisitorID: The visitor’s Experience Cloud ID.
• tnta: Target data payload used in Analytics for Target integrations.
• trackingServer: The trackingServer variable.
• transactionID: The transactionID variable.
• userAgent: The device’s user agent string.

The following variables are not supported through Bulk data insertion:

• charSet: The charSet variable. Bulk data insertion only supports UTF-8.
• timezone: The visitor’s time zone offset from GMT in hours.
• clickAction, clickActionType, clickContext, clickContextType, clickSourceID, clickTag: Variables used in Activity Map data collection.