Consumption Analytics Documentation

Home > Documentation for older versions > Cloud Cruiser 4 > Collecting, transforming, and publishing > ETL process overview

ETL process overview

Table of contents
No headers

This article explains the general process for collecting data from cloud management platforms and other sources, transforming and enriching it with financial information according to your business rules, and publishing it to the Cloud Cruiser database where you can use it to bill your customers and to gain insights into your business. Most of these steps happen in a workbook, a centralized place for collecting and processing related data. To understand workbooks, see ETL workbooks.

This process applies to all collectors and data sources.

To collect, transform, and publish data

  1. Create a workbook.
    See Creating workbooks.
  2. Create and configure a collection in the workbook.
    See Creating collections.
  3. Configure the transformation of data from your collection using steps in a flow.
    See Working with flows.
  4. Configure the publishing of this flow.
    See Publishing data to a schema.
  5. Test your collections and flows by running them for one or more select dates.
    If any incorrect data was published during your testing, delete those loads before continuing.
  6. Schedule your collections and flows to run regularly, starting when the next day's complete data is available.
    See Scheduling jobs to run.
  7. Collect and publish past data to "catch up."
    Run your collections and flows for a range of dates starting with the earliest available data and ending with the most recent complete day of data.

To help you navigate the articles in this process, this clickable map appears at the top of each article:

Last modified



This page has no classifications.

 (c) Copyright 2017-2020 Hewlett Packard Enterprise Development LP