# salt.states.boto_datapipeline

Manage Data Pipelines

Added in version 2016.3.0.

Be aware that this interacts with Amazon's services, and so may incur charges.

This module uses `boto3`, which can be installed via package, or pip.

This module accepts explicit AWS credentials but can also utilize IAM roles assigned to the instance through Instance Profiles. Dynamic credentials are then automatically obtained from AWS API and no further configuration is necessary. More information available here.

If IAM roles are not used you need to specify them either in a pillar file or in the minion's config file:

    datapipeline.keyid: GKTADJGHEIQSXMKKRBJ08H
    datapipeline.key: askdjghsdfjkghWupUjasdflkdfklgjsdfjajkghs

It's also possible to specify `key`, `keyid` and `region` via a profile, either passed in as a dict, or as a string to pull from pillars or minion config:

    myprofile:
      keyid: GKTADJGHEIQSXMKKRBJ08H
      key: askdjghsdfjkghWupUjasdflkdfklgjsdfjajkghs
      region: us-east-1

    Ensure daily data pipeline exists:
      boto_datapipeline.present:
        - name: my-datapipeline
        - pipeline_objects:
            DefaultSchedule:
              name: Every 1 day
              fields:
                period: 1 Day
                type: Schedule
                startAt: FIRST_ACTIVATION_DATE_TIME
        - parameter_values:
            myDDBTableName: my-dynamo-table

salt.states.boto_datapipeline.absent(name, region=None, key=None, keyid=None, profile=None)

  Ensure a pipeline with the service_name does not exist

  name

    Name of the service to ensure a data pipeline does not exist for.

  region

    Region to connect to.

  key

    Secret key to be used.

  keyid

    Access key to be used.

  profile

    A dict with region, key and keyid, or a pillar key (string) that contains a dict with region, key and keyid.

salt.states.boto_datapipeline.present(name, pipeline_objects=None, pipeline_objects_from_pillars='boto_datapipeline_pipeline_objects', parameter_objects=None, parameter_objects_from_pillars='boto_datapipeline_parameter_objects', parameter_values=None, parameter_values_from_pillars='boto_datapipeline_parameter_values', region=None, key=None, keyid=None, profile=None)

  Ensure the data pipeline exists with matching definition.

  name

    Name of the service to ensure a data pipeline exists for.

  pipeline_objects

    Pipeline objects to use. Will override objects read from pillars.

  pipeline_objects_from_pillars

    The pillar key to use for lookup.

  parameter_objects

    Parameter objects to use. Will override objects read from pillars.

  parameter_objects_from_pillars

    The pillar key to use for lookup.

  parameter_values

    Parameter values to use. Will override values read from pillars.

  parameter_values_from_pillars

    The pillar key to use for lookup.

  region

    Region to connect to.

  key

    Secret key to be used.

  keyid

    Access key to be used.

  profile

    A dict with region, key and keyid, or a pillar key (string) that contains a dict with region, key and keyid.