Sign In to the Console
AWS CloudFormation
User Guide (API Version 2010-05-15)

AWS Documentation » AWS CloudFormation » User Guide » Template Reference » AWS Resource and Property Types Reference » AWS Glue Resource Types Reference » AWS::Glue::Job

AWS::Glue::Job

The AWS::Glue::Job resource specifies an AWS Glue job in the data catalog. For more information, see Adding Jobs in AWS Glue and Job Structure in the AWS Glue Developer Guide.

Syntax

To declare this entity in your AWS CloudFormation template, use the following syntax:

JSON

{
  "Type" : "AWS::Glue::Job",
  "Properties" : {
    "Role" : String,
    "DefaultArguments" : JSON object,
    "Connections" : ConnectionsList,
    "MaxRetries" : Double,
    "Description" : String,
    "LogUri" : String,
    "Command" : JobCommand,
    "AllocatedCapacity" : Double,
    "ExecutionProperty" : ExecutionProperty,
    "Name" : String
  }
}

YAML

Type: AWS::Glue::Job
Properties:
  Role: String
  DefaultArguments: JSON object
  Connections: 
    ConnectionsList
  MaxRetries: Double
  Description: String
  LogUri: String
  Command: 
    JobCommand
  AllocatedCapacity: Double
  ExecutionProperty: 
    ExecutionProperty
  Name: String

Properties

Role

The role that's associated with the job.

Required: Yes

Type: String

Update requires: No interruption

DefaultArguments

UTF-8 string–to–UTF-8 string key-value pairs that specify the default parameters for the job.

You can specify arguments here that your own job-execution script consumes, as well as arguments that AWS Glue itself consumes. For information about how to specify and consume your own Job arguments, see the Passing and Accessing Python Parameters in AWS Glue in the AWS Glue Developer Guide.

Required: No

Type: JSON object

Update requires: No interruption

Connections

The connections that are used by the job.

Required: No

Type: ConnectionsList

Update requires: No interruption

MaxRetries

The maximum number of times to retry this job if it fails.

Required: No

Type: Double

Update requires: No interruption

Description

The description of the job.

Required: No

Type: String

Update requires: No interruption

LogUri

The location of the logs for the job.

Required: No

Type: String

Update requires: No interruption

Command

The code that executes a job.

Required: Yes

Type: JobCommand

Update requires: No interruption

AllocatedCapacity

The number of capacity units that are allocated to this job.

Required: No

Type: Double

Update requires: No interruption

ExecutionProperty

The execution property of the job, which specifies the maximum number of concurrent runs that are allowed for the job.

Required: No

Type: ExecutionProperty

Update requires: No interruption

Name

The name of the job. It must match the single-line string pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\t]*

Required: No

Type: String

Update requires: Replacement

Return Values

Ref

When the logical ID of this resource is provided to the Ref intrinsic function, Ref returns the resource name.

For more information about using the Ref function, see Ref.

Examples

The following example creates a job with an associated role.

JSON

{
  "Description": "AWS Glue Job Test",
  "Resources": {
    "MyJobRole": {
      "Type": "AWS::IAM::Role",
      "Properties": {
        "AssumeRolePolicyDocument": {
          "Version": "2012-10-17",
          "Statement": [
            {
              "Effect": "Allow",
              "Principal": {
                "Service": [
                  "glue.amazonaws.com"
                ]
              },
              "Action": [
                "sts:AssumeRole"
              ]
            }
          ]
        },
        "Path": "/",
        "Policies": [
          {
            "PolicyName": "root",
            "PolicyDocument": {
              "Version": "2012-10-17",
              "Statement": [
                {
                  "Effect": "Allow",
                  "Action": "*",
                  "Resource": "*"
                }
              ]
            }
          }
        ]
      }
    },
    "MyJob": {
      "Type": "AWS::Glue::Job",
      "Properties": {
        "Command": {
          "Name": "glueetl",
          "ScriptLocation": "s3://aws-glue-scripts//prod-job1"
        },
        "DefaultArguments": {
          "--job-bookmark-option": "job-bookmark-enable"
        },
        "ExecutionProperty": {
          "MaxConcurrentRuns": 2
        },
        "MaxRetries": 0,
        "Name": "cf-job1",
        "Role": {
          "Ref": "MyJobRole"
        }
      }
    }
  }
}

YAML

---
Description: "AWS Glue Job Test"
Resources:
  MyJobRole:
    Type: AWS::IAM::Role
    Properties:
      AssumeRolePolicyDocument:
        Version: "2012-10-17"
        Statement:
          -
            Effect: "Allow"
            Principal:
              Service:
                - "glue.amazonaws.com"
            Action:
              - "sts:AssumeRole"
      Path: "/"
      Policies:
        -
          PolicyName: "root"
          PolicyDocument:
            Version: "2012-10-17"
            Statement:
              -
                Effect: "Allow"
                Action: "*"
                Resource: "*"
 
  MyJob:
    Type: AWS::Glue::Job
    Properties:
      Command:
        Name: glueetl
        ScriptLocation: "s3://aws-glue-scripts//prod-job1"
      DefaultArguments:
        "--job-bookmark-option": "job-bookmark-enable"
      ExecutionProperty:
        MaxConcurrentRuns: 2
      MaxRetries: 0
      Name: cf-job1
      Role: !Ref MyJobRole