Syntax error How to use Boto3 to get the workflows that are created in your account?

How to use Boto3 to get the workflows that are created in your account?

Approach/Algorithm to solve this problem

Step 1 − Import boto3 and botocore exceptions to handle exceptions.

Step 2 − No parameter is required for this function. It will fetch all listed triggers for user account and then display metadata of each triggers.

Step 3 − Create an AWS session using boto3 library. Make sure region_name is mentioned in default profile. If it is not mentioned, then explicitly pass the region_name while creating the session.

Step 4 − Create an AWS client for glue.

Step 5 − Now use list_workflows function to get all jobs those are listed in user account.

Step 6 − Call batch_get_workflows and pass the job names fetched in previous function.

Step 7 − It returns list_of_workflows and metadata of each workflows.

Step 8 − Handle the generic exception if something went wrong while checking the job.

Example

Use the following code to fetch the details of each workflow created in the user account −

import boto3
from botocore.exceptions import ClientError

def get_resource_maetadata_of_workflows():
   session = boto3.session.Session()
   glue_client = session.client('glue')
   try:
      list_of_workflows = glue_client.list_workflows()
      response = glue_client.batch_get_workflows( Names=list_of_workflows['Workflows'])

      return list_of_workflows, response
   except ClientError as e:
      raise Exception( "boto3 client error in get_resource_maetadata_of_workflows: " + e.__str__())
   except Exception as e:
      raise Exception( "Unexpected error in get_resource_maetadata_of_workflows: " + e.__str__())

a, b = get_resource_maetadata_of_workflows()
#List of Workflows
print(a)
#Resource metadata of each Workflow
print(b)

Output

#List of Workflows
{'Workflows': ['dev-aiml-naviga-ods-load'], 'ResponseMetadata':
{'RequestId': '556890ce-bcd1-4bb0-9c33-3ae1db13f3a9', 'HTTPStatusCode':
200, 'HTTPHeaders': {'date': 'Sat, 27 Feb 2021 13:57:37 GMT', 'contenttype': 'application/x-amz-json-1.1', 'content-length': '91',
'connection': 'keep-alive', 'x-amzn-requestid': '556890ce-bcd1-4bb0-
9c33-3ae1db13f3a9'}, 'RetryAttempts': 0}}
#Resource metadata of each Workflow
{'Workflows': [{'Name': 'dev-aiml-naviga-ods-load',
'DefaultRunProperties': {}, 'CreatedOn': datetime.datetime(2020, 5, 27,
3, 10, 57, 967000, tzinfo=tzlocal()), 'LastModifiedOn':
datetime.datetime(2020, 5, 27, 3, 10, 57, 967000, tzinfo=tzlocal())},
'StartedOn': datetime.datetime(2021, 2, 3, 16, 14, 48, 795000,
tzinfo=tzlocal()), 'CompletedOn': datetime.datetime(2021, 2, 3, 16, 28,
6, 207000, tzinfo=tzlocal()), 'Status': 'COMPLETED', 'Statistics':
{'TotalActions': 3, 'TimeoutActions': 0, 'FailedActions': 0,
'StoppedActions': 0, 'SucceededActions': 3, 'RunningActions': 0}}},
'MissingWorkflows': [], 'ResponseMetadata': {'RequestId': 'b328d064-
24ab-48c4-b058-852387a3d474', 'HTTPStatusCode': 200, 'HTTPHeaders':
{'date': 'Sat, 27 Feb 2021 13:57:37 GMT', 'content-type':
'application/x-amz-json-1.1', 'content-length': '2655', 'connection':
'keep-alive', 'x-amzn-requestid': 'b328d064-24ab-48c4-b058-
852387a3d474'}, 'RetryAttempts': 0}}
Updated on: 2021-03-22T08:29:43+05:30

151 Views

Kickstart Your Career

Get certified by completing the course

Get Started
Advertisements