IBM Db2 Connector for AWS Glue

Please subscribe to the product from AWS Marketplace and Activate the Glue connector from AWS Glue Studio 

What is the IBM Db2 AS400 connector for AWS Glue?

The IBM Db2 AS400 Glue Connector for AWS Glue simplifies the process of connecting AWS Glue jobs to extract data from IBM Db2, and also load data into IBM Db2. This connector provides comprehensive access to IBM Db2 data, facilitating cloud ETL processes for operational reporting, data governance, and more.

Connector options you need to set

• connectionString (required) the IBM Db2 database the full jdbc connection string along with username and password. Example connectionString: jdbc:as400://<host>;user=<username>;password=<password>
• port (optional, default is 446) the database port.
• schema (required) the schema name, consider the case sensitivity in the schema name.
• table (required) the table name you want to pull data, consider the case sensitivity in the table name.

The recommended approach to setting the connector options

Use AWS Secrets Manager can be used to store username, password and other sensitive information related to source connection.

The IAM Role you will be using in the Glue Job should contain the following policies

AWS Glue Service - To run the job. Amazon EC2 Container Registry - To access AWS Container Registry. Secrets Manager (optional) - If you use AWS Secrets Manager for connection options.

Using the IBM Db2 AS400 Connector for AWS Glue

Here are the setup steps for configuring the IBM Db2 AS400 Connector:

1. Setup IAM Role for policies and secret AWS Secrets Manager
2. Setup IBM Db2 AS400 connector and a related connection on Glue Studio console.
3. Create a job.
4. Save and run the job.

Step 1: Setup IAM Role for policies and secret AWS Secrets Manager

Create role and secret:

1. IAM Role for policies as described above.
2. Optional - Create secret in AWS Secrets Manager for the connector options described above.

Step 2: Setup IBM Db2 AS400 connector and a related connection on Glue Studio console

To set up the IBM Db2 AS400 connector and create a connection for your job:

1. Subscribe to product and activate the connector using AWS Glue Studio from the top of this instruction page.
2. Enter your connection name and choose "Create connection and active connector". You can optionally add a description, "Connection access" and "Network options". If you have created an AWS secret with the connector options you can choose your AWS secret from the dropdown under "Connection access".

Step 3: Create a job

To create a job from your connection which is created in the previous step:

1. Choose the connection and "create job".
2. Select your created connection figure on the visual canvas.
3. Add connection options and enter the necessary information.
   • Follow the earlier step (Connector options you need to set) to add the connection options
   • Or you can create an AWS secret with the connector options and attach with the connection as stated in the above step 2.1
4. Enter the job name, choose IAM Role created in step 1, and other properties in the "Job details" tab, and Choose "Save"

Step 4: Save and run the job

Run the job after filling in all parameters and creating the connector job.