I had to gather requirements for data which was and which was not going to be considered. Since the data is housed in an Oracle database, I had to learn the relational database tables and then develop a SQL script to return the required fields and values.
Since we were working with both Oracle data and creating files, I decided to write a program in Python to accomplish the tasks.
I created python code that has functions that opens cursors in oracle and fills tuples with the information to be used in the files.
Then I created code in python that does the work of calling each of the functions-- one for the header, the body, the first trailer and then the last trailer and then filling an array.
Then I created functionality that sorts the data into the proper order and then creates the file.
To automate delivery, I integrated the code into a Docker image that runs Red Hat Linux. I then created config maps and secrets in Kubernetes for use in the code.
I then built a Kubernetes Cron job to use the image, mount the config maps and secrets and execute the code to schedule testing and delivery of the data to the customer!