File Transmission Project
File Transmission Project
Embedded Files
Take data submitted through a web interface for Retirement Plan contributions and build a file in a fixed-width format to send to a vendor.
Take data submitted through a web interface for Retirement Plan contributions and build a file in a fixed-width format to send to a vendor.
I was tasked with taking specific information for about 16,000 plans and nearly 600,000 people for their retirement plan contributions and turn them into a file using a custom fixed-width format to import into a successor record-keeping system. Each plan contribution had to have a header record, body records for each contribution, and then an aggregated summary trailer record for the data transmission type, and then a summary trailer record for each transmission type.
I was tasked with taking specific information for about 16,000 plans and nearly 600,000 people for their retirement plan contributions and turn them into a file using a custom fixed-width format to import into a successor record-keeping system. Each plan contribution had to have a header record, body records for each contribution, and then an aggregated summary trailer record for the data transmission type, and then a summary trailer record for each transmission type.
I had to gather requirements for data which was and which was not going to be considered. Since the data is housed in an Oracle database, I had to learn the relational database tables and then develop a SQL script to return the required fields and values.
Since we were working with both Oracle data and creating files, I decided to write a program in Python to accomplish the tasks.
I created python code that has functions that opens cursors in oracle and fills tuples with the information to be used in the files.
Then I created code in python that does the work of calling each of the functions-- one for the header, the body, the first trailer and then the last trailer and then filling an array.
Then I created functionality that sorts the data into the proper order and then creates the file.
To automate delivery, I integrated the code into a Docker image that runs Red Hat Linux. I then created config maps and secrets in Kubernetes for use in the code.
I then built a Kubernetes Cron job to use the image, mount the config maps and secrets and execute the code to schedule testing and delivery of the data to the customer!
I worked as a Requirements Analyst, and then the lead software engineer on this project. I worked with a business process consultant to gather data requirements from the vendor as well as what specific contributions they would like to be transferred to the vendor. We were able to successfully get the file built under the original estimated time of work.
I worked as a Requirements Analyst, and then the lead software engineer on this project. I worked with a business process consultant to gather data requirements from the vendor as well as what specific contributions they would like to be transferred to the vendor. We were able to successfully get the file built under the original estimated time of work.
Page updated
Google Sites
Report abuse