Data Engineer
Agilisium
2022– Current
Client : Universal Music Group
Project Type : Cloud Data Integration/ ETL
Tools : Gcp, AWS cloud, Airflow, Python, Java
Period : From Feb 2022
Roles and Responsibilities:
- Involved in requirement gathering, design, built, unit testing, code review, QA, UAT and deployment.
- Developed reusable dynamic pipelines for different scenarios and suggested many features to UMG product team.
- Developed a framework to ingest the new partners into process in GCP
- Built the Dataflow pipelines based on existing informatica mappings and schedule the pipelines in Airflow.
- Loaded the historical data from different sources into Google Big Query.
- Troubleshooting the invalid mappings and optimizing the SQL query
- Designed automated report to capture the Dataflow pipelines status and Data deviations in Dataflow pipelines.
- Collaborated with peers for processes like code reviews, unit test documentation and knowledge sharing sessions
- Co-ordinate with onshore team and keep maintain the JIRA up-to date.
- Followed the agile methodology and ensured that requirement deadlines are met within time.
Technologies : Gcp, AWS cloud, Airflow, Python, Java
Cloud Engineer II
Verizon
2019 – 2022
Client: Verizon
Project Type: Panacea
Tools: PostgreSQL, New Relic, Linux, GraphQL
Period: Dec 2019 – Jan 2022
Roles and Responsibilities:
- Developed end-to-end marketing data and analytics solution including scraping, fusion, predictive modeling, deployment, reporting, and evaluation.
- Completed studies and proofs of concept for company leadership and regularly advised at that level.
- Built a hybrid statistical/NLP model for the impact of online reviews.
- Created a qualitative analysis framework to develop coding schemes for survey responses.
- Developed a predictive model for an all-in cost of delivery to a customer using years of historical data.
- Collaborated on a product-pricing model for a prototype-phase eCommerce application.
Technologies: AWS cloud, Airflow, Python, Java, PostgreSQL, New Relic, Linux, GraphQL
CloudEngineer II
Verizon
2016– 2019
Client : Verizon
Project Type : Hygieia Devops Dashboard
Tools: AWS Cloud, Angular, Java, SpringBoot, RestAPI, Linux.
Period : Dec 2016– Nov 2019
Roles and Responsibilities:
- Developed various Java microservices to fetch the data from different Sources like API,SQL Server Etc.
- Collaborated with the various DevOps teams across org to fetch data.
- Worked on Shell Scripts to perform various file operations.
- Performed DB operations in mongo DB and provided solutions
- Developed workflows that applies slowly changing dimensions.
- Involved in finding root cause and bug fixing.
- Participated in Various Outdoor forums representing the Org like Google cloud Forum, Agile Coach etc.
- Hands on experience in working with Gitlab, JIRA, Jenkins, Sonar, Ticketing and Change Request Management applications like ServiceNow.
- Involved in code review and enhancements of the jobs
- Prepared test cases and Performed Unit Tests based on business requirement.
- Experience in Performance Tuning using J meter.
Technologies: AWS Cloud, Angular, Java, SpringBoot, RestAPI, Linux.