Senior Software Engineer-ETL Developer, Informatica, python

Company Profile:
Founded in 1976, CGI is among the largest independent IT and business consulting services firms in the world. With 94,000 consultants and professionals across the globe, CGI delivers an end-to-end portfolio of capabilities, from strategic IT and business consulting to systems integration, managed IT and business process services and intellectual property solutions. CGI works with clients through a local relationship model complemented by a global delivery network that helps clients digitally transform their organizations and accelerate results. CGI Fiscal 2024 reported revenue is CA$14.68 billion and CGI shares are listed on the TSX (GIB.A) and the NYSE (GIB). Learn more at cgi.com.
Job Title: Senior ETL developer
Position: Senior Software Engineer
Experience: 5- 7 Years
Category: Senior Software Engineer
Shift: 10am – 7pm
Main location: Client Office, Bangalore
Position ID: J0626-1828
Employment Type: Full Time
Education Qualification: Master’s degree

Position Description

An ETL developer works with data by collecting it from multiple databases, applications, or external sources, then organizing and preparing it before loading it into systems where it can be used effectively. The ETL developer plays a key role in keeping data clean, structured, and reliable for analysis. By building and managing data pipelines, ETL developers support reporting, analytics, and business intelligence efforts, helping organizations make smart, data-driven decisions

Your future duties and responsibilities

Your future duties and responsibilities
1.Data Pipeline Architecture Development: ETL Developers determine how data flows from the various source systems to their intended target (such as a data warehouse). An ETL developer sets the proper flow, identifies the appropriate tools, and outlines the method to ensure an effective process.
2.Writing SQL Queries for Extraction: ETL developers write SQL queries to extract the desired data from each database. These queries can be complex or simple, depending on how the data is stored in the source system.
3.Transforming Data Using Business Rules: Typically, raw data is not readily accessible for those who use it. ETL Developers transform data by cleaning, filtering, and shaping the data to meet the business’s rules and needs (such as transforming dates or calculating totals).
4.ETL Packages Designed for Future Use: ETL Developers create tools and templates that can be reused for similar ETL tasks, rather than rewriting the entire program from scratch each time. This makes the ETL Developer’s job easier and saves companies’ time.
5.Data Quality Checks and Validations: ETL Developers ensure the data is accurate, complete, with no duplicates, etc. They implement rules that can identify potential errors and address those errors before using the data.
6.Working with data analysts and architects: ETL Developers work closely with data analysts and architects to determine what data is needed, how it will be used, and how the data will be structured.
7.Applying data security processes: ETL developers secure sensitive data by using encryption, implementing access control, or by legal data protection processes.
8.Bug fixing and improving existing workflows: Whenever something goes wrong with the data processing, they will find the errors and fix them. They will also attempt to improve the workflow so that it runs quickly and is more efficient.
9.Managing job scheduling and automation: They will set the ETL to run automatically, usually at scheduled times (e.g., daily), using common ETL tools that have job schedulers, cron jobs, and/or orchestration.
10.Maintaining logs of all data operations for audit preparation: ETL developers keep a record of every data movement/change in logs, which is helpful in problem-solving, auditing, and understanding modifications to the ETL workflows.

Required qualifications to be successful in this role

Required qualifications to be successful in this role
Must Have Skill

Python, PySpark, SQL, Informatica, Data Warehousing,

Good to have skill

Azure, ADF, Power BI Knowledge

Together, as owners, let’s turn meaningful insights into action.

Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because…

You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s why we call oursel…