Data Engineer with AWS, SQL, NoSQL, Teradata

Required Skills:

• Minimum 5 years of hands-on experience in Python and Shell scripting.
• At least 5 years of experience with SQL technologies (Teradata, Oracle) and NoSQL databases (MongoDB).
• Experience with AI enabled development (Cursor, CoPilot)
• Experience using Git or other version control platforms.
• Strong understanding of Agile methodologies and CI/CD pipelines.
• Experience with Jenkins for continuous integration and deployment.
• Demonstrated expertise in application performance tuning and optimization.
• Familiarity with ETL tools, preferably Ab Initio.
• Experience with Databricks and PySpark is an added advantage.
• Knowledge of AWS, Terraform, and Azure is preferred.
• Knowledge of java and design patterns is an added advantage

5+

Responsibilities

• The Data Engineer is responsible for design, develop, and maintain scalable data pipelines and applications using Python and Shell scripting.
• The delivery of a business needs starting from understanding the requirements to deploying the software into production.
• This role requires you to be fluent in some of the critical technologies with proficiency in others and have a hunger to learn on the job and add value to the business.
• Critical attributes of being a Data Engineer, among others, is ownership, eagerness to learn & an open mindset.
• In addition to Delivery, the Data Engineer should have an automation first and continuous improvement mindset.
• Resources should drive the adoption of CI/CD tools and support the improvement of the tools sets/processes. Support other product delivery partners in the successful build, test, and release of solutions
• Be part of a fast-moving team, working with the latest tools and open-source technologies
• Work on a development team using agile methodologies.
• Understand the Business and the Application Architecture End to End
• Solve problems by crafting software solutions using maintainable and modular code.
• Participate in daily team standup meetings where you’ll give and receive updates on the current backlog and challenges.
• Participate in code reviews. Ensure Code Quality and Deliverables
• Provide Impact analysis for new requirements or changes.
• In-depth knowledge of single team business domain and the ability to express or communicate technical work in business value terminology.
• Firm grasp on design disciplines and architectural patterns and aligning and influencing the fellow team members in following them.
• Mentor team members by reviewing their work, sharing technical knowledge, and fostering a collaborative and growth-oriented team environment
• Engaged in fostering and improving organizational culture.