Sr Consultant (Data Quality & Validation Engineer-Databricks/AWS)
- Source: LinkedIn
- Genius Business Solutions (GBSI)
- On-site
- New York City
- Full-Time
- Senior
Job Description
About Genius Business Solutions Inc. (GBSI) Featured in CNBC, Digital Journal, Fox News, and CIO Review, GBSI is a globally recognized IT services leader with 20+ years serving Fortune 500 organizations. Our teams deliver solutions across automotive, manufacturing, retail, and pharmaceutical industries. Headquartered in Moline, IL, GBSI supports clients and consultants throughout the US, Canada, Europe, and India. Join our innovative team to lead enterprise-grade SAP solutions and drive digital transformation initiatives across global enterprises. Job Summary We are seeking a Data Quality Engineer to design and execute test strategies for data projects on Databricks, AWS, and Delta Sharing platforms. The role involves validating ingestion pipelines, transformations, and Medallion Architecture layers, ensuring secure data access with Unity Catalog and RBAC. Candidates will build automated testing frameworks, collaborate with cross-functional teams, and support release planning while driving data governance and quality initiatives across the Databricks ecosystem.
Mandatory Skills
- Databricks
- AWS
- Delta Sharing
Key Responsibilities
- Develop and execute test plans, test cases, and validation strategies for data projects built on Databricks, AWS, and Delta Sharing platforms.
- Validate data ingestion pipelines, data transformations, and Medallion Architecture layers to ensure data quality, accuracy, completeness, and performance.
- Create and maintain automated data testing frameworks using SQL and automation tools to support repeatable regression testing.
- Test and verify Delta Sharing, Unity Catalog, role-based access controls, and data security mechanisms to ensure secure data access and governance.
- Collaborate with Development, Product Owners, and Data Engineering teams to identify defects, track quality metrics, and resolve testing issues.
- Support release planning, deployment validation, and production deployments while providing clear communication on testing status, risks, and issues.
- Contribute to data governance and quality initiatives, including data catalog migration, DQ framework adoption, and testing best practices across the Databricks ecosystem.
Equal Employment Opportunity GeniusBSI is an Equal Opportunity Employer. We believe that no one should be discriminated against because of their differences, such as age, disability, ethnicity, gender, gender identity and expression, religion, or sexual orientation. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status, or any other basis as protected by federal, state, or local law.
Skills
- azure-databricks
- databricks
- amazon-web-services
- sap
- unity-3d
You missed this one - but you don't have to keep missing out. Try Club members get matched with open opportunities before they're gone, so you're always first in line, never last.
