Custom Software Engineer

Project Role : Custom Software Engineer
Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs.
Must have skills : Microsoft Azure Databricks
Good to have skills : NA
Minimum 12 year(s) of experience is required
Educational Qualification : 15 years full time education

Summary:
Administer Azure Data Lake Storage Gen2: containers, directory/folder structure, lifecycle, access RBAC / POSIX ACLs, storage configuration, and blob inventory report configuration and management the basis for the ADL inventory dataset for the data hub.
Implement and maintain the ADLS security model — directory/container ACLs and the security-group model behind them. Where Entra ID access and security-group management are required, this is done in partnership with an ED&A resource to ensure the security model is implemented accurately and completely. See scope note below on tenant-level access.
Administer Azure Data Factory ADF: integration runtimes IR / Self-Hosted IR, linked services, datasets, managed identities, pipeline environment configuration, connectivity to sources/sinks, and maintaining the pipeline folder organization / governance standard.
Support Azure Databricks platform administration: workspace configuration, cluster/SQL warehouse policies, and Unity Catalog administration catalogs/schemas, grants, external locations, credentials in partnership with the Databricks lead.
Manage secrets and access: Azure Key Vault, service principals / managed identities, and RBAC/ACL provisioning for ED&A resources.
Stand up and configure data-platform resources for the Commercial environment during the foundation phase, and prepare the repeatable pattern used for Phase 2 workload migration.
Be the ED&A interface to Cloud Services / Infrastructure for provisioning, networking, and governance dependencies — translating data-team needs into clean requests and unblocking them quickly.
Implement and document platform standards, naming conventions, and operational runbooks ensure those standards are observed and followed within each owned/managed application and support cost monitoring of data-platform resources 10K/mo run-rate assumption.

Scope boundaries what this role is NOT

It is not a blanket Azure / Entra ID / tenant administrator and does not own network architecture, firewall, or cross-tenant identity/federation — those remain with the central Cloud Services and Infrastructure teams.
Entra ID / security-group access is scoped and conditional: the role needs enough access to implement and validate the data-hub security model, but tenant-wide identity administration is out of scope. Where group management cannot be granted directly, it is executed as a partnership with the responsible ED&A resource. Level of tenant access to be confirmed.
It augments ED&A it does not replace the cloud team’s platform-engineering or security responsibilities.

Required skills & experience

Hands-on administration of Azure Data Lake Storage Gen2 including ACL-based security models and blob inventory and Azure Data Factory in a production environment.
Working knowledge of Azure Databricks administration and Unity Catalog governance grants, external locations, ABAC/row-column controls a plus.
Solid grasp of Azure RBAC, ACLs, managed identities/service principals, Key Vault, and Entra ID security groups.
Comfort operating within an enterprise cloud where the tenant/network is centrally managed — i.e., getting things done through, and alongside, a central cloud team.
Strong documentation and stakeholder-coordination skills able to turn ambiguous needs into clear, prioritized requests.

Good to have
Experience with Gov Commercial or other regulated/segmented Azure migrations.
Familiarity with data classification / export-control patterns CUI / ITAR vs. commercial and how they map to Unity Catalog controls.
Power BI gateway / downstream connectivity setup.
IaC exposure Bicep / Terraform / ARM for repeatable resource deployment.
Relevant certs: Azure Administrator Associate AZ-104, Azure Data Engineer Associate DP-203, or Databricks platform-admin credentials.

Additional Information:
- The candidate should have minimum 12 years of experienc…