Senior Data Engineer & BI Developer, SEO - 27149

Position Summary: The Reporting and Analytics team within the Special Education Office (SEO) of the Division of Inclusive and Accessible Learning (DIAL) is seeking a highly skilled, multi-talented, experienced individual to manage end to end data integration, warehousing, and reporting workflows in tracking referrals, evaluations, Individualized Education Programs (IEPs, IESPs), mandated student services, and complex compliance metrics for all preschool and school age students referred for special education services in public, charter, and private school settings.

Under general supervision, with broad scope for the exercise of independent initiative and judgement, the selected candidate is responsible for the analysis, design, development, implementation, enhancement, maintenance, security and data governance of data warehouses, data marts, business intelligence systems and operational, management, regulatory reporting systems. Performs related work.

Reports to: Senior Director of MIS/Analytics, SEO

Direct Reports: There are no immediate direct reports assigned to this position. However, the candidate must be capable of adapting to future needs, including supervising developers, directing project teams, or overseeing external consultants.

Key Relationships The candidate will work closely with other offices within the division, several external constituencies, and partner with other New York City Public Schools (NYCPS) divisions/offices, including the Division of Instructional and Information Technology (DIIT), the Office of the General Counsel (OGC), Research and Policy Support Group (RPSG), and the Office of Student Enrollment (OSE).

Responsibilities Data Procurement & ETL Pipelines

• Engage with business stakeholders to gather and document requirements.
• Create conceptual, logical and physical data models, data dictionaries and capture data lineage
• Design, implement, test, deploy, debug, and document large scale Microsoft based on premise and cloud data warehouses and data marts.
• Own the end to end design, extraction, transformation, and loading (ETL) process, testing and deployment for complex large scale datasets ensuring accuracy and security.
• Ensure seamless integration of disperse enterprise NYCPSE systems, including school age and pre-school special education applications (SESIS, ATLAS, Encounter Attendance, Provider Assignment), enrollment, attendance, course scheduling, teacher certification, ensuring seamless integration of special education, enrollment, and personnel metrics.

Compliance & Legal Reporting

• Design and create complex data models and queries from scratch.
• Improve the performance and speed of existing data structures and queries.
• Construct reliable data pipelines and reporting frameworks.
• Keep data systems updated, accurate, and functional over time.
• Run data jobs and deliver reports for federal, state, and city regulations, FOIL requests, audits, and legal stipulations.

Specialized Automation

• Architect automation engines, designing scalable Python and T-SQL systems from the ground up to generate and distribute reports.
• Maintain automation engines, ensuring ongoing performance and reliability for critical data workflows.
• Distribute data insights, delivering information efficiently to key decision makers.
• Drive algorithmic assignment, programmatically managing the placement of preschool students with disabilities for reevaluation.

Enterprise BI and Analytics Delivery

• Design and deploy robust and reliable systems for data analysis.
• Design, build and deploy fast, high-performance PowerBI dashboards.
• Tailor all tools and reports for different internal and external groups.

Cloud Modernization

• Lead technical readiness for moving legacy on-premise data systems.
• Plan data migration from local SQL Server data marts to the cloud.
• Implement modern cloud environments using Microsoft Fabric.
• Define future state data schemas to support new cloud setups.

Strategic Planning and Project management

• Assist in defining roadmaps, align data systems with business goals, and data governance standards.
• Test and choose new tools, software, and AI features to keep the data stack modern and efficient.
• Coordinate and direct data management activities.
• Assist in performing project planning, feasibility studies, cost benefit analyses, impact analyses, and task prioritization.

**Qualification Requirem…