Software Developer & Data Engineer

About The Company WISEcode is dedicated to revolutionizing the food intelligence landscape by creating a comprehensive and trustworthy food data system. Recognizing that most individuals lack reliable information about their food and its effects, WISEcode aims to centralize and standardize fragmented food data sources. Our mission is to empower consumers, brands, and institutions with consistent, explainable, and accessible food information that supports informed decision-making. We believe that transforming scattered data into a reliable knowledge layer will enable healthier choices and foster transparency across the food industry. As a company, we prioritize innovation, rigor, and inclusivity, building systems that are scalable, dependable, and built to last.

About The Role We are seeking a talented and experienced Software Developer & Engineer to join our dynamic team as a senior individual contributor. In this role, you will serve as the second engineer working on The Pantry, our cutting-edge data lakehouse architecture. This system leverages technologies such as DuckLake on S3 Parquet, Postgres catalog, Prefect orchestration, and Python to create a unified, scalable food data platform. Your responsibilities will include designing, implementing, and maintaining core components of the data infrastructure, collaborating closely with the data team to develop robust data ingestion, processing, and resolution pipelines. This position offers a unique opportunity to shape the foundational architecture of our data ecosystem in an early-stage environment, where your contributions will directly impact the company’s growth and the broader mission of improving food transparency. The ideal candidate will thrive in a fast-paced, ambiguous setting and bring a proactive approach to problem-solving and innovation.

Qualifications

• Minimum of 3+ years of professional experience in a similar data engineering or software development role
• Proven track record of designing, building, and operating a lakehouse or data warehouse from inception, with at least one year of production experience
• Strong expertise in data identity and entity resolution as core architectural concerns
• Experience managing batch data pipelines that interact with paid cloud or third-party APIs at scale, with a focus on cost efficiency
• Proficiency in Python and SQL for data processing and pipeline development
• Hands-on experience with storage and query engines such as DuckDB, DuckLake, S3 Parquet
• Knowledge of databases including Postgres and DynamoDB for state management
• Familiarity with orchestration frameworks like Prefect, Kubernetes, Fargate, and tools such as dbt, Dagster, or Airflow
• Experience working within AWS infrastructure, including S3, ECS, Lambda, EventBridge, SNS, Terraform, and IAM
• Understanding of data modeling principles, including lakehouse architecture, analytic design, star schemas, and reporting frameworks like Quarto
• Experience with CI/CD pipelines, particularly using GitHub Actions

Responsibilities

• Own the end-to-end implementation of the lakehouse architecture, collaborating with the data team on platform and data design
• Develop and establish patterns for sourcing data from APIs, public sources, and external databases
• Implement identity and entity resolution processes to merge and maintain trustworthy product records, managing source conflicts and traceability
• Consolidate existing food enrichment pipelines into a unified, efficient pipeline in partnership with engineering
• Build reliable downstream connectors to deliver processed food data to WISE Intel and consumer applications
• Maintain strict operational discipline through configuration management, fail-fast practices, and early failure detection
• Establish data ingestion capabilities and implement quality reporting to ensure data readiness and integrity
• Document technical decisions clearly and concisely through decision records prior to code implementation
• Collaborate with cross-functional teams to continuously improve system architecture, performance, and scalability

Benefits

• Fully remote work environment with flexible scheduling
• Unlimited paid time off and 10 paid holidays annually
• Competitive compensation package including base salary, performance bonuses, and meaningful equity participation
• Comprehensive health benefits covering medical, dental, vision, life, and ancillary coverages, with 100% employer-p…