Senior Data and AI Engineer Databricks

Company Description Smart Tech LLC is a Kansas-based technology firm and certified Databricks and Snowflake partner founded in 2024. The company builds AI-driven data platforms, secure software, and advanced analytics solutions for organizations across industries. Its team of engineers, scientists, and architects focuses on cloud-native architectures, automation, and agentic AI to address complex business problems. Smart Tech LLC supports clients in scaling their data capabilities, improving decision-making, and adapting quickly to changing market demands.

Role Description This is a remote contract role for a Senior Data and AI Engineer (Databricks). The individual in this role will design, build, and optimize data pipelines and lakehouse architectures on Databricks, integrating with Snowflake and other cloud services as needed. Day-to-day responsibilities include developing scalable ETL/ELT workflows, implementing data quality and governance controls, and collaborating with data scientists and architects to productionize machine learning and AI solutions. The role also involves performance tuning, cost optimization, and creating reusable components and frameworks that support automation and agentic AI use cases. The Senior Data and AI Engineer will engage with stakeholders to translate business requirements into technical designs and provide guidance on best practices in modern data and AI engineering.

Qualifications

• Strong experience with Databricks (Spark, LakeFlow, Agent bricks,, Lakebase, Genie, Unity Catalog, Unity Gateway, Delta Lake, Iceberg, notebooks, jobs) and modern data lakehouse architectures.
• Proficiency in Python or Scala for data engineering, along with SQL for analytics and data transformations.
• Hands-on expertise with cloud platforms (such as AWS, Azure, or GCP) and related data services and security practices.
• Experience designing and implementing ETL/ELT pipelines, data modeling, and data quality frameworks.
• String experience in building and deploying machine learning and AI solutions in production, preferably in collaboration with data science teams.
• Familiarity with Snowflake or similar cloud data warehouses is strongly preferred.
• Ability to work independently in a remote environment, manage multiple priorities, and communicate clearly with technical and non-technical stakeholders.
• Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related field, or equivalent practical experience.
• Experience in consulting or working with external clients on data and AI projects is a plus.
• Please apply only if you are a US Green Card Holder or a US Citizen.