Software Engineer_Social Media Data & AI Feeds

Job Description

We are looking for a Mid-Level Software Engineer with strong experience in Python, REST API integration, ETL/data pipelines, and Machine Learning/AI technologies. The role involves building reliable data ingestion and processing pipelines for social media data and integrating AI/LLM-based capabilities into data workflows.

Key Responsibilities

• Develop and maintain Python-based applications and data pipelines.
• Integrate and consume REST APIs, including handling authentication, pagination, rate limits, retries, backoff, and caching.
• Work with LLM APIs, embeddings, and AI-assisted development.
• Design and implement ETL/data processing pipelines for large volumes of data.
• Implement staged filtering and data processing workflows.
• Work with SQL and databases such as PostgreSQL and Snowflake.
• Process and manage data in formats such as Parquet and JSON.
• Develop and manage workflow orchestration using Airflow or cron.
• Containerize applications using Docker.
• Work with AWS or Azure cloud environments.
• Write clean, maintainable, and testable code.
• Collaborate with cross-functional teams to understand data and AI requirements.
• Troubleshoot API, data pipeline, and application-level issues.

Preffered Candidate Profile

• 4 - 6 years of relevant software engineering experience.
• Strong hands-on experience in Python and API-based integrations.
• Experience building or maintaining data pipelines/ETL workflows.
• Exposure to AI/ML or LLM-based applications.
• Comfortable working with cloud and containerized environments.
• Ability to independently troubleshoot technical issues and deliver solutions.