Big Data Developer
- Source: Naukri
- Innova Solutions
- Hybrid
- Chennai
- Full-Time
- Mid level
Job Description
Key Responsibilities :
- Apache Spark, Hadoop, Hive, HDFS - Mandatory & Iceberg(Optional)
- SQL & NoSQL databases (Postgres, Cassandra, MongoDB, HBase) - Mandatory (at least one)
- Strong programming skills in Python, pySpark(Spark Core) & Java. - Pyspark Mandatory
- Experience with workflow orchestration tools (Airflow, Oozie).Mandatory(at least one)
- Proficiency in containerization & CI/CD (Docker, GitLab CI/CD). Mandatory (at least one)
- Good understanding of data modelling, governance, and security practices. - Mandatory
- Strong problem-solving and performance tuning skills. - Mandatory
- Hands-on with cloud platforms (Azure preferred). - Optional
- Worked on Kafka / Flink / Storm (real-time streaming) - Optional (But should have minimum knowledge on streaming pipeline).
Work Location- Hyd/Chennai
Experience:7 to 10 years
L1/ L2 ( 1 round F2F Mandatory ) followed by client round.
Skills
- Spark
- Hadoop
- apache-hadoop
- apache-iceberg
- PostgreSQL
- cassandra
- apache-cassandra
- MongoDB
- hbase
- Python
- pyspark
- Java
- Airflow
- apache-airflow
- Docker
- gitlab
- gitlab-ci
- microsoft-azure
- Kafka
