PySpark Developer with AWS
- Source: Naukri
- Tata Consultancy Services
- On-site
- Bengaluru
- Full-Time
- Mid level
Job Description
a { text-decoration: none; color: #464feb; } tr th, tr td { border: 1px solid #e6e6e6; } tr th { background-color: #f5f5f5; }
PySpark Developer with AWS
Experience: 810 Years
Locations: Hyderabad / Bangalore / Kolkata
Primary Skill: PySpark
Mandatory Skill: AWS
Job Summary:
We are looking for an experienced PySpark Developer with strong AWS expertise to design, develop, and optimize scalable data-processing solutions. The candidate should have strong hands-on experience in PySpark, Python, Spark, SQL, ETL/data pipelines, and AWS cloud services.
AWS experience is mandatory for this position.
Mandatory Skills
- PySpark
- AWS – Mandatory
- Apache Spark
- Python
- SQL
- ETL / Data Engineering
- Data Pipelines
- Big Data Processing
- AWS services such as S3, Glue, EMR, Lambda, Redshift, IAM and CloudWatch
Key Responsibilities
- Develop and maintain large-scale data processing applications using PySpark.
- Build scalable ETL/ELT data pipelines.
- Work with AWS cloud services for data engineering workloads.
- Write and optimize complex SQL queries.
- Optimize PySpark/Spark jobs for performance and scalability.
- Troubleshoot data pipeline and data quality issues.
- Collaborate with data architects and engineering teams.
Skills
- pyspark
- amazon-web-services
- Spark
- Python
- processing-js
- amazon-s3
- aws-glue
- amazon-emr
- aws-lambda
- amazon-redshift
- aws-iam
- amazon-cloudwatch
