AWS Data Engineer
- Source: Naukri
- Data Economy
- Hybrid
- Hyderabad
- Full-Time
- Mid level
Job Description
We are seeking a highly skilled AWS Data Engineer with strong experience in AWS Glue, EMR, and PySpark to design, develop, and optimize large-scale data processing solutions.
Key Responsibilities:
- Strong experience with AWS Glue, including Glue Jobs, Crawlers, Workflows, and Data Catalog.
- Hands-on experience with AWS EMR and Apache Spark.
- Proficiency in PySpark for large-scale data processing.
- Experience with Amazon S3, AWS IAM, CloudWatch, Lambda, and Step Functions.
- Good understanding of Spark architecture, partitioning, caching, and performance tuning.
- Experience with SQL and data warehousing concepts.
- Knowledge of data lake and modern data platform architectures.
- Experience working with relational databases such as PostgreSQL, MySQL, SQL Server, or Oracle.
- Familiarity with Git and CI/CD tools.
Skills
- amazon-web-services
- aws-glue
- amazon-emr
- Spark
- pyspark
- amazon-s3
- aws-iam
- amazon-cloudwatch
- aws-lambda
- aws-step-functions
- PostgreSQL
- mysql
- oracle
