Data Engineer-Data Platforms-AWS
You will work as a Data Engineer specializing in Data Platforms on AWS, advising on, developing, and maintaining data engineering solutions within the AWS Cloud ecosystem. Your core responsibilities include designing, building, and operating both batch and real-time data pipelines using AWS services such as EMR, Glue, Glue Catalog, and Kinesis. You will create and manage data layers on AWS RedShift, Aurora, and DynamoDB, and handle data migrations using AWS DMS. The role also involves developing pipelines for Data Warehouse and Datalake environments using AWS Kinesis and Managed Streaming for Apache Kafka. You will leverage open source technologies including Apache Airflow, dbt, and Spark with Python or Scala to build robust data engineering solutions. Scheduling and managing data services on the AWS Platform to ensure efficient operations is also a key part of this position. Familiarity with AWS Glue Databrew, Lambda functions with Python, and RedShift Spectrum is a plus.
