Data Engineer-Data Platforms-Google
As a Data Engineer specializing in Google data platforms at IBM Consulting, you will design, build, and maintain data engineering solutions on Google's Cloud ecosystem. You will develop both batch and real-time data pipelines for Data Warehouse and Datalake using Google services such as DataProc, DataFlow, PubSub, BigQuery, and BigTable. The role involves managing and scheduling data platforms using Google Cloud Scheduler and Cloud Composer (Airflow), as well as implementing data migration solutions to ensure seamless data transfer between systems. You will optimize the data layer using services like BigQuery, BigTable, and Cloud Spanner for efficient data storage and retrieval. Proficiency with open-source technologies like Apache Airflow, dbt, Spark, and Apache Beam is expected alongside strong Google Cloud expertise.
