GCP Data Engineer
£350 - £400 GBP hourly
The Role
We are seeking an experienced GCP Data Engineer to design, build, and optimize scalable cloud-native data platforms on Google Cloud Platform (GCP). The ideal candidate will have strong expertise in developing batch and real-time data pipelines, implementing data lake and data warehouse solutions, and enabling data-driven analytics and AI/ML initiatives. The role involves close collaboration with architects, data scientists, business analysts, and application teams to deliver high-quality, secure, and reliable data solutions
Your responsibilities:
• Build batch and streaming data ingestion frameworks using Dataflow, Dataproc, Pub/Sub, and Cloud Functions.
• Develop reusable and optimized data processing solutions using PySpark and Python.
• Implement orchestration workflows using Cloud Composer (Apache Airflow).
• Ensure data quality, integrity, lineage, and governance across data platforms.
• Implement partitioning, clustering, and performance tuning strategies in BigQuery.
• Manage structured, semi-structured, and unstructured data processing requirements.
• Implement IAM policies, data security controls, and compliance requirements.
• Participate in technical design discussions, code reviews, and solution governance meetings.
Your Profile
Essential skills/knowledge/experience:
• Google Cloud Platform (GCP)
• BigQuery
• Dataproc
• Cloud Composer (Airflow)
• Pub/Sub
• Dataflow
• Cloud Storage
• Python
• PySpark
• SQL
• Terraform
• Git, CI/CD
Desirable skills/knowledge/experience:
• Strong analytical and problem-solving skills.
• Excellent communication and stakeholder management capabilities.
• Ability to work in global and multi-vendor environments.
• Experience delivering solutions for data modernization and cloud migration initiatives.