Cloud Composer Jobs

18 of 18 Cloud Composer Jobs

Senior Data Engineer

City of London, London, United Kingdom
Hybrid / WFH Options
Tata Consultancy Services
Design, develop, and maintain robust and scalable backend systems and APIs. Data Ingestion: Develop and maintain data pipelines to extract data from various sources and load it into Google Cloud environments. Data Transformation: Implement data transformation processes, including data cleansing, normalization, and aggregation, to ensure data quality and consistency. Data Modeling: Develop and maintain data models and schemas … to support efficient data storage and retrieval in Google Cloud platforms. Data Integration: Integrate data from multiple sources, both on-premises and cloud-based, using Cloud Composer or other relevant tools. Data Lakes: Build data lakes using Google Cloud services such as Big Query. Performance Optimization: Optimize data pipelines and … queries for improved performance and scalability in Google Cloud environments. Collaboration: Work with product managers to ensure superior product delivery to drive business value & transformation Documentation: Document data engineering processes, data flows, and system configurations for future reference and knowledge sharing. Your Profile Essential experience: Experience in data engineering, with a strong focus on Google Cloud More ❯
Posted:

Senior Data Engineer

London Area, United Kingdom
Hybrid / WFH Options
Tata Consultancy Services
Design, develop, and maintain robust and scalable backend systems and APIs. Data Ingestion: Develop and maintain data pipelines to extract data from various sources and load it into Google Cloud environments. Data Transformation: Implement data transformation processes, including data cleansing, normalization, and aggregation, to ensure data quality and consistency. Data Modeling: Develop and maintain data models and schemas … to support efficient data storage and retrieval in Google Cloud platforms. Data Integration: Integrate data from multiple sources, both on-premises and cloud-based, using Cloud Composer or other relevant tools. Data Lakes: Build data lakes using Google Cloud services such as Big Query. Performance Optimization: Optimize data pipelines and … queries for improved performance and scalability in Google Cloud environments. Collaboration: Work with product managers to ensure superior product delivery to drive business value & transformation Documentation: Document data engineering processes, data flows, and system configurations for future reference and knowledge sharing. Your Profile Essential experience: Experience in data engineering, with a strong focus on Google Cloud More ❯
Posted:

Senior Data Engineer

london, south east england, united kingdom
Hybrid / WFH Options
Tata Consultancy Services
Design, develop, and maintain robust and scalable backend systems and APIs. Data Ingestion: Develop and maintain data pipelines to extract data from various sources and load it into Google Cloud environments. Data Transformation: Implement data transformation processes, including data cleansing, normalization, and aggregation, to ensure data quality and consistency. Data Modeling: Develop and maintain data models and schemas … to support efficient data storage and retrieval in Google Cloud platforms. Data Integration: Integrate data from multiple sources, both on-premises and cloud-based, using Cloud Composer or other relevant tools. Data Lakes: Build data lakes using Google Cloud services such as Big Query. Performance Optimization: Optimize data pipelines and … queries for improved performance and scalability in Google Cloud environments. Collaboration: Work with product managers to ensure superior product delivery to drive business value & transformation Documentation: Document data engineering processes, data flows, and system configurations for future reference and knowledge sharing. Your Profile Essential experience: Experience in data engineering, with a strong focus on Google Cloud More ❯
Posted:

Senior Data Engineer

slough, south east england, united kingdom
Hybrid / WFH Options
Tata Consultancy Services
Design, develop, and maintain robust and scalable backend systems and APIs. Data Ingestion: Develop and maintain data pipelines to extract data from various sources and load it into Google Cloud environments. Data Transformation: Implement data transformation processes, including data cleansing, normalization, and aggregation, to ensure data quality and consistency. Data Modeling: Develop and maintain data models and schemas … to support efficient data storage and retrieval in Google Cloud platforms. Data Integration: Integrate data from multiple sources, both on-premises and cloud-based, using Cloud Composer or other relevant tools. Data Lakes: Build data lakes using Google Cloud services such as Big Query. Performance Optimization: Optimize data pipelines and … queries for improved performance and scalability in Google Cloud environments. Collaboration: Work with product managers to ensure superior product delivery to drive business value & transformation Documentation: Document data engineering processes, data flows, and system configurations for future reference and knowledge sharing. Your Profile Essential experience: Experience in data engineering, with a strong focus on Google Cloud More ❯
Posted:

Senior Data Engineer

london (city of london), south east england, united kingdom
Hybrid / WFH Options
Tata Consultancy Services
Design, develop, and maintain robust and scalable backend systems and APIs. Data Ingestion: Develop and maintain data pipelines to extract data from various sources and load it into Google Cloud environments. Data Transformation: Implement data transformation processes, including data cleansing, normalization, and aggregation, to ensure data quality and consistency. Data Modeling: Develop and maintain data models and schemas … to support efficient data storage and retrieval in Google Cloud platforms. Data Integration: Integrate data from multiple sources, both on-premises and cloud-based, using Cloud Composer or other relevant tools. Data Lakes: Build data lakes using Google Cloud services such as Big Query. Performance Optimization: Optimize data pipelines and … queries for improved performance and scalability in Google Cloud environments. Collaboration: Work with product managers to ensure superior product delivery to drive business value & transformation Documentation: Document data engineering processes, data flows, and system configurations for future reference and knowledge sharing. Your Profile Essential experience: Experience in data engineering, with a strong focus on Google Cloud More ❯
Posted:

Google Cloud Data Migration Lead

Dallas, Texas, United States
Robotics technology LLC
Job Details Position: Google Cloud Data Migration Data Migration Team Lead Duration: Long term contract Job Summary: Seeking a Google Cloud data engineer to design, build, and maintain scalable and efficient data processing systems on the Google Cloud platform. This engineer will be responsible for the entire data lifecycle, from ingestion and storage to … data to business intelligence tools, AI systems, analysts and data scientists. Key Responsibilities: Serve as Data Migration team leader for a large data and application migration to the Google Cloud platform. As Data Migration team leader, this individual will be responsible for our team's endto-end data architecture and migration planning to support the migration effort as … well as future-state client efforts on the Google Cloud platform. As Data Migration team leader, this individual will collaborate closely with the overall Google Cloud migration team leadership, working to deliver a successful application and data migration. Design and build data pipelines: Develop and maintain reliable and scalable batch and real-time data pipelines using More ❯
Employment Type: Any
Salary: USD Annual
Posted:

Data Solutions Architect (GCP)

City of London, London, United Kingdom
Hybrid / WFH Options
Tenth Revolution Group
Management Role Overview This strategic, client-facing role sits within a growing Data Management practice and focuses on leading cloud-based data architecture initiatives, particularly on Google Cloud Platform (GCP). The Data Solutions Architect will collaborate with senior stakeholders to modernise data platforms, accelerate cloud transformation, and unlock business value through data and … commercially viable and technically sound solutions. Enterprise Solution Design Architect and oversee the delivery of scalable data platforms (data lakes, lakehouses, warehouses) using GCP technologies such as BigQuery, Cloud Storage, Databricks, and Snowflake. Cloud Data Strategy Lead cloud migration and modernisation strategies using GCP and tools like Terraform, CI/CD pipelines, Azure DevOps … modelling using tools such as ERwin, ER/Studio, or PowerDesigner to ensure performance, scalability, and maintainability. ETL/ELT Frameworks Design robust data pipelines using tools like Cloud Composer, Dataflow, Dataproc, Informatica, or IBM DataStage, supporting both batch and streaming ingestion. Data Governance & Quality Implement governance frameworks, metadata management, and data quality controls using platforms More ❯
Employment Type: Permanent
Salary: £100000 - £125000/annum
Posted:

GCP Data Engineer

Boston, Massachusetts, United States
Tubman Technologies Inc
Job Title: GCP Data Engineer Location: Boston MA or Atlanta GA Visa - H1 10+years of experience Need a senior engineer with Cloud Data Fusion, and Google Dataform environment - Not looking for people with heavy Airflow or Dataflow - It will not work Must list out years of experience w/… the following Must Haves and Good to Haves: Must have: Google Pub/Sub BigQuery Google Dataform Cloud Data fusion Data ingestion to Big Query experience Google Cloud Storage Cloud Composer GitHub SQL Good to have: DBMS connectivity and interaction experience (SQL Server, DB2, Oracle) Experience calling RESTful API's and SOAP … Webservices Experience integrating with other Google resources, databases, and services Jira Confluence Position Purpose: Implements simple to complex data ingestion and pipeline processes on Google Cloud Platform using industry-standard best practices. Designs, develops, configures, tests, debugs, and documents these processes based on business requirements and technical architecture specifications. Supports and troubleshoots existing ingestion and pipeline processes and More ❯
Employment Type: Permanent
Salary: USD Annual
Posted:

GCP Data Engineer

Parsippany, New Jersey, United States
Tata Consultancy Services
skills in SQL and languages like Python. Deep understanding of data warehousing concepts and solutions like BigQuery. Expertise in GCP services such as BigQuery, Dataflow, Pub/Sub, Cloud Storage, Cloud Composer, Cloudrun and Dataproc. Building and deploying scalable and reliable applications using GCP services. Setting up and configuring the necessary cloud More ❯
Employment Type: Permanent
Salary: USD Annual
Posted:

Principal Consultant - Data Engineering Lead DBT

Newbury, Berkshire, England, United Kingdom
Hybrid / WFH Options
Intuita
delivery.Proven success as a Team Leader, managing a team of Data Engineers on various projects Proven experience in data engineering and architecture, with a focus on developing scalable cloud solutions in Azure, GCP or AWS. Data Modelling using Kimball, 3NF or Dimensional methodologies Analytics Engineering lean, with experience within BigQuery (GCP) with data modelling in DBT and mobile … effectiveness, including Azure DevOps or GitHub Considerable experience designing and building operationally efficient pipelines, utilising core Cloud components, such as Azure Data Factory, Big Query, AirFlow, Google Cloud Composer and Pyspark etc Proven experience in modelling data through a medallion-based architecture, with curated dimensional models in the gold layer built for analytical use … Strong understanding and or use of unity catalog alongside core databricks functionality to drive metadata management Strong understanding of cloud economics, including cost management strategies and optimising solutions for customer needs.Experience with infrastructure as code, proficiency using tools such as Terraform to automate and manage cloud infrastructure, ensuring both consistency and scalability across environments Certifications in More ❯
Employment Type: Full-Time
Salary: £75,000 - £95,000 per annum
Posted:

GCP Data Engineer

Alpharetta, Georgia, United States
Apetan Consulting
to join our growing Data, analytics and Data products team. This role is pivotal in designing, building, testing, and maintaining robust, scalable data pipelines and infrastructure on the Google Cloud Platform (GCP The successful candidate will leverage core GCP services like BigQuery and Dataflow, integrate with advanced platforms like Vertex AI, and potentially utilize Gemini models for data … Development & Management: Design, develop, test, deploy, and maintain scalable, efficient, and reliable batch and real-time data pipelines on GCP. Utilize services such as Dataflow, Pub/Sub, Cloud Composer, and potentially Dataproc to ingest, transform, and load data from diverse sources including on-premises systems, IoT devices, and cloud applications. Data Warehousing & Modeling … systems like Kafka; workflow orchestration tools like Apache Airflow; data transformation tools like dbt or Dataform; containerization technologies like Docker and Kubernetes; CI/CD tools (e.g., Jenkins, Google Cloud Build); experience with other data platforms like Snowflake or Databricks. Industry Experience: Prior experience working in the energy, utilities, or related industrial sectors. More ❯
Employment Type: Any
Salary: USD Annual
Posted:

Senior or Consultant - Data Engineering DBT

Newbury, Berkshire, England, United Kingdom
Hybrid / WFH Options
Intuita
on experience in a business transformation setting, either at enterprise level or in large-scale delivery.Proven experience in data engineering and architecture, with a focus on developing scalable cloud solutions in Azure, GCP or AWS. Data Modelling using Kimball, 3NF or Dimensional methodologiesAnalytics Engineering lean, with experience within BigQuery (GCP) with data modelling in DBT and mobile/… effectiveness, including Azure DevOps or GitHub Considerable experience designing and building operationally efficient pipelines, utilising core Cloud components, such as Azure Data Factory, Big Query, AirFlow, Google Cloud Composer and Pyspark etc Proven experience in modelling data through a medallion-based architecture, with curated dimensional models in the gold layer built for analytical use … Strong understanding and or use of unity catalog alongside core databricks functionality to drive metadata management Strong understanding of cloud economics, including cost management strategies and optimising solutions for customer needs.Experience with infrastructure as code, proficiency using tools such as Terraform to automate and manage cloud infrastructure, ensuring both consistency and scalability across environments Certifications in More ❯
Employment Type: Full-Time
Salary: £45,000 - £68,000 per annum
Posted:

Senior Data Engineer GCP - Finance

City of London, London, United Kingdom
Hybrid / WFH Options
Client Server
Senior Data Engineer (GCP BigQuery Python SQL) London/WFH to £85k Are you a tech savvy Data Engineer with Google Cloud expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on Data Engineer role. As a Senior Data … BigQuery, Dataflow and Dataproc, collaborating closely with clients to define business requirements, architect fit-for-purpose data solutions and support the migration of legacy on-premise systems to cloud-native architectures. You'll collaborate directly with clients to analyse requirements, define solutions and deliver production grade systems, leading the development of robust, well tested and fault tolerant data … at client site in London). About you: You are an experienced Data Engineer within financial services environments You have expertise with GCP including BigQuery, Pub/Sub, Cloud Composer and IAM You have strong Python, SQL and PySpark skills You have experience with real-time data streaming using Kafka or Spark You have a good More ❯
Employment Type: Permanent, Work From Home
Salary: £85,000
Posted:

Senior Data Engineer GCP - Finance

London, England, United Kingdom
Hybrid / WFH Options
Client Server
Senior Data Engineer (GCP BigQuery Python SQL) London/WFH to £85k Are you a tech savvy Data Engineer with Google Cloud expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on Data Engineer role. As a Senior Data … BigQuery, Dataflow and Dataproc, collaborating closely with clients to define business requirements, architect fit-for-purpose data solutions and support the migration of legacy on-premise systems to cloud-native architectures. You'll collaborate directly with clients to analyse requirements, define solutions and deliver production grade systems, leading the development of robust, well tested and fault tolerant data … at client site in London). About you: You are an experienced Data Engineer within financial services environments You have expertise with GCP including BigQuery, Pub/Sub, Cloud Composer and IAM You have strong Python, SQL and PySpark skills You have experience with real-time data streaming using Kafka or Spark You have a good More ❯
Posted:

Senior Data Engineer GCP - Finance

london, south east england, united kingdom
Hybrid / WFH Options
Client Server
Senior Data Engineer (GCP BigQuery Python SQL) London/WFH to £85k Are you a tech savvy Data Engineer with Google Cloud expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on Data Engineer role. As a Senior Data … BigQuery, Dataflow and Dataproc, collaborating closely with clients to define business requirements, architect fit-for-purpose data solutions and support the migration of legacy on-premise systems to cloud-native architectures. You'll collaborate directly with clients to analyse requirements, define solutions and deliver production grade systems, leading the development of robust, well tested and fault tolerant data … at client site in London). About you: You are an experienced Data Engineer within financial services environments You have expertise with GCP including BigQuery, Pub/Sub, Cloud Composer and IAM You have strong Python, SQL and PySpark skills You have experience with real-time data streaming using Kafka or Spark You have a good More ❯
Posted:

Senior Data Engineer GCP - Finance

slough, south east england, united kingdom
Hybrid / WFH Options
Client Server
Senior Data Engineer (GCP BigQuery Python SQL) London/WFH to £85k Are you a tech savvy Data Engineer with Google Cloud expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on Data Engineer role. As a Senior Data … BigQuery, Dataflow and Dataproc, collaborating closely with clients to define business requirements, architect fit-for-purpose data solutions and support the migration of legacy on-premise systems to cloud-native architectures. You'll collaborate directly with clients to analyse requirements, define solutions and deliver production grade systems, leading the development of robust, well tested and fault tolerant data … at client site in London). About you: You are an experienced Data Engineer within financial services environments You have expertise with GCP including BigQuery, Pub/Sub, Cloud Composer and IAM You have strong Python, SQL and PySpark skills You have experience with real-time data streaming using Kafka or Spark You have a good More ❯
Posted:

Technical Delivery Lead - GCP

London, United Kingdom
Hybrid / WFH Options
Tenth Revolution Group
re looking for: 10+ years in technology/data delivery, including 3+ years in Delivery Lead/Technical Lead roles (GCP preferred). Proven experience leading large-scale cloud data platform deliveries. Strong stakeholder engagement, communication, and governance skills. Familiarity with GCP data services (BigQuery, Dataflow, Cloud Composer, etc.) and modern delivery methodologies (Agile More ❯
Employment Type: Contract
Rate: £80000 - £120000/annum
Posted:

Technical Delivery Lead - GCP

London, South East, England, United Kingdom
Hybrid / WFH Options
Tenth Revolution Group
re looking for: 10+ years in technology/data delivery, including 3+ years in Delivery Lead/Technical Lead roles (GCP preferred). Proven experience leading large-scale cloud data platform deliveries. Strong stakeholder engagement, communication, and governance skills. Familiarity with GCP data services (BigQuery, Dataflow, Cloud Composer, etc.) and modern delivery methodologies (Agile More ❯
Employment Type: Full-Time
Salary: £80,000 - £120,000 per annum
Posted:
Cloud Composer
10th Percentile
£62,500
25th Percentile
£74,688
Median
£112,500
75th Percentile
£118,750
90th Percentile
£125,875