11 of 11 Cloud Composer Jobs

and able to manage CI/CD pipelines and terraform as well as Cloud infrastructure, in our context, it is GCP (Google Cloud Platform). Evaluate and drive continuous improvement and reducing technical debt in the teams Design and implement efficient data models, data pipelines that … in an environment that allows you to work and take decisions independently Experience in working with data visualization tools Experience in GCP tools – Cloud Function, Dataflow, Dataproc and Bigquery Experience in data processing framework – Beam, Spark, Hive, Flink GCP data engineering certification is a merit Have hands on … deployment of data mesh architecture , ensuring federated governance, discoverability, and self-serve capabilities. Design and build scalable data pipelines using GCP (BigQuery, Dataflow, Cloud Composer, Cloud Functions) and orchestrate transformations using DBT . Develop modular, reusable DBT models for core retail metrics such as More ❯

and able to manage CI/CD pipelines and terraform as well as Cloud infrastructure, in our context, it is GCP (Google Cloud Platform). Evaluate and drive continuous improvement and reducing technical debt in the teams Design and implement efficient data models, data pipelines that … in an environment that allows you to work and take decisions independently Experience in working with data visualization tools Experience in GCP tools – Cloud Function, Dataflow, Dataproc and Bigquery Experience in data processing framework – Beam, Spark, Hive, Flink GCP data engineering certification is a merit Have hands on … deployment of data mesh architecture , ensuring federated governance, discoverability, and self-serve capabilities. Design and build scalable data pipelines using GCP (BigQuery, Dataflow, Cloud Composer, Cloud Functions) and orchestrate transformations using DBT . Develop modular, reusable DBT models for core retail metrics such as More ❯

deploying machine learning models in a production environment. • 3+ years of experience in programming with Python • 3+ years of hands-on experience utilizing Google Cloud Platform (GCP) services, including BigQuery and Google Cloud Storage to efficiently manage and process large datasets, as well as Cloud Composer and/or Cloud Run. • Experience with version control systems like GitHub for managing code repositories and collaboration. • 3+ years of experience with code quality and security scanning tools, such as, SonarQube, Cycode and FOSSA. • 3+ years of experience with data engineering tools … problem-solving and analytical skills, with a focus on data-driven solutions. • Familiarity with cloud computing platforms like AWS, Azure, or Google Cloud Platform. • Familiarity with Atlassian project management tools (e.g., Jira, Confluence) and agile practices. Skills Preferred: • Proven ability to thrive in dynamic environments, managing More ❯

for building and maintaining scalable, efficient, and reliable data pipelines. You'll work across a modern tech stack with a strong focus on Google Cloud Platform (GCP) and collaborate with various teams to ensure data flows securely and accurately throughout the organisation. Key Responsibilities Design, build, and maintain … robust data pipelines. Work with Python and SQL for data processing, transformation, and analysis. Leverage a wide range of GCP services including: Cloud Composer (Apache Airflow) BigQuery Cloud Storage Dataflow Pub/Sub Cloud Functions IAM Design and implement data models and More ❯

Join a dynamic team where your expertise in Google Cloud Platform fuels innovation, drives smarter decisions, and supports business growth through powerful data engineering. We're on the lookout for a skilled GCP Data Engineer to design and implement efficient, secure, and scalable data pipelines. Your work will … storage, and enhance operational efficiency using the latest GCP tools. What You'll Be Doing Design, develop, maintain, and optimize data pipelines on Google Cloud Platform . Build and manage data warehouses and lakes using tools like BigQuery , Cloud Storage , and Dataflow . Leverage GCP services … including Cloud Pub/Sub , Cloud Composer , and Dataflow to ensure seamless data flow and processing. Use your expertise in SQL , along with experience in relational and NoSQL databases. Transform and process data using Python , Spark , or Scala . Implement secure, scalable ETL frameworks More ❯

maintains the core data technology infrastructure driving the ecosystem that enables the business to make smarter decisions with data. Our primary technology is Google Cloud Platform supported by Airflow and dbt. As technical lead on the team you'll be working closely with architects, product managers and stakeholders … engineering practice across the organisation Coaching and mentoring a team of engineers Build and maintain our data ecosystem, including maintaining a lakehouse on Google Cloud Platform with BigQuery at its core Deliver operations and orchestration for all things data, specifically on Airflow, Cloud Composer … including experience with GCP and BigQuery preferred. Design and deliver solutions on the technologies that drive data at the Guardian. This looks like: Google Cloud Platform: BigQuery, Kubernetes Python, Airflow, & DBT CI/CD & Terraform Nice-to-have : Spark & Scala on DataProc Demonstrated knowledge and experience of key More ❯

support, and evolve a clean ecosystem (enterprise-wide and EDW-specific data architecture, modelling, development, and governance) champion the usage of relevant modern cloud and/or open-source tools and technology. Enable the strategic roadmaps, develop and communicate the sequence of architectural implementation. Establish a strong support … projects and strategic programmes. What skills and experience will you have? Significant practical and demonstrable data architecture experience, preferably in designing and implementing cloud-native analytics/data platforms (including data lake/warehouse) technology through all data lifecycle stages Excellent conceptual and logical data modelling and database … mindset, taking advantage of learning opportunities to help N Brown become an industry leader What knowledge of Technology will you have? Experience with Google Cloud products (BigQuery, GCS, Cloud Composer, Dataflow etc.) or similar products from other cloud platforms Experience with open More ❯

Qodea is Europe's leading Google Cloud specialist consultancy. We're a team that's energised by innovation and delivering exceptional results for our clients. We deliver cutting edge solutions across data & analytics, AI, cloud infrastructure or security that drive digital transformation and enable our customers … you'll bring: Experience in performing a technical leadership role on projects and experience with transitioning projects into a support program. Experience with Google Cloud Platform (GCP) services, including Cloud Composer (Apache Airflow) for workflow orchestration. Strong experience in Python with demonstrable experience in More ❯

Future Talent Pool - GCP Data Engineer, London, hybrid role - digital Google Cloud transformation programme Proficiency in programming languages such as Python, PySpark and Java develop ETL processes for Data ingestion & preparation SparkSQL CloudRun, DataFlow, CloudStorage GCP BigQuery Google Cloud Platform Data Studio Unix/Linux Platform … Version control tools (Git, GitHub), automated deployment tools Google Cloud Platform services, Pub/Sub, BigQuery Streaming and related technologies. Deep understanding of real-time data processing and event-driven architectures. Familiarity with data orchestration tools Google Cloud Platform cloud composer. Google Cloud Platform certification(s) is a strong advantage. Develop, implement, and optimize real-time data processing workflows using Google Cloud Platform services such as Dataflow, Pub/Sub, and BigQuery Streaming. 6 months initial, likely long term extensions This advert was posted by Staffworx Limited - a UK More ❯

this role • Proficient in Java, preferably Kotlin, with experience on Java 11, Gradle and Apache Spark • Experience in GCP, preferably Big Query and Cloud Composer • Experience with CI/CD, preferably GitHub and GitHub action • Experience with Agile is desirable, with strong adaptability and an open More ❯

this role Proficient in Java, preferably Kotlin, with experience on Java 11, Gradle and Apache Spark. Experience in GCP, preferably Big Query and Cloud Composer. Experience with CI/CD, preferably GitHub and GitHub action. Experience with Agile is desirable, with strong adaptability and an open mindset; Be … your horizons. Come join our team-one of the largest IT and business consulting services firms in the world. Skills Data Analysis Google Cloud Platform Java Reference More ❯