1 to 25 of 164 BigQuery Jobs in the UK

Spark and Kafka. Experience designing data models, ETL and ELT pipelines, data warehouses and data lakes. Practical experience with Google Cloud tools such as BigQuery, Dataflow, Dataproc, Pub/Sub, Composer and Dataplex, or comparable services within Azure or AWS.Strong knowledge of SQL, databases, metadata management and data governance. ...

Azure) Experience with large-scale distributed data processing and performance tuning Hands-on experience with modern data warehousing/lakehouse technologies (e.g., Redshift, BigQuery, Snowflake; and engines such as Spark, Flink, or Trino; and table formats such as Iceberg, Hudi, or similar) Strong SQL skills and experience with ...

Azure) Experience with large-scale distributed data processing and performance tuning Hands-on experience with modern data warehousing/lakehouse technologies (e.g., Redshift, BigQuery, Snowflake; and engines such as Spark, Flink, or Trino; and table formats such as Iceberg, Hudi, or similar) Strong SQL skills and experience with ...

Azure) Experience with large-scale distributed data processing and performance tuning Hands-on experience with modern data warehousing/lakehouse technologies (e.g., Redshift, BigQuery, Snowflake and engines such as Spark, Flink, or Trino and table formats such as Iceberg, Hudi, or similar) Strong SQL skills and experience with ...

data fabric).Hands-on experience with one or more cloud data ecosystems: Azure (Data Factory, Synapse, Fabric, ADLS, Databricks)AWS (Glue, Redshift, EMR)GCP (BigQuery, Dataflow)Databricks (Spark/PySpark)Snowflake (SQL, Snowpark, performance tuning)Desirable ExperienceStrong SQL and/or Python capability, and familiarity with tools such ...

another relevant programming language. Experience with modern data engineering tools, such as dbt, Airflow or Spark. Experience with cloud data warehouses, such as Snowflake, BigQuery or Amazon Redshift. A solid understanding of data modelling, ETL/ELT and data quality. Knowledge of data governance, security and privacy. Confidence taking ...

dimensional modeling, and ELT/ETL design, with production experience on a modern cloud data warehouse or lakehouse (for example Snowflake, Databricks, BigQuery, Redshift, or Synapse) and a transformation framework such as dbt. Experience applying software engineering practices to analytics work, including Git-based workflows, automated testing ...

equivalent Experience building data pipelines in production Hands-on experience with a cloud platform (AWS, Azure or GCP) Experience with data warehousing (Snowflake, Redshift, BigQuery or Synapse) Understanding of data modelling and CI/CD Desirable Spark, Databricks or Kafka Orchestration tools such as Airflow or dbt Infrastructure ...

integration using modern frameworks (Spark, dbt, LangChain)A strong foundation in system design, data storage, and reliability with commonly used data platforms (Databricks, Snowflake, BigQuery, PSQL, etc.) and data engineering tools (e.g., Pandas, Spark, dbt, etc.)Hands-on experience with MLOps/LLMOps principles, including CI/ ...

Code (Terraform preferred). Experience with containerisation (Docker) and orchestration platforms (Kubernetes/EKS). Certifications & Tools Exposure to enterprise data platforms (Databricks, Snowflake, BigQuery, or similar). Cloud certifications (AWS, Azure, GCP) are beneficial but not required. Other Requirements Minimum 3 years experience working on data engineering ...

more programming or query languages such as SQL, PL/SQL, Python, Java, Ruby or R.Experience with relevant modern data technologies such as BigQuery, Databricks, Snowflake, MongoDB, Hadoop, Redis, Kafka or similar. The ability to select technologies based on scalability, performance, security, interoperability and business requirements. Experience documenting complex ...

Azure). Strong SQL and Python skills, with deep experience in modern data stack tooling (e.g., dbt, Airflow or Dagster, Spark, Snowflake, BigQuery, Databricks). Experience designing lakehouse architectures and ELT-based transformation workflows. Practical experience implementing data governance, lineage, quality, and observability frameworks. Familiar with CI/ ...

workflows. Required Skills Commercial experience in a Data Engineering or Data Developer role. Strong SQL and Python programming skills. Hands-on experience with Google BigQuery and Google Cloud Platform. Experience implementing cloud-based data solutions. Experience integrating Salesforce Marketing Cloud and Salesforce CRM data. Understanding of marketing platforms, campaign ...

knowledge of AWS and components such as S3, Kinesis, DMS, SNS, Glue, Athena, RDS Experience with Data Warehouse databases like Snowflake/Redshift/BigQuery Experience with Python/PySpark Experience with implementing Rest APIs. Experience with using and integrating BI tools such as QuickSight, Looker, Power BI, Tableau ...

environments. Experience with CI/CD pipelines, ideally using Azure DevOps or similar. Nice to Have Experience with Apache Airflow or dbt. Exposure to BigQuery/GCP. Azure or other cloud platform certifications Knowledge of data governance and data management frameworks Ideal experience working with financial data, regulatory reporting ...

queries for: Data validationRoot cause analysisReport troubleshootingSupport and maintain data warehouse environments, such as: Azure Synapse AnalyticsSQL Server/Azure SQL DBSnowflake or BigQuery (optional, if used in hybrid environments)Monitor ETL performance and investigate slow-running queries and data load failures. Issue Investigation & RCAInvestigate job failures and performance ...

stakeholders. Self-sufficient, with excellent problem-solving and communication skills. Advantageous: Experience with Logic Apps and integration tools. Familiarity with data frameworks (e.g., Snowflake, BigQuery, Redshift).Knowledge of DevOps practices, CI/CD pipelines, and Infrastructure Code (e.g., Bicep, Terraform).Exposure to machine learning and AI solutions. Understanding PowerShell ...

DOMO, Tableau, Looker,etc. Expert level SQL skills — complex queries, window functions, CTEs, query optimization. Experience with cloud data platforms (e.g., Snowflake, Azure Synapse, BigQuery, Databricks). Expertise in data modeling concepts: star/snowflake schemas, dimensional modeling,semantic layers, and performance tuning at scale. Experience with Python ...

/CD pipelinesExperience with managed ML platforms such as SageMaker, Vertex AI or Azure MLData engineering and MLOpsExperience with data warehouses such as Snowflake, BigQuery or RedshiftWorkflow orchestration using tools like Airflow or DagsterExperience with MLOps tools such as MLflow, Weights and Biases or similarAwareness of data and model ...

just individual pipelinesExperience designing and operating production data platforms across cloud infrastructure, orchestration, ingestion and SQL transformation layersPractical experience with GCP, BigQuery, Terraform, Kubernetes, Dagster, dlt and dbt - or equivalent tools with the ability to articulate transferable reasoningDemonstrated ability to make and document architecture decisions that involve meaningful trade ...

record of delivering improvements. Bonus points for: Ecommerce, marketing, sales or supply chain analytics experience. Familiarity with cloud data platforms such as Azure, AWS, BigQuery or Snowflake. Python, R or other analysis and automation tools. Knowledge of data pipelines, ETL or data warehousing. We are a Disability Confident Employer ...

record of delivering improvements. Bonus points for: Ecommerce, marketing, sales or supply chain analytics experience. Familiarity with cloud data platforms such as Azure, AWS, BigQuery or Snowflake. Python, R or other analysis and automation tools. Knowledge of data pipelines, ETL or data warehousing. We are a Disability Confident Employer ...

cloud-based data infrastructure, while contributing to strong engineering practices and standards. The environment is heavily focused on Google Cloud Platform (GCP), with BigQuery, Dataform and Airflow/Cloud Composer forming key parts of the technology stack. WHAT YOU'LL BE DOING * Designing and implementing complex data flows across ...

with CI/CD, DevOps practices, and modern software development methodologies. Ability to work independently, manage ambiguity, and make sound technical decisions. Experience with BigQuery, Google Cloud, medical imaging data, DICOM, or AI-enabled development workflows would be advantageous. How to Apply If you are interested in this Senior ...

PySpark SQL Knowledge of AWS and components such as S3, Glue, Athena, RDS Experience with Data Warehouse databases like Redshift/Snowflake/BigQuery Experience with implementing Rest APIs. Experience with using and integrating BI tools such as Looker, Qlik, Power BI, Tableau Modern data engineering practises This ...