1 to 25 of 209 BigQuery Jobs in the UK

such as Spark and Kafka.Experience designing data models, ETL and ELT pipelines, data warehouses and data lakes.Practical experience with Google Cloud tools such as BigQuery, Dataflow, Dataproc, Pub/Sub, Composer and Dataplex, or comparable services within Azure or AWS.Strong knowledge of SQL, databases, metadata management and data governance.Experience ...

Spark and Kafka. Experience designing data models, ETL and ELT pipelines, data warehouses and data lakes. Practical experience with Google Cloud tools such as BigQuery, Dataflow, Dataproc, Pub/Sub, Composer and Dataplex, or comparable services within Azure or AWS.Strong knowledge of SQL, databases, metadata management and data governance. ...

Azure) Experience with large-scale distributed data processing and performance tuning Hands-on experience with modern data warehousing/lakehouse technologies (e.g., Redshift, BigQuery, Snowflake; and engines such as Spark, Flink, or Trino; and table formats such as Iceberg, Hudi, or similar) Strong SQL skills and experience with ...

Azure) Experience with large-scale distributed data processing and performance tuning Hands-on experience with modern data warehousing/lakehouse technologies (e.g., Redshift, BigQuery, Snowflake; and engines such as Spark, Flink, or Trino; and table formats such as Iceberg, Hudi, or similar) Strong SQL skills and experience with ...

Azure) Experience with large-scale distributed data processing and performance tuning Hands-on experience with modern data warehousing/lakehouse technologies (e.g., Redshift, BigQuery, Snowflake and engines such as Spark, Flink, or Trino and table formats such as Iceberg, Hudi, or similar) Strong SQL skills and experience with ...

data fabric).Hands-on experience with one or more cloud data ecosystems: Azure (Data Factory, Synapse, Fabric, ADLS, Databricks)AWS (Glue, Redshift, EMR)GCP (BigQuery, Dataflow)Databricks (Spark/PySpark)Snowflake (SQL, Snowpark, performance tuning)Desirable ExperienceStrong SQL and/or Python capability, and familiarity with tools such ...

another relevant programming language. Experience with modern data engineering tools, such as dbt, Airflow or Spark. Experience with cloud data warehouses, such as Snowflake, BigQuery or Amazon Redshift. A solid understanding of data modelling, ETL/ELT and data quality. Knowledge of data governance, security and privacy. Confidence taking ...

dimensional modeling, and ELT/ETL design, with production experience on a modern cloud data warehouse or lakehouse (for example Snowflake, Databricks, BigQuery, Redshift, or Synapse) and a transformation framework such as dbt. Experience applying software engineering practices to analytics work, including Git-based workflows, automated testing ...

equivalent Experience building data pipelines in production Hands-on experience with a cloud platform (AWS, Azure or GCP) Experience with data warehousing (Snowflake, Redshift, BigQuery or Synapse) Understanding of data modelling and CI/CD Desirable Spark, Databricks or Kafka Orchestration tools such as Airflow or dbt Infrastructure ...

integration using modern frameworks (Spark, dbt, LangChain)A strong foundation in system design, data storage, and reliability with commonly used data platforms (Databricks, Snowflake, BigQuery, PSQL, etc.) and data engineering tools (e.g., Pandas, Spark, dbt, etc.)Hands-on experience with MLOps/LLMOps principles, including CI/ ...

Code (Terraform preferred). Experience with containerisation (Docker) and orchestration platforms (Kubernetes/EKS). Certifications & Tools Exposure to enterprise data platforms (Databricks, Snowflake, BigQuery, or similar). Cloud certifications (AWS, Azure, GCP) are beneficial but not required. Other Requirements Minimum 3 years experience working on data engineering ...

more programming or query languages such as SQL, PL/SQL, Python, Java, Ruby or R.Experience with relevant modern data technologies such as BigQuery, Databricks, Snowflake, MongoDB, Hadoop, Redis, Kafka or similar. The ability to select technologies based on scalability, performance, security, interoperability and business requirements. Experience documenting complex ...

Azure). Strong SQL and Python skills, with deep experience in modern data stack tooling (e.g., dbt, Airflow or Dagster, Spark, Snowflake, BigQuery, Databricks). Experience designing lakehouse architectures and ELT-based transformation workflows. Practical experience implementing data governance, lineage, quality, and observability frameworks. Familiar with CI/ ...

workflows.Required Skills• Commercial experience in a Data Engineering or Data Developer role.• Strong SQL and Python programming skills.• Hands-on experience with Google BigQuery and Google Cloud Platform.• Experience implementing cloud-based data solutions.• Experience integrating Salesforce Marketing Cloud and Salesforce CRM data.• Understanding of marketing platforms, campaign metrics ...

knowledge of AWS and components such as S3, Kinesis, DMS, SNS, Glue, Athena, RDS Experience with Data Warehouse databases like Snowflake/Redshift/BigQuery Experience with Python/PySpark Experience with implementing Rest APIs. Experience with using and integrating BI tools such as QuickSight, Looker, Power BI, Tableau ...

environments. Experience with CI/CD pipelines, ideally using Azure DevOps or similar. Nice to Have Experience with Apache Airflow or dbt. Exposure to BigQuery/GCP. Azure or other cloud platform certifications Knowledge of data governance and data management frameworks Ideal experience working with financial data, regulatory reporting ...

queries for: Data validationRoot cause analysisReport troubleshootingSupport and maintain data warehouse environments, such as: Azure Synapse AnalyticsSQL Server/Azure SQL DBSnowflake or BigQuery (optional, if used in hybrid environments)Monitor ETL performance and investigate slow-running queries and data load failures. Issue Investigation & RCAInvestigate job failures and performance ...

technical business users.Delivery Frameworks: Comfortable working within Agile and Waterfall project delivery methodologies.Desirable:Cloud Infrastructure: Hands-on experience with Google Cloud Platform (BigQuery, GCP storage) or equivalent cloud providers (AWS/Azure).Programming Languages: Proficiency in Python, R, or general-purpose scripting languages.Analytics Tools: Exposure to visualisation software (e.g. ...

ideally within fintech, SaaS, or digital platforms Deep proficiency in SQL and hands-on experience with dbt Experience working with modern data warehouses (Snowflake, BigQuery, or Redshift) Familiarity with software engineering principles (Git, CI/CD, testing frameworks) Strong understanding of data visualisation and BI tools Confident communicator able ...

with clients and stakeholders.Self-sufficient, with excellent problem-solving and communication skills.Advantageous:Experience with Logic Apps and integration tools.Familiarity with data frameworks (e.g., Snowflake, BigQuery, Redshift).Knowledge of DevOps practices, CI/CD pipelines, and Infrastructure Code (e.g., Bicep, Terraform).Exposure to machine learning and AI solutions.Understanding PowerShell ...

stakeholders. Self-sufficient, with excellent problem-solving and communication skills. Advantageous: Experience with Logic Apps and integration tools. Familiarity with data frameworks (e.g., Snowflake, BigQuery, Redshift).Knowledge of DevOps practices, CI/CD pipelines, and Infrastructure Code (e.g., Bicep, Terraform).Exposure to machine learning and AI solutions. Understanding PowerShell ...

DOMO, Tableau, Looker,etc. Expert level SQL skills — complex queries, window functions, CTEs, query optimization. Experience with cloud data platforms (e.g., Snowflake, Azure Synapse, BigQuery, Databricks). Expertise in data modeling concepts: star/snowflake schemas, dimensional modeling,semantic layers, and performance tuning at scale. Experience with Python ...

/CD pipelinesExperience with managed ML platforms such as SageMaker, Vertex AI or Azure MLData engineering and MLOpsExperience with data warehouses such as Snowflake, BigQuery or RedshiftWorkflow orchestration using tools like Airflow or DagsterExperience with MLOps tools such as MLflow, Weights and Biases or similarAwareness of data and model ...

just individual pipelinesExperience designing and operating production data platforms across cloud infrastructure, orchestration, ingestion and SQL transformation layersPractical experience with GCP, BigQuery, Terraform, Kubernetes, Dagster, dlt and dbt - or equivalent tools with the ability to articulate transferable reasoningDemonstrated ability to make and document architecture decisions that involve meaningful trade ...

record of delivering improvements. Bonus points for: Ecommerce, marketing, sales or supply chain analytics experience. Familiarity with cloud data platforms such as Azure, AWS, BigQuery or Snowflake. Python, R or other analysis and automation tools. Knowledge of data pipelines, ETL or data warehousing. We are a Disability Confident Employer ...