1 to 25 of 96 BigQuery Jobs in the UK

Senior Data Engineer Requirements: Proven experience in building and managing cloud-based data platforms (AWS Redshift/Glue, Azure Data Factory/Synapse, Google BigQuery/Dataflow). Strong programming skills in Python, SQL, and Java for data engineering tasks. Experience designing reliable, maintainable, and high-performance data pipelines ...

data warehouse platform. Extremely Strong SQL skills Significant hands-on experience integrating APIs. Experience with the Google Cloud Platform/Data Stack including: BigQuery; Cloud Functions; Cloud Storage; Pub/Sub; IAM Management; Data Studio Strong working knowledge of Python for pipeline development, automation and tooling integration. Hands ...

star/snowflake) models. Build and maintain databases across platforms such as SQL Server, PostgreSQL and cloud data platforms (Azure SQL, AWS RDS, Snowflake, BigQuery). Write and optimise complex SQL, including stored procedures, functions, views and performance‐tuned queries. Develop ETL/ELT logic using SQL‐based approaches ...

based data architectures (GCP experience essential) Proficiency in Python, SQL, (epsoure to Java, Kotlin, Bash) Hands-on experience with modern data tools such as BigQuery, Dataflow, Pub/Sub, dbt, Kubernetes, or similar Experience building and maintaining data pipelines Familiarity with CI/CD, Git, Terraform, and modern engineering ...

Implement RAG architectures and manage vector databases (Pinecone, Weaviate, FAISS, Milvus) Data & Engineering Excellence Lead the evolution of modern data platforms (Databricks, Snowflake, Synapse, BigQuery) Ensure robust data engineering practices (Airflow, dbt, Prefect) and governance (Collibra, Purview) Drive scalable lakehouse architectures (Delta Lake, Iceberg, Hudi) Cloud, Infrastructure & MLOps Champion ...

related standards Strong communication and stakeholder management skills, including engaging senior stakeholders Proven leadership, mentoring, and team-building capabilities Tech Stack: Google Analytics Google BigQuery Looker Studio Google Tag Manager Desirable Experience: Experience in public sector or citizen services (eg, benefits systems) Exposure to government frameworks or large-scale ...

data engineering, analytics engineering, or technical analytics Strong SQL skills, including joins, window functions, and performance tuning Experience with Databricks, Snowflake, or BigQuery Strong data modelling experience, ideally with dbt Experience with BI tools such as Omni, Power BI, Tableau, Looker, or Sigma Strong stakeholder management and communication skills ...

their products (S3, GCS, Kinesis, Pub/Sub, Lambda/Cloud functions, DataProc) Experience with one of the main databases for analytics (Redshift, BigQuery, Snowflake or other). Nice to have Experience modelling and transforming data from event collection to report curation, especially for e-commerce or affiliate businesses ...

Delta Lake.• Position AWS solutions effectively against other cloud platforms' offerings in both generative AI (Azure OpenAI, Vertex AI) and data platforms (Azure Synapse, BigQuery)• Guide architectural decisions on build vs. buy for both Al capabilities and data platform componentsExperience* Deep experience with generative AI technologies: Amazon Bedrock, Amazon ...

Qualifications: Proficiency in Python, Scala, and SQL. Extensive experience in data modelling and ELT/ETL processes. Strong experience with Google Cloud Platform, including BigQuery, Dataflow, Pub/Sub, and Composer. Familiarity with CI/CD & DevOps practices, including automated testing and infrastructure as code. Experience in implementing data ...

migration pipelines, including support for legacy DataStage decommissioning and modernisation. Work with a variety of database technologies including relational, NoSQL, MPP and columnar stores (BigQuery, Redshift, Azure SQLDW, HBase, MongoDB). Build optimised, scalable data models. Apply performance tuning and optimisation across storage. Ensure secure handling of data including ...

leadership roles Strong hands-on experience across: Azure cloud, ADF, DevOps, Power BI, Fabric workspaces AWS cloud, S3, cross-cloud connectivity, API Gateways GCP (BigQuery, GCS, Dataflow) Deep expertise in: Databricks (Lakehouse architecture, Delta Lake, Unity Catalog, Delta Sharing, Pyspark, Spark SQL etc.) Snowflake (data warehousing & data sharing, Iceberg ...

experience — proven track record building big data processing platforms in production, moving beyond scripting to robust engineering solutions (e.g., Databricks/Delta Lake, Snowflake, BigQuery). Hands-on experience architecting Data Warehouses and Data Lakes. API and service design maturity — experience designing multi-service systems with attention to schema ...

build and maintain resilient data platforms using bronze, silver and gold data modelling frameworks. You will develop scalable data pipelines using Python, working with BigQuery to support advanced analytics and high-performance reporting. You will be responsible for integrating data from Dynamics 365, shaping data models and delivering high ...

Hands-on experience working with at least one OLAP-specific engine or analytical data warehouse technology (such as Apache Druid, ClickHouse, Amazon Redshift, Google BigQuery or Snowflake) to build scalable reporting solutions. Confidence can sometimes hold us back from applying for a job. ...

time data pipelines Knowledge of microservices and distributed systems Tech & Cloud Experience with AWS, Azure, or GCP (AWS preferred) Familiarity with Databricks, Snowflake, or BigQuery Engineering Practices Strong in testing, CI/CD, Git Experience with Terraform, Docker, Kubernetes Experience 3+ years in data engineering Agile experience and strong ...

generative AI), plus the ability to communicate value to diverse audiences. Data Stack Knowledge - Deep expertise in modern cloud data platforms (Snowflake, Databricks, BigQuery, Redshift) and data ingestion patterns (batch, streaming, CDC). Hands‐On Development - Proficiency in programming (e.g., JavaScript, Python, SQL, R) and data frameworks like pandas ...

pipelines. Proficient SQL skills for data analysis, validation, and troubleshooting. Experience working with data warehouses, data lakes, or big data platforms (e.g., Snowflake, Redshift, BigQuery, Spark). Engineering Practices & Tooling Experience with CI/CD pipelines and automated build and deployment processes. Strong experience with version control systems ...

pipelines. Proficient SQL skills for data analysis, validation, and troubleshooting. Experience working with data warehouses, data lakes, or big data platforms (e.g., Snowflake, Redshift, BigQuery, Spark). Engineering Practices & Tooling Experience with CI/CD pipelines and automated build and deployment processes. Strong experience with version control systems ...

experience as a Data Engineer with solid foundations in SQL and dimensional modelling Experience working with Snowflake or similar cloud data warehouses such as BigQuery Good Python capability, including orchestration tools such as Airflow Proven experience building and managing data ingestion pipelines Cloud experience within AWS or GCP environments ...

surfaces you ship. Strong working knowledge of how to store and query large datasets at scale : SQL fundamentals; relational (e.g., Postgres), analytical (e.g., BigQuery, Snowflake), and embedded (e.g., SQLite) stores; and object storage with caching layers. Familiarity with ML workflow orchestration and experiment tracking (e.g., Kubeflow Pipelines, MLflow). ...

Real experience as a Data Engineer, building pipelines and doing data analysis not just exposure to it. Hands-on experience with Google Cloud, specifically BigQuery, Cloud Run and DBT Cloud. Version control and CI/CD experience, ideally with GitLab. Familiarity with Jira and Confluence. Nothing exotic ...

generative AI), plus the ability to communicate value to diverse audiences. Data Stack Knowledge – Deep expertise in modern cloud data platforms (Snowflake, Databricks, BigQuery, Redshift) and data ingestion patterns (batch, streaming, CDC). Hands‐On Development – Proficiency in programming (e.g., JavaScript, Python, SQL, R) and data frameworks like pandas ...

running tasks, error-recovery* Backend: Django (5.x+), DRF, FastAPI, Pydantic, Celery, Django Channels, Flask, RESTful APIs.* Databases & Storage: PostgreSQL, MS SQL Server, MongoDB, Firestore, BigQuery, Azure Blob Storage.* Cloud & DevOps: Azure (App Services, OpenAI, AKS), GCP (Vertex AI, Cloud Run), Docker, GitHub Actions, Azure DevOps, RBAC and Cost Controls. ...

business (who own the products). Key Requirements/Person Specification Technical Proficiency: Deep hands‐on expertise with GCP data and analytics services (BigQuery, Dataflow, Pub/Sub, IAM, monitoring), plus working knowledge of Databricks and/or Snowflake in federated enterprise environments. Strong understanding of modern data architectures ...