1 to 25 of 182 BigQuery Jobs

Senior Data Engineer Requirements: Proven experience in building and managing cloud-based data platforms (AWS Redshift/Glue, Azure Data Factory/Synapse, Google BigQuery/Dataflow). Strong programming skills in Python, SQL, and Java for data engineering tasks. Experience designing reliable, maintainable, and high-performance data pipelines ...

technological environments PREFERRED SKILLS · Airflow, dbt, Spark, Kafka, RabbitMQ, Redis. · Git, CI/CD pipelines. · Experience with data warehousing solutions such as Snowflake, Redshift, BigQuery, or Synapse. · Exposure to AI/ML workflows and model deployment. · Experience with streaming systems and real-time architecture. · Knowledge of event-driven ...

such as Spark or Hadoop. Experience with ETL/orchestration tools like Airflow, Talend or Azure Data Factory. Understanding of data warehousing solutions (Snowflake, BigQuery, Redshift or similar). Good understanding of data governance, GDPR and modern security practices. Strong problem solving skills and the ability to work with ...

developing scalable cloud solutions in Azure, GCP or AWS. Data Modelling using Kimball, 3NF or Dimensional methodologies Analytics Engineering lean, with experience within BigQuery (GCP) with data modelling in DBT and mobile/telecoms industry experience would be beneficial, with deep DBT experience being highly beneficialDepth of knowledge ...

frameworks to ingest, transform, validate, normalise, and cleanse data - preparing it for analytics, reporting, and secure storage (e.g., Amazon S3, Azure Blob Storage, BigQuery, Snowflake). Apply data quality controls, build data models, and manage storage solutions within secure and compliant environments. Develop data integration and processing pipelines, ensuring ...

frameworks to ingest, transform, validate, normalise, and cleanse data - preparing it for analytics, reporting, and secure storage (e.g., Amazon S3, Azure Blob Storage, BigQuery, Snowflake). Apply data quality controls, build data models, and manage storage solutions within secure and compliant environments. Develop data integration and processing pipelines, ensuring ...

frameworks to ingest, transform, validate, normalise, and cleanse data - preparing it for analytics, reporting, and secure storage (e.g., Amazon S3, Azure Blob Storage, BigQuery, Snowflake). Apply data quality controls, build data models, and manage storage solutions within secure and compliant environments. Develop data integration and processing pipelines, ensuring ...

frameworks to ingest, transform, validate, normalise, and cleanse data - preparing it for analytics, reporting, and secure storage (e.g., Amazon S3, Azure Blob Storage, BigQuery, Snowflake). Apply data quality controls, build data models, and manage storage solutions within secure and compliant environments. Develop data integration and processing pipelines, ensuring ...

frameworks to ingest, transform, validate, normalise, and cleanse data - preparing it for analytics, reporting, and secure storage (e.g., Amazon S3, Azure Blob Storage, BigQuery, Snowflake). Apply data quality controls, build data models, and manage storage solutions within secure and compliant environments. Develop data integration and processing pipelines, ensuring ...

Experience with managed ML platforms such as SageMaker, Vertex AI or Azure ML Data engineering and MLOps Experience with data warehouses such as Snowflake, BigQuery or Redshift Workflow orchestration using tools like Airflow or Dagster Experience with MLOps tools such as MLflow, Weights and Biases or similar Awareness ...

scalable storage design Solid engineering practices: Git and CI/CD for data systems Highly Desirable Skills GCP Stack: Hands-on expertise with BigQuery, Cloud Storage, Pub/Sub, and orchestrating workflows with Composer or Vertex Pipelines. Domain Knowledge: Understanding of sports-specific data types ( event, tracking, scouting, video ...

experience in data integration , including designing and optimising data pipelines (batch and streaming) and integrating cloud-based platforms (e.g., Azure Synapse, AWS Redshift, Google BigQuery ) with legacy systems, ensuring performance and scalability. Deep knowledge of ETL/ELT processes , leveraging tools like Apache Airflow, dbt, or Informatica , with ...

computing framework like Apache Spark (using PySpark). Familiarity with cloud data services (AWS S3/Redshift, Azure Data Lake/Synapse, or Google BigQuery/Cloud Storage). Exposure to workflow orchestration tools (Apache Airflow, Prefect, or Dagster). Bachelor's degree in Computer Science, Engineering, Information Technology ...

computing framework like Apache Spark (using PySpark). Familiarity with cloud data services ( AWS S3/Redshift, Azure Data Lake/Synapse, or Google BigQuery/Cloud Storage ). Exposure to workflow orchestration tools ( Apache Airflow, Prefect, or Dagster ). Bachelor's degree in Computer Science, Engineering, Information Technology ...

Build and maintain ETL/ELT pipelines using Python and SQL Orchestrate workflows with Airflow Work with cloud data platforms (AWS/GCP, BigQuery/Redshift) Improve data quality, monitoring, and reliability Collaborate with analysts and engineers to deliver trusted data What we're looking for: 3+ years' experience ...

clarify requirements and translate them into model updates Skills & Experience You should have: Strong SQL skills and experience working with cloud data warehouses (BigQuery, Redshift, Snowflake, etc.) Solid experience building models and transformations using dbt Understanding of dimensional modelling and data transformation principles Exposure to BI tools (Looker, Power ...

Qualifications & Experience Essential Advanced SQL skills with strong data modelling expertise (facts, dimensions, semantic layers). Experience working with modern cloud data warehouses (e.g. BigQuery, Snowflake, Redshift). Hands-on experience with analytics engineering tools (e.g. dbt). Strong understanding of ELT pipelines and data transformation best practices. Ability ...

databases (e.g., MySQL, PostgreSQL, MongoDB, Cassandra). Hands-on experience with cloud platforms (e.g., AWS, GCP, Azure) and their data services (e.g., Snowflake, S3, BigQuery, Redshift). Experience with containerisation and orchestration tools (e.g., Docker, Kubernetes). Familiarity with version control systems (e.g., Git) and CI/CD pipelines. ...

months to align legacy stacks with modern standards What they are looking for Technical experience Strong SQL experience with Redshift or BigQuery and exposure to Snowflake or another modern warehouse Proven experience building production dbt models, tests, and environments Solid understanding of dimensional modelling and Kimball principles Experience working ...

/or R for data science and automation. Solid grounding in statistics, spatial analysis, and machine-learning methodologies. Experience with spatial databases (PostGIS, BigQuery GIS, SQL Server Spatial). Ability to communicate complex spatial insights clearly to diverse audiences. Experience working with remote sensing and raster datasets. Desirable Familiarity ...

field. 5+ years of experience in data architecture, solution design, or similar roles. Strong experience with modern data platforms and technologies (e.g., Snowflake, Databricks, BigQuery, Azure/AWS/GCP data services). Deep knowledge of data modeling, APIs, event-driven architectures, and cloud-native data architectures. Proven ability ...

performance – Enhance data observability and automate key workflows for efficiency You Will Need – Advanced hands-on experience with SQL, Python, and core GCP tools (BigQuery, Dataflow, Pub/Sub, Composer or similar) – Proven background in full-lifecycle data engineering and automation – Strong understanding of CI/CD and infrastructure ...

e.g. Python ELT/ETL CI/CD Data Modelling Data Architecture Data Frameworks dbt Data processing and orchestration using Airflow or similar Google BigQuery or Redshift Cloud based services: GCP (preferred) or AWS Agentic development frameworks Automations About You 6 years+ experience as a Data Engineer solving complex ...

e.g. Python ELT/ETL CI/CD Data Modelling Data Architecture Data Frameworks dbt Data processing and orchestration using Airflow or similar Google BigQuery or Redshift Cloud based services: GCP (preferred) or AWS Agentic development frameworks Automations About You 6 years+ experience as a Data Engineer solving complex ...

Power BI Supporting self-service analytics and improving data literacy across the business Acting as an SQL subject matter expert (Postgres, Cloud SQL, BigQuery, Redshift) Using orchestration tools such as Airflow to deliver reliable, automated pipelines Contributing to IaC and CI/CD pipelines via GitHub Collaborating across engineering ...