12 of 12 Databricks Jobs in Newcastle upon Tyne

explain and implement the concepts and principles of data modelling. Ability to create and run simple unit tests. Desired Qualifications Certifications in AWS, Azure, Databricks, or related technologies. Example Experience with public sector data initiatives and compliance requirements. Knowledge of machine learning and artificial intelligence concepts. Where you’ll work ...

practices across the project lifecycle Key Skills & Experience we’re looking for: Strong background in data engineering and software development Proven experience working with Databricks (essential) Hands-on expertise with tools such as Python, PySpark, Spark, and SQL Experience building and maintaining data pipelines and data platforms Solid understanding ...

Data Engineering Testing tools like Great Expectations, dbt, pytest and data validation frameworks Experience of testing data platforms such as Snowflake, BigQuery, Redshift, Databricks, Azure Synapse Experience of testing pipelines in things like Airflow, Azure Data Factory, AWS Glue, Kafka Data Concepts ETL/ELT, data modelling, data warehousing, data ...

Data Engineering Testing tools like Great Expectations, dbt, pytest and data validation frameworks Experience of testing data platforms such as Snowflake, BigQuery, Redshift, Databricks, Azure Synapse Experience of testing pipelines in things like Airflow, Azure Data Factory, AWS Glue, Kafka Data Concepts ETL/ELT, data modelling, data warehousing, data ...

real-time data pipelines Knowledge of microservices and distributed systems Tech & Cloud Experience with AWS, Azure, or GCP (AWS preferred) Familiarity with Databricks, Snowflake, or BigQuery Engineering Practices Strong in testing, CI/CD, Git Experience with Terraform, Docker, Kubernetes Experience 3+ years in data engineering Agile experience and strong ...

Gold layers of our Medallion Architecture, and all the way to analytics, AI and self‐service reporting. Working within the Microsoft Azure and Databricks ecosystem, you’ll help build a data platform that’s scalable, flexible and built to last. Your work will directly support high‐impact use cases, including … zone into the Bronze layer, working in partnership with the Development and Application Management team. Design and optimise ETL/ELT pipeline frameworks using Databricks, Delta Lake and Azure Data Factory. Ensure Silver and Gold layer data products are fit for purpose for analytics, pricing, AI and ML model consumption. ...

A leading insurance company in Newcastle upon Tyne is seeking a Data Architect to define architectural standards and manage the data solution frameworks. You'll be responsible for the design and governance of the Medallion ...

deliver solutions that support business objectives What We're Looking For Strong experience designing and building scalable data pipelines Proficiency in SQL, Python, Databricks or AWS Experience with tools such as Git and Airflow Proven ability to test, troubleshoot and improve data platforms Experience delivering high-quality, reliable data solutions ...

Lead Data Engineer - Python/SQL/Spark/Databricks is required by highly successful and fast growing technology consultancy. As a Lead Data Engineer, you'll be part of a team building innovative products. You should be skilled in problem-solving and experienced in designing scalable, resilient, and fault ...

Data Engineer - Python/SQL/Spark/Databricks is required by highly successful and fast growing technology consultancy. As a Data Engineer, youll be part of a client team building innovative products. You should be skilled in problem-solving and experienced in designing scalable, resilient, and fault-tolerant architectures. … pipelines One or more programming languages, typically Python and SQL Some or all of the following: Distributed computing frameworks such as Spark or Databricks Cloud platforms such as AWS, Azure or GCP Orchestration tools such as Airflow Test, troubleshoot and improve data products, ensuring reliability and quality You will have ...

Lead Data Engineer - Python/SQL/Spark/Databricks is required by highly successful and fast growing technology consultancy. As a Lead Data Engineer, you'll be part of a team building innovative products. You should be skilled in problem-solving and experienced in designing scalable, resilient, and fault … pipelines One or more programming languages, typically Python and SQL Some or all of the following: Distributed computing frameworks such as Spark or Databricks Cloud platforms such as AWS, Azure or GCP Orchestration tools such as Airflow Test, troubleshoot and improve data products, ensuring reliability and quality You will have ...

DevOps Engineer – BPSS/SC role 5-6 Month Contract Newcastle upon Tyne – Hybrid Working OUTSIDE IR35 - £400 Per Day One of my national consultancy clients’ is looking for 2 DevOps Engineers, to support one ...