32 Data Pipeline Jobs in the North of England

the forefront of our journey to Net Zero. Because of this though, they currently use a lot of third parties to store their data and are looking to build out an internal risk function to utilise data more efficiently. You'll get involved in immediately organising … the data structures, building out a Data Warehouse and data pipelines from the multiple data sources. From there you'll start including other data sources including telephony and others to strengthen Risk decision making. It will be your job to … bolster the current Risk function, helping to build better models using Credit Risk Data to allow them to compete across multiple financial sectors. It's a great opportunity to build an overall risk profile, refine the decision engines and eventually manage the processes overall! What you'll need more »

Xpertise is seeking a series of Data Engineers with cloud experience to join a fledgling team in Newcastle. As part of our client's growing engineering division, you will play a pivotal role in leading the data engineering capabilities, working closely with Platform Engineers, Developers, and … and even venture into the world of MLOps/AIOps. Key experience desired/what you will learn: Design, develop, and maintain scalable data pipelines and ETL processes leveraging GCP services such as BigQuery, Dataflow, and Cloud Storage. If you have experience across AWS and Azure, we can … practices to ensure compliance and data integrity. Monitor and troubleshoot data pipelines, ensuring high availability and reliability. CI/CD pipeline automation utilising GitLab DevOps: GKE (Kubernetes), Terraform, Ansible Leadership capabilities: mentorship, management Role overview: If you're eager to collaborate with a driven team more »

Council, Sparks – Engagement Champion to name a few. We are hiring for Senior Product Developer Job Description:- Design, developing and testing large scale data processing systems through data pipelines and ETL's. Working closely with architects, analysts, and stakeholder to bring efficient and scalable solutions in … data processing. Skills : Specific skills we need – strong SQL, performance tuning, python for ETL frameworks and robust data warehousing experience and GCP. Strong experience in python strong knowledge of sql/plsql and ability to write performant sql queries Experience working on data pipelines … data warehouse and ETL's. GCP experience (Migration to cloud is a plus)(pub/sub, dataflow, dataproc, big query, cloud sql) knowledge in containers and container orchestration CI/CD experience version control (GIT) Orchestration tools ( airflow or cloud composer more »

our distinct culture, and our dedication to in-person collaboration sets us apart.About the roleWe're looking for Principal Software Engineers to build data products and help us improve our platform potential. Auto Trader makes data-informed decisions; we discuss and build solutions together, identifying areas … and patterns in how we use our data, enabling our platform users to self-serve their needs. We have teams working on a wide range of applications; from building the core data platform capabilities through to teams using insight to build specialized user experiences for our … customers. We are at the cutting edge of applying data technologies to solve problems and you can expect to work with a range of technologies including dbt, Kotlin/Java, Python, Apache Spark and Kafka.Join us as a Principal Software Engineer and, as well as shaping and creating more »

acquisition of a new BI Developer. As a BI Developer, you will collaborate closely with cross-functional teams to understand business requirements, design data models, and develop robust BI reports and dashboards. This role will be based from the Leeds office on a hybrid working model to be … BI solutions using tools such as Power BI, Tableau, or similar. Collaborate with stakeholders to gather and analyse business requirements. Develop and maintain data models, ETL processes, and data pipelines. Create interactive dashboards and reports to provide insights into key business metrics. Optimise query performance and … ensure data accuracy and integrity. Stay updated with emerging BI trends and technologies to drive continuous improvement. Utilise real time analytics to have a meaningful impact on business performance. Requirements: Relevant Degree in Computer Science or similar field Advanced Power BI SQL & SSRS DAX Experience with cloud platforms more »

part of our client's growing engineering division, you will play a pivotal role in designing, implementing, and optimising machine learning models and data pipelines. With a strong emphasis on AWS technologies and MLOps practices, you'll have the opportunity to contribute to the development of scalable, production … what you will learn: Experience developing, deploying, and maintaining machine learning models in production environments. AWS cloud services, especially in building and managing data pipelines and machine learning workflows: S3, Redshift, Lambda, Glue, EMR, EKS (Kubernetes) Familiarity with MLOps/DevOps concepts and practices, including version control, CI …/CD, and model monitoring. Proficiency in Python and relevant data manipulation and analysis libraries (e.g., pandas, NumPy). Experience with distributed computing frameworks like Apache Spark is a plus. Apache Spark and Airflow would be a bonus. Role overview: If you're looking to work with a more »

If you’re looking to work for a business that is taking data seriously and has big plans for its data offering, then the below should be of interest. You’ll be working for a digital agency that is looking to utilise data as … a major part of it’s transformation strategy. You’ll build working relationships with key stakeholders to gather data requirements and generate actionable insights and reports to drive key business objectives. The company offers a huge amount of development opportunities and provides investment for you to upskill in … experience in: PostgreSQL (other relational databases are fine but this is the preference) Tableau for BI reporting and visualisations DBT for build of data pipelines and warehouse work. Why you would want this job: There’s a huge amount of scope. It’s a new role within the more »