7 Data Pipeline Jobs in West Yorkshire

Lead Data Engineer: We need some strong Data engineer profiles… they need good experience with Pyspark, Python, SQL, ADF and preferably Databricks experience Job description: Building new data pipelines and optimizing data flows using the Azure cloud stack. Building data products from scratch. Support Business Analysts and Data Architects with discovery and best practices. Self-directed and comfortable supporting the data needs of multiple teams, systems and products. What’s required ? Advanced Azure knowledge and experience working and migrating data products from … on-prem to Azure. Experience building and optimizing ‘big data' data pipelines, architectures and data sets using Py-spark. Experience building real-time data pipelines using Event-hub, storage queues and Azure stream analysis. Strong analytic skills related to working with unstructured more »

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

AWS Data Engineer | £50-60k | Fintech | Hybrid Leeds Want to work for a business that uses Data to create predictions that shape the future of fintech decision making? If so, AWS Data Engineers this one is for you... About the business 🚀 G.Digital has … how the everyday person gets closer to financial freedom! They've kicked off some exciting new projects including the development of a new Data Lakehouse and the implementation of an iPaaS solution and now they're looking to hire a Data Engineer to join their small … Python Any exposure to Terraform would be great Liaising with other areas across the business to help define requirements for new projects, including both pipeline and ETL requests What’s on offer to you? 💰 £50-60k Bonus of up to 10% Flexible working (core hours) Private health more »

a few. We are hiring for Senior Product Developer ( Full time/Fixed term contract ) Job Description:- Design, developing and testing large scale data processing systems through data pipelines and ETL's. Working closely with architects, analysts, and stakeholder to bring efficient and scalable solutions in … data processing. Skills : Specific skills we need – strong SQL, performance tuning, python for ETL frameworks and robust data warehousing experience and GCP. Strong experience in python strong knowledge of sql/plsql and ability to write performant sql queries Experience working on data pipelines … data warehouse and ETL's. GCP experience (Migration to cloud is a plus)(pub/sub, dataflow, dataproc, big query, cloud sql) knowledge in containers and container orchestration CI/CD experience version control (GIT) Orchestration tools ( airflow or cloud composer more »

in the resolution of complex user requests and ensuring a minimum of the agreed service level agreements. Maintain confidentiality in accordance with our data protection policies and procedures. Delivering to service quality KPI's that underpin the management of Masteks services Demonstrate knowledge of the specific technologies necessary … software applications, systems, and networks. Knowledge of programming languages Java, JVM, DynamoDB, AWS IAM, CloudWatch, PagerDuty, Tooling TypeScript, Node.js, SRE, AWS Data Pipeline & Visualisation and scripting is a plus. Excellent problem-solving skills with the ability to analyse complex scenarios. Outstanding communication skills, both written and verbal more »

acquisition of a new BI Developer. As a BI Developer, you will collaborate closely with cross-functional teams to understand business requirements, design data models, and develop robust BI reports and dashboards. This role will be based from the Leeds office on a hybrid working model to be … BI solutions using tools such as Power BI, Tableau, or similar. Collaborate with stakeholders to gather and analyse business requirements. Develop and maintain data models, ETL processes, and data pipelines. Create interactive dashboards and reports to provide insights into key business metrics. Optimise query performance and … ensure data accuracy and integrity. Stay updated with emerging BI trends and technologies to drive continuous improvement. Utilise real time analytics to have a meaningful impact on business performance. Requirements: Relevant Degree in Computer Science or similar field Advanced Power BI SQL & SSRS DAX Experience with cloud platforms more »

is on an exciting journey and there is no better a time to join us. The investments we are making in our people, data, and technology are leading to innovative projects; fresh possibilities have provided new ways for our people to work, learn and thrive. About us… Like … the modern Britain we serve, we're evolving. Investing billions in our people, data and tech to transform the way we meet the ever-changing needs of our 26 million customers. We're growing with purpose. Join us on our journey and you will too… What you'll … across Product & Engineering. Proven experience in hands-on software engineering using a broad range of technologies including the following: Java or Python Microservices Data pipelines and database programming such as DBT, SQL, BigQuery, Cloud Composer etc CI/CD/DevOps tooling experience e.g., GIT, Jenkins etc What more »