1 to 25 of 287 Permanent Data Pipeline Jobs in England

Data Engineer Consultant - Data & AI (DV Cleared/Eligible)65,000 – 75,000 + packageLocation: United Kingdom (Greater Manchester – Manchester, Greater Manchester) Type: PermanentData Engineer Consultant - Data & AI (DV Cleared/Eligible)Location: ManchesterSalary: 65k - 75kAbout the Role:Our client, a leading consultancy in … the Defence & Security sector, is seeking a skilled Data Engineer to join their AI & Data Engineering team. This pivotal role offers the opportunity to be at the forefront of advanced technology projects aimed at enhancing national security. The position is perfect for individuals who are passionate … data security and quality across projects.Qualifications and Skills:Proven experience in data engineering, particularly with ETL processes, data pipeline construction, and workflow orchestration.Familiarity with distributed computing techniques, such as parallel processing and batch data management.Strong foundation in data system more »

Data Engineer Consultant - Data & AI (DV Cleared/Eligible)65,000 – 75,000 + packageLocation: United Kingdom (Bristol – Bristol) Type: PermanentData Engineer Consultant - Data & AI (DV Cleared/Eligible)Location: BristolSalary: 65k - 75kAbout the Role:Our client, a leading consultancy in the Defence & Security … sector, is seeking a skilled Data Engineer to join their AI & Data Engineering team. This pivotal role offers the opportunity to be at the forefront of advanced technology projects aimed at enhancing national security. The position is perfect for individuals who are passionate about leveraging their … data security and quality across projects.Qualifications and Skills:Proven experience in data engineering, particularly with ETL processes, data pipeline construction, and workflow orchestration.Familiarity with distributed computing techniques, such as parallel processing and batch data management.Strong foundation in data system more »

Data Engineer Consultant - Data & AI (DV Cleared/Eligible)65,000 – 75,000 + packageLocation: United Kingdom (London – London) Type: PermanentData Engineer Consultant - Data & AI (DV Cleared/Eligible)Location: LondonSalary: 65k - 75kAbout the Role:Our client, a leading consultancy in the Defence & Security … sector, is seeking a skilled Data Engineer to join their AI & Data Engineering team. This pivotal role offers the opportunity to be at the forefront of advanced technology projects aimed at enhancing national security. The position is perfect for individuals who are passionate about leveraging their … data security and quality across projects.Qualifications and Skills:Proven experience in data engineering, particularly with ETL processes, data pipeline construction, and workflow orchestration.Familiarity with distributed computing techniques, such as parallel processing and batch data management.Strong foundation in data system more »

Truth Builds Trust If our mission, values, and purpose align with your own, we would love to hear from you! Your opportunity The Data Engineer is a crucial member of the Finance Analytics technology team, tasked with developing, managing, and optimizing data pipelines within our data ecosystem. The Data Engineer will leverage cutting-edge technology in Snowflake, Python, Informatica, and Azure to improve our data capabilities and support our Finance business partners in their decision-making processes. Key responsibilities include: Design, build, and maintain efficient, reliable data pipelines … use within our subsidized onsite canteen Must have skills Experience as a Data Engineer, with a solid background in data pipeline construction and data architecture using Snowflake, Python, and Informatica Familiarity with Azure and other cloud-native technologies Understanding of finance industry data more »

Data Engineer We are seeking a Data Engineer to join our friendly team. Our client is building a new data platform centred around a Microsoft SQL server-based data warehouse that runs on AWS RDS. This role is crucial in expanding our … client's data capabilities and supporting the launch of our new platform and mobile app. Key Responsibilities: Support and maintain the central Data Platform, ensuring its availability and performance to meet business needs. Build data pipelines to connect APIs, files, databases, and data streams to our client's Data Platforms. Shape data from various sources into a transactional ODS for detailed reporting and a Kimball-modelled Data Warehouse for analytics and dashboards. Define and embed data quality measures within data pipelines. more »

experienced AWS Cloud Architect to design AWS reference architecture for our services-led client. Responsibilities: Design and implement scalable, secure, and high-performance data architectures on AWS. Develop data models and database designs that align with business requirements and ensure data integrity. Proficiency in … or AWS CodePipeline. Hands-on experience with Infrastructure as Code (IaC) tools like AWS CloudFormation, Terraform, or similar. Create and maintain ETL processes, data pipelines, and data integration workflows using AWS services. Implement data storage solutions, including data lakes, data warehouses, and operational databases. Provide technical leadership and guidance on AWS data services and architecture to the team. Requirements: Proven experience as an AWS Data Architect or similar role, with a strong focus on data architecture and management. In-depth knowledge of more »

Key Responsibilities Assist the Data Team Lead in system improvements. Develop, maintain, and troubleshoot software components. Identify and solve data/software issues. Collaborate with stakeholders and peers. Plan tasks and deployments. Conduct peer reviews and advocate for best practices. Ensure compliance with IT and Security … policies. Essential Technical Skills 2-3 years Azure data systems experience. Proficiency in traditional Data Warehouse tools. Understanding of Dimension Modelling. Strong SQL skills. Knowledge of Azure Data Lake, Data Factory, Databricks, and Functions. Essential Experience Support for Data Warehouses. … Building Azure data pipelines. Agile methodology experience. Problem-solving skills. Awareness of industry trends. Stakeholder engagement. Desired Experience Business Objects Reporting. Power BI familiarity. more »

Data Technical Lead Location: Hybrid - London Package: Negotiable + Benefits Brown & Brown, Inc. is one of the largest insurance brokers globally having in excess of $4bn revenue in 2023 by providing risk management solutions to help protect what our customers value most. We have experienced significant growth over … size of the business by improving customer experience, growing organically and acquiring, accelerating knowledge and capabilities of teammates and using technology with purpose. Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them … to provide great customer service and grow through the provision of superior data services As a Technical Lead for our Data Team, you will play a critical role in shaping our data strategy, driving technical excellence, and ensuring the successful delivery of data more »

Data Analyst - Hybrid Working Are you a talented Data Analyst seeking a challenging and business critical role within a highly successful global product company who have developed a world renowned brand? Are you looking for the next phase of your career through progressing your technical knowledge … and joining an established and accomplished data management team ? If so this could be the role for you... Why Would you Join? Competitive salary with annual reviews Generous Bonus Scheme Private medical care Finish early on a Friday 25 days holiday Hybrid working - 3 days in the office … days WFH (work from home) Beautiful brand new refurbished office The Opportunity As a data analyst you will conduct data analysis having first selected appropriate statistical methods and provide insights and recommendations based on investigations including deep dives into any relevant metrics. The successful data more »

GOAT Interactive is looking for a Junior Data Engineer to join our Data Engineering team, this role will be responsible for the development, testing, and maintenance of data pipelines and data storage systems on Google Cloud Platform (GCP). You will be … working with technologies such as Apache Airflow, BigQuery, Python, and SQL to transform and load large data sets, ensuring high data quality and accessibility for business intelligence and analytics purposes. Our business is growing quickly and with that so the scale of our data, we are currently working on several initiatives to improve our data solution and you would become an integral part of this. Key Responsibilities Design, construct, install, test, and maintain data pipelines. Ensure systems meet business requirements and industry practices for data integrity more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

Data Engineer – SAS/SQL/Power BI * Sponsorship is not available with this position * Role – Data Engineer Salary – Up to £75k DOE Location – Manchester or London (Hybrid) A well established and award-winning Data consultancy are looking to add a Senior Data Consultant to join their talented data team. You’ll be at the centre of everything they do as a business, supporting a range of top tier clients. The position is offering a basic salary up to £75,000 depending on experience as well as a discretionary … Flexible working environment Inclusive and friendly culture Private Medical Insurance Buy and Sell additional annual leave Funded Learning and development programmes The Successful Data Engineer will have: Experience in developing and designing data pipelines and ETL processes Previous experience of data warehousing Utilise SAS more »

DATA ENGINEER – UP TO £60,000! Location : Sheffield Benefits: 25 Days + Bank Holidays! Life Assurance! Flexible Working! Company: A chance to have a positive societal impact if you launch yourself into a fast growing, but firmly established, company in the much sought after EdTech sector APPLY NOW … Responsibilities: To build and maintain scalable data pipelines To gather requirements and deliver data projects To document processes and data pipelines To maintain a backlog of future improvements/… features in Jira To build effective relationships with technical and non-technical colleagues Requirements: Should have exceptional SQL skills Should have data pipeline development experience in Python Should have experience with AWS tools including Glue & Lambda Should have an understanding of CI/CD concepts Should have more »

Senior Data Engineer Location: London (2 days a week in office) Salary: £75k - £90k (DOE) About the Company: Our client, a leading technology-driven organization, is seeking a talented and experienced Senior Data Engineer to join their dynamic team. The company prides itself on fostering innovation … edge technology to drive business success. This is a fantastic opportunity to work with a team of experts who are passionate about harnessing data to create impactful solutions. Key Responsibilities: • Design, develop, and maintain robust ETL (Extract, Transform, Load) processes to ensure efficient data flow and … integration across various systems. • Utilize Python for data manipulation, transformation, and automation tasks. • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality solutions. • Implement data pipelines and workflows to support real-time and batch data more »

LEAD DATA ENGINEER LONDON BASED £80,000-90,000 PER ANNUM This Real estate company is searching for a new Lead Data Engineer, to Revolutionise their expanding Data and Analytics team, and help build out brand new Data pipelines using Python and … SQL. You will also be responsible for building a new Data platform in GCP. THE COMPANY This growing company are searching for a new Lead Data Engineer, to own the technical direction of their expanding Data and Technology team. They have been investing heavily … in their data team over recent years, and are a very data-focused business. THE ROLE Joining this team as a Lead data engineer, you will be responsible for building the company's next-generation data platform using GCP. This role has more »

Full Stack Developer/Data Engineer opportunity. Full time permanent position. Fully remote or hybrid - office just outside of London. My client is a dynamic and rapidly growing electrification company dedicated to the decarbonisation of heat transport and induction. They have years of experience from across the energy … sector in integrating and connecting renewable generation, EV charging and the digitalisation of energy. They are seeking a Full Stack Developer/Data Engineer with Data bricks expertise to help tackle exciting challenges in the energy sector. In this role, you will: Develop and scale energy … solutions: Bring ideas to life, building robust and scalable applications from proof-of-concept to deployment, working alongside the Energy Solutions team. Design data pipelines for smarter energy: Craft and manage data pipelines using Databricks, integrating best-in-class demand forecasts to optimize energy use. Enhance more »

Leading ecommerce client now requires a Data Engineer to join their innovative Machine Learning team. This role will focus on increasing overall data efficiency using Machine Leaning, streamlining data processes to increase overall profitability, and ensuring our clients operations and customer teams can increase … strong exposure to Machine learning principles/practices and technologies such as ML flow/Sage Maker. The role: Develop robust and scalable data pipelines. Collaborate with cross-functional teams to develop and deploy Machine Learning models and algorithms to solve business challenges and create opportunities. Contribute to … the development of our clients in-house Machine Learning operations framework. Support the data science and analytics team in deploying pipelines. Coach and mentor the team to improve development standards. Key requirements: Strong hands-on experience with Databricks, Spark, SQL or Scala. Proven experience designing and building data more »

Engineering in sculpting and realising the strategic vision, enhancing the analytical prowess of the Actuarial team. Embrace the challenge of refining operations through data automation and harnessing cutting-edge technologies. Key Essentials: Proficiency in Python, SQL, and PowerBI is paramount. Experience with Azure or APIs is highly advantageous. … standards. Showcase technical prowess in Python, SQL, and JSON. Implement and oversee a robust CI/CD process. Enhance Azure modules, advancing automated data pipelines. Question conventional analysis and design, advocating for innovative alternatives. Articulate technical design principles to non-technical stakeholders. Propose enhancements to data efficiency and reliability. Represent the actuarial engineering perspective in key forums and authorities. Explore and introduce new tools for data management and analysis. To apply, please submit your CV and a cover letter detailing your relevant experience and how you can contribute to the success of more »

Data Engineer required for a 6 month initial contract with a leading commodities trading firm. Outside of IR35 Hybrid working - 2/3 days in London office Experience Required: - Commodities industry … experience Weather forecasting Airflow (or equivalent data orchestration platforms) Data Modeling (Star Schema) Data Warehousing Data Pipeline Orchestration (Kafka) On-Prem SQL more »

Amazon Redshift, Amazon EMR, Amazon Athena, Amazon Sagemaker and more. Help our customers to remove the constraints that prevent them from leveraging their data to develop business insights Create white papers, writing blogs, build demos and other reusable collateral that can be used by our customers. Work closely … with our Solution Architects, Data Scientists and Service Engineering teams Experience with design, development and operations that leverages deep knowledge in the use of services like Amazon Kinesis, Apache Kafka, Apache Spark, Amazon Sagemaker, Amazon EMR, NoSQL technologies and other 3rd parties Develop and define key business questions … needs of enterprises Basic understanding of machine learning fundamentals Ability to take Machine Learning models and implement them as part of data pipeline IT platform implementation experience Experience with one or more relevant tools ( Flink, Spark, Sqoop, Flume, Kafka, Amazon Kinesis) Experience developing software code in one more »

Job Title: Software Engineer (Rust/HPC/Real Time Data) Client: Elite Tech Firm Salary: Up to £200k 1st Year Compensation Location: London Sells: Cutting-edge tech, ownership of multiple greenfield projects, no red tape, a friendly/collaborative environment, beautiful offices, personal projects on Fridays! An … as part of a team of engineers looking after and building a zero-down time low latency solutions for multi petabyte/exabyte data sets Working heavily in Rust Building/Optimising some of the world's most advanced data pipelines Collaborating with ML Engineers, Data … with other incredibly passionate technologists Skills: 5+ years experience working as a Software Engineer ideally using Rust Outstanding CompSci Fundamentals needed! Knowledge of data engineering principles/data lake architectures - Arrow/Parquet etc. Excellent knowledge of low-level concepts (e.g. compilers, x86, LLVM etc. more »

Job Overview Position: Senior Data Engineer In this role, you will be responsible for storing, processing, modeling, and applying data science to ensure that data and insights are available for data analytics and business intelligence (BI) systems. You must be proficient in … data assessment and profiling, source system analysis, and providing a clear vision for processing and interpreting data to support its end-use. Ideal Candidate Profile The ideal candidate will have a background in Data … Engineering or Data Warehousing (Data Engineer/DW Developer) with robust DW development and ETL/ELT data pipeline experience, along with expert knowledge of SQL. Key Skills - Mandatory Strong data modeling and SQL/database design skills Proficiency in ETL more »

We are seeking an experienced Python Data Engineer Consultant to join a leading hedge fund. The ideal candidate should have a proven ability to design and implement data solutions, with expertise in extracting, transforming, and loading (ETL) data from various sources, including websites, PDFs … and Real Time data streams. Role: Python Data Engineer Client: Leading Hedge Fund Type of role: contract (6 months) Location: London office Rate: up to £1500/day Key Responsibilities: Architect, develop, and optimize data pipelines for extracting, transforming, and loading data from diverse alternative data sources, such as web scrapes, PDF files, and Real Time data infrastructures. Implement and manage database solutions in SQL Server and various cloud-based environments, ensuring data integrity, efficiency, and accessibility. Build and maintain Real Time data more »

Working with a top tier Digital Asset Management firm who are looking for an adept and experienced Data Engineer to play a critical role in shaping and managing their data engineering platform. This role demands strong technical skills and a proven ability to work closely with … quantitative researchers, ensuring seamless integration of data engineering processes to support our quantitative investment strategies. Key Responsibilities: Collaborate closely with quantitative researchers to understand their data needs, offer technical solutions, and effectively integrate data engineering with quantitative strategies. Design, develop, and optimize robust data pipelines, facilitating ETL processes that support quantitative research, analysis, alpha forecasting, and execution. Implement stringent data quality assurance measures to ensure the accuracy, reliability, and consistency of data inputs and outputs. Evaluate, select, and manage appropriate data engineering tools, technologies, and infrastructure more »

Senior Data Engineer (AWS) up to 90k London - 2/3 days a week My Client is an exciting scale up focused on the Art world, looking for a Senior Data Engineer to join a team of software engineers, data engineers, data scientists, and analysts. You will be responsible for designing and constructing reliable data pipelines. You will leverage the most advanced data engineering and Python tools to ensure the most efficiency and effectiveness in your work. Responsibilities: Collaborate with the team to design, test, and … implement scalable and secure data pipelines that meet business needs. Maintain the integrity of data by ensuring good quality. Monitoring pipelines for optimal performance and minimal downtime. Adapt data models to accommodate changing business requirements in collaboration with other teams. Collaborate with other teams more »