76 to 100 of 336 Data Pipeline Jobs in England

Senior Data Engineer (Inside IR35) - £700 to 825 per day Location: Remote/Hybrid (London) Rate: £825 per day Contract: Inside IR35 Are you an experienced Data Engineer with a strong background in banking? Our client are seeking Senior Data Engineers to contribute to … innovative data projects within a leading financial institution. Key Responsibilities: Data Engineering: Design and implement data models, ETL processes, and data warehousing solutions. Programming: Utilize Python, Java, Scala, or GoLang to build and optimize data pipelines. Distributed Processing: Work with … Hadoop, Spark, and other platforms for large-scale data processing. Real-Time Data Streaming: Develop and manage pipelines using CDC, Kafka, and Apache Spark. Database Management: Handle SQL databases like Oracle, MySQL, or PostgreSQL. Data Governance: Ensure data quality, security, and compliance more »

Lead Data Engineer (Java/Python/AWS/Glue/Dremio). Investment Management. £160,000 - £170,000 + 25% Bonus Target and Benefits. Hybrid 2 Days a week in St Pauls Office. CANNOT SPONSOR CANNOT SPONSOR My client is a top tier multi asset investment management … house based in Central London. The Data Office team is playing a key role in helping build the future of financial services, working together with business partners to create client experiences that are changing the way people invest. You will work with smart, talented people across our business. … platform’s architectural design Development and testing of the integration, modelling, data persistence and querying tools and analytical systems Data pipeline implementation, maintenance and testing Metadata management processes and tools Monitoring the overall performance and stability of the pipelines Implementing data curation, metadata more »

Senior Data Engineer. Java/Python/AWS. Investment Management. £135,000 - £145,000 + Discretionary Bonus and Benefits. Cannot sponsor Visa. The Data Office team at my client is playing a key role in helping build the future of financial services, working together with business … view to the table—because that is how they help their clients succeed. You will be an individual contributor on the Analytics and Data Platform engineering team responsible for architecting, building, testing, and maintaining the data platform. You will be responsible for: Contributing to the … platform’s architectural design Development and testing of the integration, modelling, data persistence and querying tools and analytical systems Data pipeline implementation, maintenance and testing Metadata management processes and tools Monitoring the overall performance and stability of the pipelines Implementing data curation, metadata more »

Group Head of Data Engineering & Governance Are you an accomplished Head of Data Engineering & Governance looking for the next move in your career? InX are currently working on a retained Search basis with a Financial Services organisation to place a Group Head of Data in the CIO's senior management team. The Role As the Group Head of Data Engineering & Governance, you will be responsible for leading the data engineering team in designing, implementing, and maintaining scalable data pipelines and infrastructure. You will collaborate closely with … cross-functional teams to ensure the integrity, availability, and security of the organisation's data, while also driving innovation in data engineering practices. You will work closely with the Data Science and Analytics team (which sits outside of the remit of this position) but more »

Senior Data Engineer. Java or Python and AWS. Investment Management. 12 month rolling Fixed Term Contract. £135,000 - £145,000 + 15% Guaranteed Bonus paid monthly + Benefits including health, holidays and 13% pension. Cannot Sponsor. CANNOT SPONSOR The Data Office team at my client is … view to the table—because that is how they help their clients succeed. You will be an individual contributor on the Analytics and Data Platform engineering team responsible for architecting, building, testing, and maintaining the data platform. You will be responsible for: Contributing to the … platform’s architectural design Development and testing of the integration, modelling, data persistence and querying tools and analytical systems Data pipeline implementation, maintenance and testing Metadata management processes and tools Monitoring the overall performance and stability of the pipelines Implementing data curation, metadata more »

About Tredence: - Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions at scale –empowering end users to improve decision … strategically and execute methodically. Develop and manage capacity and growth projection forecasts of the environment within budgets. Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional/non-functional business requirements. Drive optimization, testing and tooling to improve quality … years of relevant experience At least two years of experience building and leading highly complex, technical engineering teams. Strong hands-on experience in Data bricks Experience managing distributed teams preferred. Strong technical experience in large distributed systems, Data Warehousing, Data Lake at scale Project more »

Senior Data Engineer Python, SQL, Big Data Frameworks London - 4x a week £80-90,000 + bonuses Seeking a skilled Data Engineer to join a company specialising in quantitative trading and investment management. This role is pivotal in building and maintaining the infrastructure that … supports their cutting-edge trading strategies. Key Responsibilities: Design and manage scalable data pipelines. Integrate data from various sources and develop ETL processes. Optimise database systems for high performance. Work with data scientists and analysts to meet data needs. Automate data processing tasks to enhance efficiency. Implement data security measures and ensure compliance with industry standards. Requirements: Master’s degree in Computer Science, Engineering, Mathematics, or related field from a top uni. Proven experience as a Data Engineer, preferably in the financial services or hedge more »

Data Engineer Opportunity – AI for Finance Leader in London - £75,000-£85,000 Harrington Starr are currently partnered with an AI/Data leader within the Financial Services space in London. Their ground-breaking software is helping investors to achieve superhuman performance. In order to support … further growth, we are looking for a Data Engineer skilled in the following. What will you be doing? Work on a web scraping platform for one of the firm’s largest clients Develop solutions to parse and process tabular data from PDF and HTML documents Maintain … support and expand existing data pipelines using DBT, Snowflake and S3 Implement standardised data ingress/egress pipelines Onboard new, disparate data sets, sourced from many and varied data vendors, covering all asset types and frequencies from daily to real-time Liaise more »

Senior Data Engineer | Full Time | On-Site | Python | SQL | DataBricks| Azure| As a Senior Data Engineer, you will play a key technical role in design, implementation, and continuous refinement of data pipelines and architectures within Microsoft’s Azure ecosystem. This role involves leveraging Azure … s diverse data services, such as Data Factory, Databricks, Azure SQL and Synapse Analytics, among others, to build scalable and secure data solutions that support complex onward processing by both operational and analytical teams. What will this role look like? - Develop and maintain scalable … operational and analytical teams to solve complex business problems. - Monitor system performance, identify bottlenecks, and implement changes to improve data processing and pipeline/systems performance. - Work closely with Data Scientists within the Operational Analytics team to understand data needs and deliver solutions more »

of industries. Cerberus Technology Solutions (CTS) is a subsidiary of CCM that specializes in information organization, storage and analysis. The CTS teams include Data Science, Data Management and Client Engagement, which work closely together with clients to identify business opportunities and create new business value through … improved data handling and analysis. Responsibilities: Build predictive models using machine-learning techniques that generate data-driven insights on modern data platforms (Spark, Hadoop and other map-reduce tools); Develop and productionalize containerized algos for deployment in hybrid cloud environments (GCP, Azure) Connect and … blend data from various data sources within enterprise tools (python, pandas, or SQL) to enable application of Data Science methods Create metrics and analytical reports to ensure data quality and business value. Clean, structure and normalize data to eliminate redundant more »

Leading ecommerce client are now searching for a Senior Data Engineer to contribute towards the delivery of their data strategy. This engineer will shape our client’s data function, delivering end to end solutions for an array of customer data projects. The … role: Designing data pipelines, managing data warehouses, and implementing complex ETL processes. Work closely with data scientists, analysts, and stakeholders to optimise our client’s infrastructure. Optimise data driven products, personalisation, reporting and overall business success. Manage the whole data lifecycle (End to End). Ensure the reliability and quality of data. Key Requirements: Strong experience designing data pipelines/warehouses using AWS and Snowflake. Exposure to big data technologies such as Kafka, Spark, or Hadoop. Solid experience with Snowflake, including performance optimisation and more »

infrastructure investments. Be part of a dynamic team driving growth and maximizing value in the alternative asset management industry. Key Responsibilities: Support the Data Team Lead in system updates. Develop, modify, and maintain software components. Resolve data/software issues and suggest technical solutions. Collaborate with … peer reviews and offer technical guidance. Identify process improvements and adhere to IT policies. Essential Technical Skills: 2-3 years' experience in Azure data systems. Proficiency in Data Warehouse technologies and SQL. Familiarity with Azure services like Data Lake and Data Factory. … Essential Experience: Supporting traditional Data Warehouses. Building Azure data pipelines and data lakes. Agile development experience. Strong problem-solving skills. Awareness of industry trends and stakeholder interaction. Desired Experience: Familiarity with Business Objects Reporting and Power BI. more »

needs of the business, within the broader context of overall business and technology strategy. Preference will be given to candidates with experience in data and information management/strategy, and scientific solutions and services, as well as experience working on a broad range of projects. You will be … solutions architecture skills and experience Knowledge and experience of implementing large and medium scale data storage , archiving , transformation and data pipeline solutions with a focus on scientific data Knowledge and experience of various forms of data storage and processing and data … Experience working in a science organisation or with Science R&D Knowledge of TCP/IP networking, HTTP/REST, APIs and other data transfer mechanisms such as SSH, SFTP, VPN links Knowledge and experience with MS Azure solution architectures (esp. IaaS, PaaS and SaaS based solutions) Experience more »

Mid-Level and Senior Data Scientist Roles - Hybrid/Bristol Location: Hybrid/Bristol - 2 days in office per week min. About Our Client: Our client is a leading organisation in the risk industry, specialising in cyber risk assessment and management. They are at the forefront of innovation … With unique perks like dog-friendly offices, team meals and enrichment days, their team thrives on a cooperative and inventive spirit. Mid-Level Data Scientist: Location: Hybrid/Bristol Salary: £50,000 - £60,000 per annum Contract Type: Permanent Key Responsibilities: Seeking an Engineer with a curious mindset … and an understanding of bespoke data transformation, without the need for the crutch of Cloud Platforms at all times… Develop, enhance, and manage intricate data ingestion pipelines. Integrate advanced machine learning elements into data pipelines. Implement data quality metrics and dashboards for more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

Data Engineer Location: London, UK Hybrid: 3x a week in office Salary: £63,000 About the Client Our client is a top-tier professional services firm known for its exceptional workplace culture and some of the most sought-after office spaces in London. Role Overview Our client is … in search of a skilled Data Engineer to manage and engineer the data warehouse. The opportunity will be amazing for a Data Engineer who is happy to work in a small team. Incredible opportunity to mentor/lead a small Data Engineering … team within a year! Main Responsibilities Build scalable data pipelines on a daily basis Code on a daily basis with Azure SQL and python Develop and maintain the logical and technical architecture to fulfil the client’s information, insights, and reporting needs. Stay informed on the latest developments more »

Managers as part of the Fixed Income Technology leadership team. The ideal candidate will be a collaborative leader, with experience of application development, data management and cloud-based architectures. They will be comfortable to empower the team members to be self-reliant in decision making, and ability to … levels, demands good hygiene of code, database design and APIs. You will need to be comfortable with databases, working with SQL to diagnose data issues, and digging into logs and documentation to truly understand what the systems are doing. The team is part of a wider Fixed Income … by Risk Analysts, Portfolio Managers, and Quants. This is a hands-on leadership role that provides an opportunity to tackle sophisticated business, logic, data, and technical challenges. Role summary and job responsibilities Manages a software engineering team to deliver business-focused outcomes. Work closely with Head of Fixed more »

Data Scientist/Quant Researcher Top-tier Hedge Fund London/Hong Kong Our client, an industry-leading hedge fund, is looking to add Data Scientists to its Equities division. We will be hiring in both London and Hong Kong. You will be an early/… mid-career Data Scientist (1-7 yrs' experience) currently working in a: Hedge Fund Asset Manager Market Data Provider Alternative Data Provider or adjacent industry with exposure to Capital Markets data You should ideally have an interest in a particular Equities sector … or group of sectors (e.g. Consumer data, Healthcare data, etc) and some proven expertise in applying this to Equities markets problems. Working with the firm's world class technologists and investment teams, you will be an individual contributor focused on the analysis of 3rd party data more »

As people increasingly move across channels and platforms, Kantar Media’s data and audience measurement, targeting, analytics and advertising intelligence services unlock insights to inform powerful decision-making. Working with panel and first-party data in over 80 countries, we have the world’s fastest growing … East, Asia Pacific, North America, and Africa to understand audiences and help the world’s leading organisations succeed and grow. Job Title: Senior Data Scientist Location: London, Grays Inn Road Salary: Competitive Full time/Permanent Kantar is the leader in providing audience and advertising measurement tools and … the forefront of technological developments in audience measurement in the media industry, working with broadcasters and advertisers, media agencies and industry committees. The data science team provides research and technical expertise, support, oversight, and methodological development to our global operating services and sits within the Global Product team. more »

Job title: Data Engineer Client: Elite Prop Trading Firm Salary: Up to £1500 p/d Location: London/Hybrid My client are seeking a Data Engineer to own the design and implementation of data solutions, with previous expertise in data extraction … transformation, and loading (ETL) processes from a variety of sources, including websites, PDFs, and real-time data streams. Being a Data Engineer at a truly tech driven fintech, you will join an environment that prides themselves on working with the most cutting edge technologies and boast … a world class technical team where you will work with and learn from the best. Responsibilities: As a Data Engineer, you will design, build and continuously optimise extremely scalable and performant data pipelines. Architect and implement data ingestion, transformation, and storage processes. Develop and more »

Are you a Data Engineer with a passion for engineering various data tools ? We would love to hear from you! Careers at TCS: It means more. TCS is a purpose-led transformation company, built on belief. We don’t just help businesses to transform through technology. … you, it means more to make an impact that matters, through challenging projects which demand ambitious innovation. Be exposed to the future of data Work with some of the brightest global minds in the industry Lead definition and implementation of standards and best practices in Enterprise The Role … This role will support the design, management, checking, and engineering of a diverse range of data using a variety of tools to achieve consistent data sharing across the organization. Your Profile Key responsibilities: Design, create, test and maintain data pipelines to support Digital projects more »

A global company are looking for an experienced BI Developer/Data Engineer to join their growing Data Team based in their London office – this is a hybrid role, requiring 3 days per week in the office to collaborate with colleagues. It’s a really exciting … time to join the team, as they look to leverage the latest Microsoft Azure data technologies, having recently launched a brand-new Azure Data Platform and introduced the use of Databricks. The role is predominantly back-end Data Engineering focused, where you’ll develop … various solutions for data collection, integration, transformation and modelling, to support the ongoing development of their global data platform. This will include developing data pipelines, to automate data collection and integration across various sources, with the use of Azure Data more »

support of BTs Strategic SIEM development. We are seeking a skilled Software Engineer with expertise in Elasticsearch (or other SIEM and/or Data platforms) to join our dynamic team. As a Software Engineer you will play a critical role in designing, developing, and maintaining our security information … will be on leveraging Elasticsearch and related technologies to enhance threat detection, incident response, and overall security posture. What you’ll be doing • Data Ingestion and Enrichment: o Configure Elasticsearch pipelines for data ingestion from various sources, primarily from Kafka o Enhance data enrichment … Lead for the year and work towards achieving these. You'll have the following experience • ETL Processes with Logstash Design, develop, and maintain data pipelines using Logstash, part of the Elastic Stack. Automate data ingestion, transformation, and loading tasks. • Beats for Data Collection Configure more »