26 to 50 of 67 Data Ingestion Jobs in England

Data Engineer £80,000-£95,000 London, Hybrid Permanent I am seeking an experienced Data Engineer who is passionate about designing, optimising, and maintaining AI-native data processing pipelines. Your role will involve tackling complex challenges with robust data pipelines across diverse sources, enhancing the quality … of data for our systems, and readiness to meet the challenges of scale. Responsibilities: Ensure the secure handling of data through end-to-end encryption, data isolation, and other best practices. Design robust data processing and indexing pipelines handling large amounts of data across several … modalities, ensuring robustness and timeliness. Curate and manage large-scale data ingestion and indexing pipelines, ensuring data quality and error handling. Manage cloud orchestration and data infrastructure, applying your expertise with various data processing and indexing tools to ensure scalability and reliability. Requirements: Strong programming more »

Job DescriptionJob title: Lead Data EngineerClient: Data Driven Quant FundSalary: Up to £160,000Location: London/HybridMy client are seeking a Lead Data Engineer to own delivery of scalable data pipelines that are critical to the entire firms infrastructure.Being a Lead Data Engineer at a … most cutting edge technologies and boast a world class technical team where you will work with and learn from the best.Responsibilities:As a Lead Data Engineer, you will engage with data scientists, software engineer's and product managers to deliver high-quality product based on very specifically tailored … data requirements.Architect and implement data ingestion, transformation, and storage processes.Optimise data pipeline performance.Keep up with market developments in the data engineering and AI space and implement these best practices.Requirements and Skills:Bachelor's Degree in Computer Science, Engineering (or other related STEM subject)5+ years more »

Job DescriptionSenior Data Engineer - Investment Firm - London - Up to £150k base + bonusAbout Us:We are working with a prominent investment firm based in London, renowned for their innovative approach and commitment to delivering exceptional results for our clients. As part of our continuous growth and evolution, we are … seeking a talented Senior Data Engineer to join our dynamic team.Role Overview:As a Senior Data Engineer, you will play a pivotal role in managing and optimising our data infrastructure, ensuring the reliability, security, and efficiency of our data processes. You will work closely with various … teams to design, implement, and maintain robust data pipelines, leveraging cutting-edge technologies to drive insights and inform strategic decisions.Key Responsibilities:Develop and maintain data pipelines for security and index data, sourced from Bloomberg, Reuters, and other relevant providers.Utilise Python and Java (both preferred) for data more »

Data Platform Engineer - London/Hybrid - £70,000 FTC I am currently working with a well-established, global organisation within the education sector who are looking for a Data Platform Engineer to join their established IT team. Their current project is based around the creation and implementation of … a brand new Azure Data Platform. You will take responsibility for the design, development and maintenance of the data platform utilising your experience with the Azure tech stack. You will join a growing team. This is an opportunity to join a team who are serious about the way … that they use data and work within an organisation who are providing significant investment into all of their data teams. As part of this role, you will be responsible for some of the following areas. Develop and maintain the organisation Azure data warehouse infrastructure Create robust data more »

Founding Data Engineer Role update - this role is now contract only. And really a mix of data science and engineering... Central London 3 days a week, hybrid NB – we are looking for someone with specific experience around fintech, finance, banking, eCommerce transactions, insurance, payments, fraud, consumer scams or … they have validated some of the big problems to solve. The mission is big. They have a new approach tested with retail banks. The data engineer will be key to bringing some of the solutions and the early stage product to life. The role > We’re looking for someone … that really fancies building a data platform from scratch alongside some very solid technical founders > Designing, building, and maintaining scalable data pipelines. > Collaborating with various teams to understand data requirements and implement solutions. > Optimizing data workflows and processes to enhance data quality, reliability, and performance. more »

Senior Data Engineer Up to £70k plus bonus Manchester Are you looking to take your Data Engineer career to the next level?? This company use extremely modern technologies, and you can be certain you will grow within a technical environment. The career advancement and progression opportunities for you … focus is building, planning, and constructing pipelines, in a technical role, working predominantly within the Azure Cloud. Your new challenge Working alongside the Lead Data Engineer, you’ll be working within a small, friendly team, working on exciting technical projects. You will be using your technical expertise with Microsoft … Azure to conduct data ingestion, extractions, and transformations in Data Lake, and developing new database structures and data warehouse strategies. This company need someone who can work on business procedures and data models, ensuring that any necessary changes or improvements are applied. About you First more »

Data Engineer – Manchester - £40,000 – Hybrid Working My client is hiring a full time Data Engineer to contribute to their expanding data science and analytics initiatives. Your role involves designing, building, and maintaining data pipelines, ensuring seamless data flow into their central Microsoft Azure repository. … Collaborate with Data Analysts and Scientists to optimise data quality, reliability, security, and automation. Skills & Responsibilities: Configure and troubleshoot Microsoft Azure, manage data ingestion Develop ETL scripts using Python, handle web scraping, APIs, and relational databases Familiarity with Power BI (you will not have to use … Power BI, but being aware of how to collaborate with people that do is important) Work closely with data analysts and scientists, contribute to data models and algorithms, and participate in data events Working knowledge of Git If you have the required skills and experience and would more »

Data Engineer - Fixed Term Contract About our Team At LexisNexis Intellectual Property (LNIP), our mission is to bring clarity to innovation by delivering better outcomes to the innovation community. We help innovators make more informed decisions, be more productive, and ultimately achieve superior results. By helping our customers achieve … their goals, we support the development of new technologies and processes that ultimately advance humanity About the Role As a Data Engineer at LexisNexis Intellectual Property (LNIP), you'll contribute to new product development. Your role will focus on complex natural language datasets, implementing cutting-edge data solutions … like Data Lakehouses and embracing DataOps for operational excellence. Responsibilities Developing and maintaining data infrastructure supporting real-time data processing in streaming architectures Implementing scalable data ingestion and ML pipelines, incorporating Data Lakehouse concepts for unified data management Designing APIs for diverse business more »

Software Engineer (Data) £110,000-£120,000 London, Hybrid (2x days) Permanent role I am seeking an experienced Software Engineer (Data) who can be passionate about designing, optimising, and maintaining AI-native data processing pipelines. Your role will involve tackling complex challenges with robust data pipelines … across diverse sources, enhancing the quality of data for our systems, and readiness to meet the challenges of scale. Responsibilities: Manage cloud orchestration and data infrastructure, applying your expertise with various data processing and indexing tools to ensure scalability and reliability. Design robust data processing and … indexing pipelines handling large amounts of data across several modalities, ensuring robustness and timeliness. Curate and manage large-scale data ingestion and indexing pipelines, ensure data quality and error handling. Ensure the secure handling of data through end-to-end encryption, data isolation, and more »

Brook, Runcorn, WA7 3DJ Salary: £46,000 - £49,000 and extensive benefits package Hours: 37.5 hours per week Are you a seasoned expert in data engineering looking to make a significant impact in the healthcare industry? Phoenix Medical Supplies is seeking a Senior DataOps Engineer to lead our data … quality products and services across the region. As a Senior DataOps Engineer, you will be instrumental in architecting and implementing solutions across the entire data pipeline, from ingestion to visualisation. The role will require you to showcase your skills in data ingestion, storage, modelling, transfer, hosting … visualisation, analysis, and consumption, all while mentoring and training team colleagues. Key Responsibilities: Design and develop robust data pipelines for ingestion, storage, processing, and interface creation. Produce both machine consumable interfaces and human consumable data products, including standard and ad hoc reports. Maintain and optimise data more »

Exciting opportunity to work with a Big4 Tech company as a Data Scientist, based in London! 12 months contract Key Qualifications: • Postgraduate degree (MS or PhD) in a quantitative field of study including economics, statistics, applied mathematics, data science, business, or a related discipline. • 5-7 years professional … experience developing advanced Tableau data visualizations, dashboards and reporting. • Programming skills in SQL and Python required to develop and maintain custom ETL processes. • Skills in exploratory data analysis and familiarity with advanced quantitative analysis. • Experience reporting on web analytics in Adobe, or other web analytics tools. • Comfortable using … modern data technologies. Familiarity with database modelling and data warehousing principles (Snowflake preferred). • Knowledge of the digital advertising industry, the mobile app economy or related field. • Familiarity with automated data ingestion processes including APIs. • Ability to partner effectively with data science and engineering stakeholders more »

minded subject matter experts, solving interesting problems, and building the products of tomorrow, this opportunity is for you. On our mission to revolutionize the Data Strategy & Management space, we are seeking a dynamic and seasoned Solution Architect with a stellar track record in Data Products. As our client … navigates the complexities of a legacy IT landscape, we need someone who can not only conceptualize, design and build robust data platforms but also provide strategic guidance and stakeholder management expertise. Leveraging your software engineering expertise, you'll play a pivotal role in ensuring the integrity, efficiency, and compliance … of the data architecture while spearheading the migration from legacy systems to modern solutions. What you'll bring to us: At least 5 years of experience in a similar role, with 10 years in software engineering and solution architecture. Extensive knowledge of database structure systems, data mining, data more »

Job title: Lead Data Engineer Client: Data Driven Quant Fund Salary: Up to £160,000 Location: London/Hybrid My client are seeking a Lead Data Engineer to own delivery of scalable data pipelines that are critical to the entire firms infrastructure. Being a Lead Data … cutting edge technologies and boast a world class technical team where you will work with and learn from the best. Responsibilities: As a Lead Data Engineer, you will engage with data scientists, software engineer's and product managers to deliver high-quality product based on very specifically tailored … data requirements. Architect and implement data ingestion, transformation, and storage processes. Optimise data pipeline performance. Keep up with market developments in the data engineering and AI space and implement these best practices. Requirements and Skills: Bachelor's Degree in Computer Science, Engineering (or other related more »

Job DescriptionData Engineer£80,000-£95,000London, HybridPermanentI am seeking an experienced Data Engineer who is passionate about designing, optimising, and maintaining AI-native data processing pipelines. Your role will involve tackling complex challenges with robust data pipelines across diverse sources, enhancing the quality of data for our systems, and readiness to meet the challenges of scale.Responsibilities:Ensure the secure handling of data through end-to-end encryption, data isolation, and other best practices.Design robust data processing and indexing pipelines handling large amounts of data across several modalities, ensuring robustness and … timeliness.Curate and manage large-scale data ingestion and indexing pipelines, ensuring data quality and error handling.Manage cloud orchestration and data infrastructure, applying your expertise with various data processing and indexing tools to ensure scalability and reliability.Requirements:Strong programming and engineering skills, with proficiency in Python more »

A Financial Service Company is currently seeking a Lead Data Engineer to join its EMEA Technology team. This person will lead the design, development, and maintenance of scalable and efficient data pipelines to support data-driven applications The Lead Data Engineer will also collaborate with cross … functional teams, including data scientists, software engineers, an product managers, to understand data requirements and deliver high-quality solutions as well as architecting data ingestion, transformation, and storage processes using tools such as Apache Spark, Azure Data Factory, and other similar technologies. Other core duties … include optimizing data pipeline performance, ensuring data accuracy, reliability, and timely delivery. Requirements; Significant experience working as a Lead Data Engineer within Financial Services Certifications in relevant technologies, such as Azure Data Engineer or Databricks Certified Developer Experience with real-time data processing and streaming more »

Job DescriptionData Architect - Consulting - FSA leading global consulting firm is looking for a Data Architect to join their team!As the successful candidate, you will be in charge of designing and implementing scalable architecture and lead a global rollout of the client's digital content platform. This consultancy is … the office and it is offering up to £155,000 + bonus + excellent benefits!Required skills:More than 15 years of experience in Data Architecture implementing data migrations to at least one cloud platform including AWS, GCP and/or AzureData modernisation and data ingestion experienceExperience leading at least one implementation of Databricks and/or Snowflake is requiredData Lake and data storage design experience for both structure and unstructured dataExperience working for a consultancy or for a financial services client is requiredDesirable:Data Governance, Data Lineage and Data Dictionary more »

Junior Data Architect- £50,000- £58,000 + Fantastic Pension & Benefits Bath- Hybrid working with 5 days per month working onsite This is an exciting time to join as leading business is embarking on the next stage of its digital transformation journey. They are transforming the way data & technology services are delivered and are looking to bring in a Data Architect to design, build, and optimise the data architecture to support the evolving business needs. My client would consider someone who is looking to step up and develop their career within data architecture and … offer excellent support, Role: You will collaborate closely with the business to understand our existing data landscape, identify opportunities for improvement, and develop strategic plans for managing and integrating data across the organisation. Design and implement scalable data architectures that support data ingestion, storage, processing more »

purpose of making the world a better and safer place. Element, a well-established organization that touches billions of lives, is searching for a Data Scientist in London (hybrid) to help build a startup within their organization. You will design and train performant models from scratch and create a … drive our product's analytics engine. Operating in an Agile setting, you will be part of a cross functional team, collaborating closely with other Data Scientists, Data Engineers, Software Engineers, Product Owners and UX/UI Designers, to innovate and drive our product to new heights. Core Responsibilities … learning models & design robust analytics engines for high-end digital products Create repeatable, interpretable, dynamic and scalable models that are seamlessly incorporated into analytic data products Document code, results, and details of the approaches in a systematic way to promote knowledge sharing and code re-use Collaborate with other more »

Data Engineer Overview: An Exciting opportunity has arisen with one of the UK’s largest life insurance brokers to join as a Data Engineer. Reporting to the Data Platform Manager, you will be responsible for ensuring that all of the raw data is prepared into clear … department to develop and maintain products Working cross-functionally across the business to understand the requirements of the products Designing and implementing performance related data ingestion pipelines from multiple sources using Apache Spark Integrating end-to-end data pipelines ensuring a high level of quality is maintained … Working with an Agile delivery/DevOps methodology to deliver additional data products Delivering and presenting proofs of concept of key technology components to the wider data team and relevant stakeholders Essential Skills & Experience: Strong experience with SQL & Python Competent with designing and delivering solutions using Azure services more »

I am partnered with an innovation & transformation consultancy that are on the lookout for an SC Cleared Data Engineer in their Bristol office. Join one of the UK's largest innovation & transformation consultancies dedicated to shaping the future of public sector engagements. We pride ourselves on delivering cutting-edge … solutions that drive impactful change and foster growth in the community. Key Responsibilities: Utilize your expertise in Azure to design, develop, and maintain data solutions tailored to the unique requirements of public sector projects. Engage in end-to-end data engineering processes, including data ingestion, transformation … Requirements: SC clearance is essential for this role. Bachelor's degree in Computer Science, Engineering, or related field. Minimum of 4 years' experience in data engineering roles, preferably within a consulting firm. Proficiency in Azure data services such as Azure SQL Database, Azure Data Factory, Azure Databricks more »

A new opportunity has risen for a Data and Insights Manager to join our D2C team. The Data and Insights team is a small but dynamic and experienced group of SMEs who work across Google Analytics, Bloomreach CDP and BI/data engineering. The team is the … personalised and segmented approach to every customer touchpoint to empower our customers to reach their financial goals. Plus, we know the best decisions are data-driven so we give our senior management team the best business intelligence data at their fingertips. Were looking for an experienced, driven and … Youll be responsible for managing the day-to-day work of the team, working with the team to triage incoming requests, gather requirements for data tasks (whether that be dashboards, new functionality, analysis pieces or tracking requests) and manage the teams backlog on JIRA. Youll take on running sprint more »

Job DescriptionSenior Data Engineer💰 £85,000-£100,000🖥️ Snowflake, AWS, dbt, Terraform🌍 London, 2-3 days a week in London officeWe are partnered with one the UK's most exciting e-commerce platforms, operating within the luxury beauty and wellness industry, and supporting them on their search for a … Senior Data Engineer.The role...As a Senior Data Engineer you'll be at the forefront of transforming and interpreting complex data into valuable insights that drive the business. Your expertise will be crucial in leveraging key technologies like Snowflake, AWS, DBT, and Terraform to enhance understanding of customer … behaviors, market trends, and operational efficiencies.What you'll be doing...You will gather, analyse, and transform data from diverse sources, ensuring cleanliness and quality.You will be architecting and building the next generation Data Platform.You will construct data models, pipelines, and stores to facilitate seamless data flow.You will more »

Senior Data Engineer 💰 £85,000-£100,000 🖥️ Snowflake, AWS, dbt, Terraform 🌍 London, 2-3 days a week in London office We are partnered with one the UK's most exciting e-commerce platforms, operating within the luxury beauty and wellness industry, and supporting them on their search for a … Senior Data Engineer. The role... As a Senior Data Engineer you'll be at the forefront of transforming and interpreting complex data into valuable insights that drive the business. Your expertise will be crucial in leveraging key technologies like Snowflake, AWS, DBT, and Terraform to enhance understanding … of customer behaviors, market trends, and operational efficiencies. What you'll be doing... You will gather, analyse, and transform data from diverse sources, ensuring cleanliness and quality. You will be architecting and building the next generation Data Platform. You will construct data models, pipelines, and stores to more »

Senior Data Engineer Location: Hybrid, with 2 days per month to be onsite (Abingdon) We have the pleasure to be representing a business that is on a mission to increase the number of people who can live longer, healthier lives and reduce unnecessary medical costs while doing so. To … help with the success of this strategy They are recruiting for a Senior Data Engineer that will take a pivotal role in driving the Data team forward. Responsibilities: Lead Cloud Data Warehouse Project : Take charge of leading the Cloud data warehouse project through its next phase … of development, ensuring its scalability, reliability, and performance meet the highest standards. Ownership of Data Management : Assume ownership of all aspects of data management, serving as the go-to person for any data queries from the internal team. Your expertise will ensure seamless data operations and more »

coupled with at least 2 years experience of Nice Actimize. - Analyzing current installation of Actimize WLF solution at a client side - Recommend improvements on data ingestion and batch process performance - Recommend optimal Threshold setting and Scoring configuration which adhere to the client requirements - Improve detection and alert generation … especially face-to-face with clients. - Must be willing to travel to client site. Nice to have - Experience in DowJones Sanctioned List and Profile data ingestion to WLF The position will be based in Canary Wharf London. Rate will be in the range £275 to £375 per day more »