1 to 10 of 10 Data Pipeline Jobs in Central London

Lead Big Data Engineer Salary: £94,000 DOE Location : London (4 days a week on site) ** MUST HOLD AN ACTIVE DV CLEARANCE ** Benefits: Health care, dental, flexible working, critical illness cover, health assessments and annual incentive programme. As the Lead Big Data Engineer, you will play … integration Responsibilities: Develop and maintain scripts for automation processes and work flows Conduct thorough testing to ensure seamless integration Data pipeline support by managing and optimising Utilise detailed knowledge of Linux internals Troubleshooting by diagnosing and resolving technical issues Following network protocols Design scalable big … data systems Data pipeline support Hybrid cloud management Implement and support business intelligence and visualisation tools Utilise big data NoSQL engines and platforms Requirements: Experience with Python/Bash Strong troubleshooting skills Strong understanding of TCP/IP and OSI Models proven experience more »

We have been tasked with recruiting a Principal Data Solutions Architect for a well-established company in the industry. Our client is seeking an adept professional to spearhead strategic leadership and technical expertise within their data solutions landscape, focussed on cloud data platforms, but … including IoT analytics, data integration, and migration projects. This unique opportunity is remote-focused but with an open invitation to their North East headquarters. Role Responsibilities: The Principal Data Solutions Architect will be pivotal in shaping the approach to designing and developing data solutions … on-premise design expertise. - At least 5 years in data engineering or business intelligence roles. - Proficiency in ETL and data pipeline design, with a technology-agnostic approach. - A solid understanding of data warehouse and data lake principles. - Expert SQL skills and more »

My Client a leading powerhouse within London are looking to add an New Lead Data Engineer to their team. The Data Engineer will support our software developers, PowerBI developers, data analysts and data scientists on data initiatives and will ensure … optimal data delivery architecture is consistent throughout ongoing projects. Job Title: Lead Data Engineer Location: London (Hybrid 3 Days in Office a week) Salary: £80,000 - £100,000 (Dependent on experience) Job Type: Permanent Start: ASAP Experience Building Data Pipelines Designed and managed data pipelines for complex systems (ETL/ELT) Experience with cloud-based data platforms for data modelling Technical Skills Proficient in SQL Server and relational database management Experience with cloud platforms like Azure (Synapse, Data Lake) Programming in Python, PySpark, and T-SQL more »

Lead Data Engineer (x2) - London - Permanent - Hybrid This role requires hybrid working based in Moorgate, London The salary for this role ranges between £65,000 - £74,000 Lead Data Engineer required for a leading client based in Moorgate, London. Our customer is seeking a well experienced … Lead Data Engineer to come on board to spearhead agile data engineering initiatives, delivering data and insights products. This role involves understanding the business and IT strategy to align technical solutions with desired outcomes, developing APIs and integrations for data transfer between … systems, and providing aggregated data solutions. Key Responsibilities: * Ability to lead complex data engineering projects * Design, code, test, and document data applications * Develop and manage scalable APIs, machine learning endpoints, data integration pipelines, and data storage solutions. * Shape the information more »

Data Engineer - Contract - InsideIR35 - Insurance City of London £600 - £700 per day We are proud to partner with a leading company in the Insurance industry to find a talented and dedicated Data Engineer. Our client is committed to leveraging technological advancements to enhance their data systems and support decision-making processes that directly impact company success. Role & Responsibilities: * Develop and maintain durable data pipelines and architectures. * Ensure the delivery of high-quality data that is accessible and reliable to relevant business units. * Implement systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders. * Collaborate with product development teams in designing and deploying data-driven solutions and products. * Optimise data retrieval, develop dashboards, reports, and visualisations to support company initiatives. * Handle scalable issues for more »

Data Engineer - London - AWS - Up to 70,000 + Benefits Exciting opportunity to work with a forward thinking company who offer their employers the chance to work with cutting edge tech, grow their skills with fully-costed training programs, maintain a healthy work-life balance with modern working … take the well being of their employees very seriously, understanding that work-life balance is critical to performance and moral. As an AWS Data Engineer, you will design, develop, and maintain data pipelines and architectures. You will be utilising AWS services such as Redshift, S3, and … Glue, alongside tools such as Apache Spark and Kafka, to process large datasets. Your role will involve optimising data workflows, ensuring data quality, and implementing robust data security measures. You'll collaborate with data scientists and analysts to support data more »

One of the largest insurance companies in the UK is looking for a Senior Data Scientist with Geospatial experience. They will be looking to grow out this function with you at the forefront, so it's an exciting opportunity with a great progression path. As a Senior Geospatial … Data Scientist, you will spearhead the creation of geospatial solutions to address complex challenges across various business functions. Leveraging your expertise in geospatial data analysis, machine learning, and statistical modelling, you will also play a key role in shaping the development of innovative insurance products and … insights from large-scale geospatial datasets. Collaborate with cross-functional teams to understand business needs and translate them into technical solutions. Perform exploratory data analysis and feature engineering to extract key information from geospatial data. Build, evaluate, and refine predictive machine learning models to improve accuracy and performance. more »

teams within company. The team structure is flat and close teamwork is pervasive. The team works closely with other engineering departments such as Data Pipelines, dev-ops, and infrastructure to name a few to deliver solutions that add real value. Key Responsibilities Software engineering is much more than … End skills (mainly python, NodeJS) Learn, design and build Rest or Graphql services which provide an API driven culture Learn, design and build data pipelines with focus on ETL and ELT Integrate existing applications with new data sources Datamodelling and database design (we use Hive data more »

dynamic and rapidly growing specialist insurance business. This is a pivotal role where you will contribute significantly to the development and deployment of data science applications. The ideal candidate will bring a strong software engineering background, a passion for reliability and testing, and experience in microservices architecture. Key … Responsibilities: Develop and deploy machine learning models into production environments. Maintain and enhance existing applications and data pipelines. Collaborate closely with the Data Science team to deliver high-value solutions. Ensure high-quality, robust, and tested code that serves model predictions effectively. Focus on microservices architecture … to achieve high volume and low latency performance. Implement and manage Continuous Integration and Continuous Deployment (CI/CD) processes. Support the Data Science team by taking on technical tasks as required. Who You Are: The ideal candidate will have: 3+ years of experience in ML, Software Engineering more »

dynamic and rapidly growing specialist insurance business. This is a pivotal role where you will contribute significantly to the development and deployment of data science applications. The ideal candidate will bring a strong software engineering background, a passion for reliability and testing, and experience in microservices architecture. Key … Responsibilities: Develop and deploy machine learning models into production environments. Maintain and enhance existing applications and data pipelines. Collaborate closely with the Data Science team to deliver high-value solutions. Ensure high-quality, robust, and tested code that serves model predictions effectively. Focus on microservices architecture … to achieve high volume and low latency performance. Implement and manage Continuous Integration and Continuous Deployment (CI/CD) processes. Support the Data Science team by taking on technical tasks as required. Who You Are: The ideal candidate will have: 2-4 years of experience in ML, Software more »