151 to 175 of 211 Data Engineering Jobs in London

Senior Data Engineer London/Bracknell - Flexible Up to £90,000 Austin Fraser has an exciting opportunity for a Senior Data Engineer to join one of the leading retail chains, running two of the busiests sites in the UK. This is a great time to join the business … as they are reshaping the in-house data engineering capability by moving to a cloud native platform, to become more product delivery focused . They are now looking to onboard a Senior Data Engineer with 5+ years of experience working with SQL, GCP, DBT, Big Query, Python … and Airflow. In return you will benefit from an excellent remuneration package. The role: Creating, deploying, and maintaining secure data platforms on the cloud. You'll contribute to crafting and delivering data solutions tailored to meet the diverse requirements of stakeholders across the Partnership. You'll have the more »

Data Scientist 6-Month Contract £600/day-£640/day (Inside IR35) London - Hybrid - 1 day per week in the office We are representing a large-scale B2C Tech company who are looking for a Data Scientist to join their AI team on a contract basis. The … central AI team consists of almost 80 people, delivering Data Science and ML projects into production to improve a number of aspects for the business or customers. You will be assigned to a specific project in the Marketing & CRM division involving MMM (Marketing Mix Modelling). You will work … alongside another Data Scientist and a Data Engineer. We are looking for: Experience developing MMM models, not just using off-the-shelf tools but developing the models themselves A strong background in Bayesian statistics Experience as a Mid-or-Senior level Data Scientist Solid knowledge of Data more »

ENGINEER CENTRAL LONDON – HYBRID (3 DAYS A WEEK) £50,000 - £70,000 A great opportunity for a BI Engineer to bridge the gap between Data Engineering and BI reporting at an asset management firm expanding their data and analytics team. THE COMPANY Join a forward-thinking asset … financial returns. With a focus on secured loans, high-yield bonds, and structured credit, they operate at the forefront of the financial markets, leveraging data and analytics to drive informed decision-making. THE ROLE AND RESPONSIBILITIES As a BI Engineer, you will be responsible for supporting data cleansing … and fast-paced environment, working with cutting-edge technologies such as Alteryx, Tableau, SQL, and Python. Responsibilities: Contribute to the setup and maintenance of data infrastructure, including data lakes, warehouses, and SQL Server databases. Utilize your technical expertise in SQL and Python to extract, transform, and analyse data more »

Cognizant is recruiting a Data Scientist, the hybrid role comes with an excellent salary and benefits package. In your first few weeks in this Data Scientist role, you can expect to: Gather business requirements, perform detailed analysis, and produce associated functional specifications across multiple functions Construct SQL queries … report and visuals, using technology like Tableau, for exploratory data analysis Develop and test models using ML model to generate predictive insights Essential Criteria must be clearly demonstrated on CV In depth commercial experience with Azure, AWS or Google Cloud IaaS/PaaS in area of data preparation …/integration and ML model constructions. Experienced with structured and unstructured data and proficient with good with Hypothesis formulation, data preparation and model building. Experience in combining qualitative and quantitative datasets. Experienced in either programming languages such as Python and/or R, data visualization tools such more »

Position: Software Engineer - Data & AWS We are seeking a Software Engineer to build and optimize data platforms leveraging AWS and key technologies like CDAP, Snowflake, and Databricks. You will design and implement robust and scalable data pipelines, ETL, and analytics systems in the cloud. Responsibilities: Develop and … enhance data pipelines, ETL processes using CDAP on AWS infrastructure. Build data integration flows to migrate large datasets into Snowflake data warehouse. Implement AWS infrastructure-as-code solutions for deployment automation. Instrument data pipelines and leverage monitoring for performance tuning and reliability. Work with data scientists to optimize data workflows and models on Databricks. Follow security best practices for access control, encryption, and auditing across data platforms. Participate in architecture reviews and technology selections. Continuously monitor and improve data platforms for scalability and costs. Requirements: 5+ years of experience in backend more »

will be encouraged to stay curious and pick the best technology for a given problem. You will also partner with cross-functional teams across data engineering, data science, product management, and UX design. Preferred experience: At least 6 years of experience designing and building complex software systems … Proficiency with either Python, Java, Scala, Go, C# or similar technologies Experience in system design and awareness of best practices Familiarity with data structures and algorithms Good communication skills You can apply for the role directly or contact Ionut Roghina on iroghina@trg-uk.com if you have any questions. more »

We are Looking for a Python Developer with Migration Specialist for client based in London, UK - Permanent. Key Responsibilities: Lead and manage large-scale data migration projects, ensuring the successful transfer of data from legacy systems to new platforms. Collaborate with stakeholders to understand requirements and develop detailed … migration plans. Design, develop, and implement data migration and transformation solutions using Azure, Python, and other relevant technologies. Ensure the integrity, accuracy, and security of migrated data throughout the entire migration process. Develop custom software solutions to address specific migration and transformation needs. Utilize Python extensively for scripting … automation, and development of data migration and transformation tasks. Apply strong Python development skills to build and maintain robust, efficient, and scalable software systems. Write clean, maintainable, and well-documented Python code. Integrate Python-based solutions with Azure and other data engineering tools. Work closely with cross more »

degree of accountability and responsibility from Day 1. WHAT YOU’LL DO: Be an ambitious builder, working up and down the stack, mixing software engineering, data engineering, and distributed systems knowledge to build modern enterprise payment applications. Build reliable, high-throughput, low-latency microservices to power flawless … across the organization, including product, legal, and business development to think beyond the technical implications of your design decisions Continuously raise our standard of engineering excellence by implementing and driving best practices for coding, testing, and deployment Proactively identify customer and infrastructure problems and drive corresponding solutions. Mentor and … applications into modern distributed computing environments (Kubernetes, Nomad, etc.) Eagerness to work openly and collaboratively with a diverse team Ability to encourage and drive engineering best practices A positive demeanour and a passion for sharing knowledge BS or equivalent experience in Computer Science or similar Other common names for more »

Job Title: Data Engineer Location: London, UK Hybrid Company Overview: La Fosse is excited to collaborate with a prominent player in the Media industry dedicated to harnessing data-driven insights to propel organisational growth and innovation. Our client is committed to excellence, boasting a dynamic team that values … creativity, collaboration, and continuous improvement. Position Overview: We are partnering with our client to identify a skilled Data Engineer to join their London team. As a Data Engineer, you will play a crucial role in advancing data-driven decision-making throughout the organisation by overseeing the comprehensive … process of importing, cleansing, transforming, and validating data to derive actionable insights. You will collaborate closely with cross-functional teams to grasp data requirements, construct robust database management solutions, and ensure data integrity and accessibility for non-technical stakeholders. Key Responsibilities: Develop and maintain robust database management more »

Legal & General Investment Management are currently looking for an ESG Data Analyst/Scientist to play a crucial role in embedding ESG data into operating models to support investment decisions, risk assessments, and the development of policy positions, as well as enabling reporting to clients. For the right … . ALL APPLICANTS MUST BE BASED IN MAINLAND UK WITH A VALID RIGHT TO WORK IN THE UK. The ever-increasing amount of ESG data has become essential to teams across the business. It now needs to flow into monitoring, trading, order management and reporting systems to understand risks … faceted role and will involve you working with stakeholders across the business to model, organise, cleanse, align and correlate vast complicated sets of ESG data to get insights. The vision of the team is to be trusted provider of high-quality, flexible, and innovative data solutions to support more »

will be essential for achieving project success. Key Responsibilities: Software Development: Write high-quality, maintainable code using languages such as Python and SQL Establish data tools like Snowflake and Azure Data Lake Services (ADLS) Gen 2 Utilize PowerBI, Tableau, or similar tools to design and create interactive and … execute PoCs to validate new technologies, frameworks, or solutions. Drive the development of MVPs, ensuring timely delivery and alignment with business goals. Azure and Data Engineering: Leverage your Azure expertise to design and implement cloud-based solutions. Collaborate with data engineers to build robust data pipelines … and ensure data quality. FAME (Financial Analysis Made Easy): Familiarity with financial systems, including FAME , will be advantageous. Use your knowledge to enhance banking processes and systems. Agile Methodologies: Apply agile practices such as DevOps (including CI/CD), Test-Driven Development, and Infrastructure as Code. Work in collaborative more »

Tier 1 FS client who are in the process of redeveloping their customer facing trading applications. As such they are looking for an Azure Data Engineer with in depth Datamodelling, SQL and Azure data engineering skills to join the team. With strong Datamodelling and database design principles … with the ability to design and develop data models, data stores and other key data architecture components. Strong SQL (SQl Server and Azure SQL) and NoSQL database experience as well as ADF with the ability to build robust, scaled and secured pipelines. Any experience with developing C# … data service API's and with Microservices and event driven architecture would be an advantage. You will need to be in the office 3 days per week and this role is Inside IR35. more »

Lead Data Engineer (Director) - Individual contributor - Azure, Data Factory, Databricks, Apache Spark - London Based I am hiring for a Lead Data Engineer for a crucial role within one of my Investment Bank clients in London. This role is at Director level as they require a very senior … likely to grow and have line management responsibilities in the future. Due to this there is an emphasis on current, hands on experience within Data & AI. Key Responsibilities: Leading data engineering practices Support current applications Introduce AI practices to the team/project Communicate key successes with … stakeholders Key Skills: Azure Databricks Apache Spark Datascience, AI, ML Certifications or continued upskilling/contribution to blog posts within Data & AI beneficial but not essential. This is a full-time role offering up to £150k salary plus bonus and benefits. 3 days minimum per week in the office more »

Lead Data Engineer - up to £100K - Hybrid London Our client a global brand based out of lovely offices in West London are looking for a Lead Data Engineer to work on a business-critical, brand new, innovative high availability application which will be used by thousands of people … someone who is looking to take their next step in their career and wants to take on more responsibility. Technical Skillset: Experience as a data engineer developing and maintenance of ETL/ELT processes Good experience in Data Modeling within a cloud-based data platform Strong experience … with SQL Server Azure data engineering stack, including Azure Synapse and Azure Data Lake Python, PySpark and T-SQL In return you will be offered a competitive salary and benefits package, remote working options and an opportunity to work with a household brand that are committed to more »

Senior Data Scientist - Python, Power BI - Fixed Term Contract - 12 Months I am reaching out as I have a great opportunity for a strong Data Scientist. My London based client is looking for someone with excellent Python programming experience alongside Data engineering experience in Azure. For … Strong experience with PowerBI. - NHS/Healthcare/Consulting experience. - Business Intelligence experience is useful for this role. - Previous experience working with High Frequency data will be an added advantage. If you are interested in this Data Scientist/Data Engineer role please respond with your most … recent CV. Alternatively email me on Jordan . Sotiris @ Randstad . co . uk Senior Data Scientist - Python, Power BI - Fixed Term Contract - 12 Months Randstad Technologies Ltd is a leading specialist recruitment business for the IT & Engineering industries. Please note that due to a high level of more »

will have acquired special expertise in Transformers, be experienced with API wrappers like LangChain and Auto-GPT, have experience in evaluating LLMs and prompt engineering, semantic search, MLOps, and embedding-based fine tuning of NLP models such as those in Sentence Transformers. You will need: MSc/PhD and … and Large Language Models, eg. GPT-4, Claude, Huggingface, LLaMA, LangChain, LlamaIndex, Pinecone Proven track record of contributions to large AI domain software and data engineering projects relevant to the life sciences, ideally in drug discovery, preferably in a biotech start-up environment Good knowledge of cloud computing … strong leadership and listening skills Knowledge in several of the following will be advantageous: AI/ML approaches to problems in the Life Sciences Engineering and data solutions to support bioinformatic workflow design and development, with a focus on ML/AI applications An understanding of data more »

Head of Group Data Platforms//Global Insurance Business £130k-£140k + Bonus Package 2 days per week in Central London Azure Estate Position Overview: My client is seeking an exceptional leader for our Group Data Platform to guide us towards a federated model with local ownership … on a Group-governed platform. This role oversees the design, architecture, engineering, and all technological aspects of our data platform. You will manage a technical team and ensure the successful delivery of strategic projects and business initiatives. A collaborative leader, you will influence data staff globally to … align on a shared data technology and platform trajectory. Key Responsibilities: Strategic Leadership: Guide Platform architecture to ensure products are developed in alignment with Platform strategy and standards. Oversee performance, monitoring, execution, and issue management for the Platform. Best Practices: Implement software and data engineering best practices more »

will have acquired special expertise in Transformers, be experienced with API wrappers like LangChain and Auto-GPT, have experience in evaluating LLMs and prompt engineering, semantic search, and embedding-based fine tuning of NLP models such as those in Sentence Transformers. You will need: MSc/PhD in AI … and Large Language Models, eg. GPT-4, Claude, Huggingface, LLaMA, LangChain, LlamaIndex, Pinecone Proven track record of contributions to large AI domain software and data engineering projects relevant to the life sciences, ideally in drug discovery, preferably in a biotech start-up environment Good knowledge of cloud computing … essential with a preference for AWS Knowledge in several of the following will be advantageous: AI/ML approaches to problems in Life Sciences Engineering and data solutions to support bioinformatic workflow design and development, with a focus on ML/AI applications An understanding of data more »

backs. If you’re ready to see your impact and unlock incredible career growth opportunities, join us, and build real world value. Ripple’s Data Engineering team supports the foundational infrastructure capabilities, tools, and data platform needed to the scale, insights and reliability of Ripple’s Payments … Liquidity and Custody solutions. Our team focuses on providing the data foundation to help Ripple’s teams scale and leverage data to build better customer experiences. As a Senior Staff TPM, you will take on and drive multiple key initiatives to drive cross org initiatives . This position … for dependencies and roadblocks is crucial. WHAT YOU'LL DO: Responsible for on-time delivery of multiple initiatives related to ingesting, transforming and consuming data Have a data-first approach to track progress, report on trends and identify problem areas Partner with program managers, product managers, and engineering more »

Job Title: Software Engineer (Rust/HPC/Real Time Data) Client: Elite Tech Firm Salary: Up to £200k 1st Year Compensation Location: London Sells: Cutting-edge tech, ownership of multiple greenfield projects, no red tape, a friendly/collaborative environment, beautiful offices, personal projects on Fridays! An Elite … Working as part of a team of engineers looking after and building a zero-down time low latency solutions for multi petabyte/exabyte data sets Working heavily in Rust Building/Optimising some of the world's most advanced data pipelines Collaborating with ML Engineers, Data … Working with other incredibly passionate technologists Skills: 5+ years experience working as a Software Engineer ideally using Rust Outstanding CompSci Fundamentals needed! Knowledge of data engineering principles/data lake architectures - Arrow/Parquet etc. Excellent knowledge of low-level concepts (e.g. compilers, x86, LLVM etc. more »

System Analyst Job Location :: London, UK (HYBRID) Work Type :: Contract We are looking for Senior level UK based BSA with Deep London market and Data projects experience. Senior Business Systems Analyst Job Description Summary In this role you will form part of a high performing agile squad where alongside … the Data Engineering Manager and Principal Product Manager you will lead the gathering of requirements for our new Snowflake data platform. Your solutions will be critical to our data and analytics domain and to the continued success of the company. Job Description In this role you … will Act as a data subject matter expert for our new data platform, supporting business users and IT colleagues. Work with business stakeholders to understand their data requirements and document them at an appropriate level. Once agreed then translate these into stories and tasks for development. Utilise more »

Principle Data Engineer 6 months contract - Up to £560 a day Inside - Inside IR35 - London - Remote Key Skills: Python, SQL, Azure Synapse, Azure tech stack, Experience with delivering pipelines Key Responsibilities: Ensure that the clients' core Azure technology stack is well understood, and knowledge is shared within the team … identifying potential improvements such as efficient data loads, deployment automation, and performance optimization. Lead by example - actively engage as a hands-on engineer and coach to assist the team in building high-quality, resilient pipelines with appropriate technologies, fostering a culture of quality and resilience. Collaborate with the team … to interpret business requirements and develop corresponding software designs. Enhance the quality of data in our lower environments by designing and implementing methods to generate high-quality synthetic data. Key experience: Proficient the Azure tech stack Skilled in delivering pipelines within SQL, Python and Azure Strong expertise with Azure more »

Solid understanding of business analysis concepts, methods and practices in an information technology environment. General and London Market Insurance domain experience. Experienced in defining data lineage from source systems to an Enterprise Data Warehouse. Solid understanding of agile delivery methodologies. Strong oral and written communication skills. Strong problem … application quality. Customer service & leadership Job Description Summary In this role you will form part of a high performing agile squad where alongside the Data Engineering Manager and Principal Product Manager you will lead the gathering of requirements for our new Snowflake data platform. Your solutions will … be critical to our data and analytics domain and to the continued success of the company. Job Description In this role you will Act as a data subject matter expert for our new data platform, supporting business users and IT colleagues. Work with business stakeholders to understand more »

Data Engineer Azure/Snowflake/Python London (Contract) Role: Our client is looking to expand their data engineering team and add in the utilisation of Snowflake which is currently being used by a select few members of the team, and upskilling taking place alongside. They want … to add in an additional team member who has multiple years of experience using Snowflake as a data tool and can hit the ground running Experience Snowflake Financial services Cloud (Ideally azure) Airflow would be an advantage more »

and have extremely strong communication skills* In addition to this you will need to have... Strong Python experience. Worked in cross-functional teams combining data science, data engineering, BI, machine learning and product management. Implement and deploy machine learning models at scale. An understanding of NLP Experience more »