151 to 175 of 475 Permanent Data Engineer Jobs

Lead AWS Data Engineer - London (Hybrid) - Permanent - £90,000-£100,000 Start-up, AWS, DBT, Redshift, PostgreSQL, Python, MongoDB, ELT *You must be based in London, and have full permanent right to work in the UK to apply for this role* I'm currently working with an exciting … start-up who provide real-time insights and emerging trends in private markets . They partner with investment firms and corporations to provide actionable data and intelligence on private companies. They are massively successful and growing steadily, and are on the look-out for a Lead Data Engineer to join the team! Specifically, they're looking for: Extensive experience as a Data Engineer using AWS Very strong ability in DBT and Redshift Proven experience working in an autonomous, start-up environment . Expert ability with PostgreSQL , ELT , unstructured data , and MongoDB . Experience with more »

About the AWS Data Engineerj ob Stride Recruitment are looking for skilled and motivated AWS Data Engineers to join a consulting firm offering end-to-end data solutions, delivering best-in-class experiences for their external clients. To be successful in this AWS Data Engineer role, you will need to have a strong background in AWS, with experience in data warehousing, data lakes, and data integration. You should also have a good understanding of data modelling, ETL processes, and data governance. Technical Skills: Proficiency in AWS Glue, AWS Redshift … and Python Experience with ETL processes, data integration, and data warehousing. Strong SQL skills Experience with Big Data technologies such as Hadoop, Spark, and Kafka Familiarity with cloud platforms (AWS, Azure, Google Cloud) Working knowledge of data visualisation tools (PowerBI, Tableau, Qlik Sense) Additional Skills: Client more »

Senior Azure Data Engineer £70,000-£75,000 salary Remote UK *Please note this is a permanent position (no contractors will be considered). You must also have full right to work in the UK to apply* I'm currently working with an exciting SaaS company, specialising in … the detection and management of risks that may affect the outcome of clinical trials. They're looking to strengthen their Data Engineering function now, by bringing on a Senior Data Engineer with excellent ability in Azure , Data Factory , data warehousing , SQL , Power BI , and an … understanding of RestAPIs . Essentials: 4+ years experience as a Data Engineer using Azure . Proven experience working with Azure Data Factory and Power BI . Strong ability with Data Warehousing. Excellent skills with Python and SQL . Confident understanding of RestAPIs . They are booking more »

Data Software Engineer– London Sports Analytics & Statistics Company Fulltime onsite *Please note this role cannot sponsor. Please do not apply if you are seeking sponsorship* A Data Engineer is required for an exciting and innovative Software sports betting company based in London. The successful candidates will … quantitative researchers and alongside other extremely talented and driven engineers to build and support systematic trading models. You will be working on real-time data pipelines for live sports events where your expertise will help the company advance their in-play sports analytics and pricing function. Your day-to … day will involve developing robust and scalable data pipelines, implementing new feeds into the business, and integrating them with their quantitative decision models. Essential Skills Proven experience as a data engineer or similar, with a track record of handling mid to large scale data projects. Strong more »

an unparalleled educational experience. By attracting and retaining the finest educators worldwide, our client ensures an environment where excellence thrives. Job Purpose As the Data Platform Engineer overseeing the Data Warehouse and analytics infrastructure, you will shape the backbone of our client's business analysis and reporting … capabilities, both now and into the future. They are seeking a visionary with a proven track record of architecting enterprise-level data ecosystems, someone who thrives on pushing the boundaries of what's possible in data manipulation. Your expertise will ensure data is not just accessible but … optimised for safe, secure utilisation across multiple fronts — be it reporting, analytics, or powering applications — ultimately driving substantial productivity gains for all data consumers. As a collaborative force, you will seamlessly integrate across central, regional, and local teams, refining our client's data visualisation strategy and elevating our more »

Job Title :: Pyspark Data Engineer Job Type :: Permanent Work Model :: Edinburgh, Scotland, United Kingdom (HYBRID) Please find below the JD of Pyspark Data Engineer – Coding skills: Pyspark or Scala(level to troubleshoot issues) and SQL. Must have good pyspark knowledge to build data transformation. Hands … on Azure data platforms i.e; Azure Datafactory, Databricks, Synapse, SQL, Data lake storage. Experience building and optimizing ‘big data’ data pipelines, architectures and data sets. Must have experience on production environment specific to data processing and activities like Monitoring, Troubleshoot, Deployments. Good understanding on … Data Cleansing, Ingestion ,Transformation and Visualization(PowerBI) flow. Good Data analytics skill and able to communicate with customers/business users. more »

We are currently seeking a Data Engineer to join our client, a unique scale-up business who have received significant investment, that is entering a phase of large scale growth. This role will be a pivotal role in shaping the organisation’s data operations, as the company … grows and matures. As a Data Engineer you will design and build data pipelines that will fuel our client’s groundbreaking product lines. You'll collaborate across multiple disciplines to ensure seamless data flow, and go beyond pipelines to champion data quality, governance, integration, and … overview of what the successful candidate will require (don’t worry if you don’t tick all the boxes!): Python for building and automating data pipelines. A solid understanding of ETL processes for data extraction, transformation, and loading. Experience with relational databases ( SQL ) and database design principles and more »

SENIOR DATA ENGINEER (EU Remote Opportunity) Xcede are delighted to be working with a very exciting Web3/Blockchain organisation with a remote working culture. Their company makes life easier for organisations in the Web3 space by providing managed services across a range of operational tasks and responsibilities … in one space. As a Senior Data Engineer in the company, you will have several clear tasks that are essential to the smooth running of processes that make this Product so unique. Responsibilities Design and implement both batch & stream Data Pipelines around the data stores & data … the company. Requirements An academic background in Statistics, Mathematics, or Computer Science (or similar) A number of years of commercial working as a Senior Data Engineer (responsible for taking decisions, rather than just writing code) An ability to write production quality Python code. Experienced creating data pipelines more »

we do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for skilled professionals to join one of the fastest … Talent Pipeline role, this is not a live role and we will be in touch when an appropriate role becomes available. Job Description The Data Engineer will be implementing data ingestion and transformation pipelines for large scale organisations. We are seeking someone with deep technical skills in … services, and a proven track record in delivering high-quality work to tight deadlines. Your main responsibilities will be: Designing and implementing highly performant data ingestion & transformation pipelines from multiple sources using a variety of technologies Delivering and presenting proofs of concept of key technology components to prospective customers more »

of our users. Through science, technology, and maintaining a clear focus on people, we make mobility possible. We have an exciting opportunity for a Data Engineer to join our growing IT team. The role As Data Engineer you will develop and construct data products and … services and integrate them into systems and business processes. Key duties: Implementing data flows to connect operational systems, data for analytics and business intelligence (BI) systems. Re-engineering manual data flows to enable scaling and repeatable use. Supporting the build of data streaming systems. Writing ETL …/ELT scripts and code to make sure the process performs optimally. Developing data models to support self-service business intelligence reporting that can be re-used to enforce data standards and quality. Building accessible data for analysis. Recognising opportunities to re-use existing data flows. more »

Senior Data Engineer | Full Time | On-Site | Python | SQL | DataBricks| Azure| As a Senior Data Engineer, you will play a key technical role in design, implementation, and continuous refinement of data pipelines and architectures within Microsoft’s Azure ecosystem. This role involves leveraging Azure’s … diverse data services, such as Data Factory, Databricks, Azure SQL and Synapse Analytics, among others, to build scalable and secure data solutions that support complex onward processing by both operational and analytical teams. What will this role look like? - Develop and maintain scalable, efficient, and robust data architectures. This involves creating 3NF and dimensional data models, designing and developing robust batch processing pipelines, and working with the operational and analytical teams to solve complex business problems. - Monitor system performance, identify bottlenecks, and implement changes to improve data processing and pipeline/systems performance. - Work more »

Lead Data Engineer - Azure Synapse/ADF/Kimball London (Hybrid) Our Financial Services client is looking for a Lead Data Engineer to drive the development of the Business Intelligence functions. This role entails close collaboration with Department Heads and divisional accountants across all sectors. Essential … Skills: Experience managing a team as a Lead or Senior Data Engineer Proven BI development experience with Kimball methodology Commercial knowledge of Azure Data Factory (ADF) Azure Synapse experience Strong skills in Azure Blob Storage Financial Services industry - highly desirable This is a permanent opportunity, paying up … per annum. Successful applicants will be contacted within 24 hours of applying. The processing and use by us of your personal data is in accordance with our Privacy Notice which can be found on our website William Alexander Diversity & Inclusion Policy, actively promotes the principles of equality, diversity and more »

Senior Data Engineer 💰 £85,000-£100,000 🖥️ Snowflake, AWS, dbt, Terraform 🌍 London, 2-3 days a week in London office We are partnered with one the UK's most exciting e-commerce platforms, operating within the luxury beauty and wellness industry, and supporting them on their search for … a Senior Data Engineer. The role... As a Senior Data Engineer you'll be at the forefront of transforming and interpreting complex data into valuable insights that drive the business. Your expertise will be crucial in leveraging key technologies like Snowflake, AWS, DBT, and Terraform to … enhance understanding of customer behaviors, market trends, and operational efficiencies. What you'll be doing... You will gather, analyse, and transform data from diverse sources, ensuring cleanliness and quality. You will be architecting and building the next generation Data Platform. You will construct data models, pipelines, and more »

Azure Data Engineer Central London- 3 X Week Up to £60,000 I am working on a Data Engineer role for a fast-growing company within the property industry. They are looking for a confident Azure Engineer to help build out their data team … You will be sitting in a cross-functional data team, working closely with the Data Development Lead and the Head of BI. Requirements To qualify for this role, you will require: · Strong experience within Azure (Data Factory, Synapse, Fabric, etc.) · SQL Expertise As well as excellent stakeholder … successful candidate will receive: · A Salary of up to £60,000 · Excellent progression opportunities Process- three interview stages 1st Stage- Short Conversation with the Data Development Lead 2nd Stage- Technical Interview with Data Manager and a key business Stakeholder HOW TO APPLY: Please register your interest in this more »

Data Engineer Opportunity – AI for Finance Leader in London - £75,000-£85,000 Harrington Starr are currently partnered with an AI/Data leader within the Financial Services space in London. Their ground-breaking software is helping investors to achieve superhuman performance. In order to support further … growth, we are looking for a Data Engineer skilled in the following. What will you be doing? Work on a web scraping platform for one of the firm’s largest clients Develop solutions to parse and process tabular data from PDF and HTML documents Maintain, support and … expand existing data pipelines using DBT, Snowflake and S3 Implement standardised data ingress/egress pipelines Onboard new, disparate data sets, sourced from many and varied data vendors, covering all asset types and frequencies from daily to real-time Liaise and work closely with our team more »

Data Engineer Leeds, onsite 2x per week £45,000 - £55,000 This is an exciting opportunity to join a rapidly growing financial organisation, grown from a joint venture with a major bank. They are seeking an experienced Data Engineer to play a crucial role in the … progression of a new Data Lakehouse, and implementation of an iPaaS solution. As the Data Engineer, you will bring extensive commercial experience in working with sizeable ETL processes/pipelines, AWS serverless technology and Python. In addition to strong technical skills, effective communication and ability to engage … culture while having extensive financial backing to ensure their technology is the best the market has to offer! Requirements: 3+ years commercial experience within Data Engineering SQL Python AWS Excellent communication skills Package: 35 hour working week L&D budget 15% pension Hybrid working 30 days annual leave + more »

Azure Data Engineer | Cheltenham | £50,000-£70,000 Locke & McCloud are working with a leading Cyber Security Consultancy that is home to over 4000 specialists who support clients across manufacturing, defence and security, energy and utilities, financial services and many other industries. They have offices globally and are … recognised for the impressive high standard of work they conduct. They are looking for an Azure Data Engineer, you will play a pivotal role in this journey, leveraging your expertise to architect, design, and implement scalable data solutions on the Azure platform. You will collaborate closely with … stakeholders to understand business requirements, design data solutions, and deliver value-added insights. You will be responsible for architecting data pipelines, optimizing data storage and retrieval, and ensuring the integrity and security of our data ecosystem. Additionally, you will have the opportunity to provide consultative guidance more »

Data Scientist/Engineer - Hybrid/Bristol Job Title : Data Scientist/Engineer Location : Hybrid/Bristol Remuneration : £50,000 - £60,000 per annum Contract Type : Permanent Role will be based with the modelling team. 25% Data Submission and Cleansing (Data Engineer), 75% Process Improvement (Data Science). Ideally, seeking someone with strong Data Science exposure but Data Engineering skills. Responsibilities : Play a pivotal role in crafting, enhancing, and managing intricate data ingestion pipelines, ensuring their efficiency, scalability, and dependability. Integrate advanced machine learning elements into data pipelines to elevate data processing and analytical capabilities. Devise and implement data quality metrics and dashboards for monitoring, ensuring the fidelity and precision of ingested data. Collaborate closely with data scientists, engineers, and cross-functional team members in an agile development setting to meet project objectives more »

Data Engineer • Location : Belfast based – Hybrid - flexible working • Salary : £32,5000 - £40,000 • Package: 10% bonus + 11% pension Overview One of the UK’s leading digital solution provider’s is searching for a Data Engineer to join their practice in Belfast and work on developing … start-ups wanting to scale at pace or some of the world’s biggest household names across the public and private sector. For the Data Engineer, this is an excellent opportunity to get experience working in a diverse role for one of the leading technology-orientated organisations with … projects, learning resources, free cloud certifications and more. Role requirements • Experience with Python, Spark, or Py-Spark • Experience with SQL for databases • Experience developing Data/ETL pipelines • Knowledge of AWS cloud, Azure or GCP (Commercially or in free-time) • Big Data or Machine learning would be nice. more »

Senior Data Engineer £75,000 to £90,000 Flexible working - Ideally 2 day a month London My Client is a market leader in the retail and e-commerce space who invest in innovation, delivering unparalleled shopping experiences to millions of customers in several formats. They are looking for … a experienced Senior Data Engineer to join their growing team and help drive their scalable Data management systems. You should come with a proven track record in managing large-scale data infrastructures and pipelines that support sophisticated analytics. The ideal candidate will be responsible for designing … building, and maintaining robust data solutions that drive strategic decision-making across multiple business units. This role is for someone who principally still loves to code, but who also feels comfortable engaging with stakeholders and mentoring others. Key Responsibilities: Design and implement scalable data architectures using modern cloud more »

Data Engineer Hybrid, West- Midlands £56k + bonus & great benefits Our client are a fast growing SaaS scale-up, revolutionising supply chain ecosystems and increasing revenue for their customers. You'll contribute to the organisation's high-quality data engineering practices, participating in technical design, implementation, testing … deployment and ongoing support and maintenance of the data platform. By going above and beyond implementing new features, the company focus on customer experience, building a high-quality data platform. You'll apply your skills effectively and continue to develop them, while benefiting from the expertise of your … more experienced colleagues, including: Skill set & Experience: • Data Modelling and Querying - Proficiency in designing and implementing data models, including star schemas and snowflake schemas. Expertise in SQL. • Data Storage Technologies - Experience in SQL, NoSQL, Blob, Delta Lake , and/or other enterprise scale data stores. • Data more »

Title: Data Engineer, 40 hours per week, fixed-term contract – DE001. Location: White City, London, UK. Compensation: £45-65,000 plus health insurance and free lunch! Posted date: Monday 6 th , 2024. Closing date: June 7 th , 2024. Start date: July 1 st , 2024, or before. Company: Esox … platform harnesses metagenomics to resolve this biological dark-matter and improve pathogen detection and prevention efforts for global aquaculture. Role: We are hiring a Data Engineer to join our Detect team. Our Detect platform enables clients to identify total microbiomes sampled from livestock and the environment surrounding their … farms. This data is pivotal in advancing our understanding and management of aquatic ecosystems. Our metagenomics pipelines produce significant quantities of DNA data and accompanying sample metadata. You’ll play a central role in supporting the growth of our company by designing and building the infrastructure necessary to more »

Data Engineer - London - £75,000 I am working with a hugely successful, global organisation who are looking to add a Data Engineer to their growing London based data team. This organisation have recently implemented a brand new data platform encompassing the full Microsoft Azure … Stack including leveraging Databricks in order to deliver on its goal of becoming truly data driven. In this role you will be responsible for the BI and data engineering lifecycle across the business supporting the global data needs of various business functions. This role is a split … between data engineering and data analytics and you will take a prominent role on a number of exciting projects. You will be joining a business that values its people at the centre of everything they do. They are looking to expand their close-knit data team where more »

Founding Data Engineer Role update - this role is now contract only. And really a mix of data science and engineering... Central London 3 days a week, hybrid NB – we are looking for someone with specific experience around fintech, finance, banking, eCommerce transactions, insurance, payments, fraud, consumer scams … they have validated some of the big problems to solve. The mission is big. They have a new approach tested with retail banks. The data engineer will be key to bringing some of the solutions and the early stage product to life. The role > We’re looking for … someone that really fancies building a data platform from scratch alongside some very solid technical founders > Designing, building, and maintaining scalable data pipelines. > Collaborating with various teams to understand data requirements and implement solutions. > Optimizing data workflows and processes to enhance data quality, reliability, and more »

Senior Data Engineer Financial Services London (Hybrid) £90K plus bonuses and benefits Harrington Starr has partnered with leading data and analytics firm on the forefront of capital markets innovation as they seek to hire an experienced Data Engineer. Our client extends its services to global exchange … groups, banks, brokers, asset managers, and hedge funds. They are seeking to hire a dynamic and highly motivated data engineer for its London team. This individual should have an entrepreneurial mindset and the adaptability to thrive in an extremely fast paced environment. Within this role, you will be … responsible for building data pipelines for a cloud-based warehouse using Azure and Snowflake, enhancing data capabilities for analytics and science. What you need: 3+ years of hands-on experience as a Data Engineer, building ETL pipelines and managing data lifecycle. Strong Python coding experience. more »