226 to 250 of 682 Permanent Data Engineering Jobs

legacy cybersecurity systems, as well as the design and deployment of new enterprise security services. The engineer will support teams migrating services, applications, and platforms to Databricks, while optimizing data pipelines, governance, performance, and automation strategies. The ideal candidate will bring deep expertise in cloud-based data engineering, Databricks administration, pipeline orchestration, and secure software development practices … distributed team environment. Key Responsibilities •Support teams migrating services, applications, and platforms from legacy back-endsystems to Databricks. •Identify optimal migration paths, build migration plans, and execute delivery. •Migrate data pipelines from NiFi to Databricks, including validation. •Implement the medallion model for data assets on Databricks. •Develop SOPs for integrating data assets into Databricks with a focus … on efficiency,instrumentation, and performance. •Optimize development, testing, monitoring, and security processes for migrateddata assets. •Develop and implement strategies to streamline data asset migration andintegration. •Write code in various programming and scripting languages to automate/optimizedata ingestion, pipeline orchestration, and data management processes. •Enable transparency by leveraging AWS CloudWatch and related technologies tomonitor and measure pipeline performance. More ❯

Overview Data Technology group in MSCI is responsible to build and maintain state-of-the-art data management platform that delivers Reference. Market & other critical datapoints to various products of the firm. The platform, hosted on firms' data centers and Azure & GCP public cloud, processes 100 TB+ data and is expected to run 24 7. With … increased focus on automation around systems development and operations, Data Science based quality control and cloud migration, several tech stack modernization initiatives are currently in progress. To accomplish these initiatives, we are seeking a highly motivated and innovative individual to join the Data Engineering team for the purpose of supporting our next generation of developer tools and … infrastructure. The team is the hub around which Engineering, and Operations team revolves for automation and is committed to provide self-serve tools to our internal customers. Responsibilities Implement & Maintain Data Catalogs: Deploy and manage data catalog tool Collibra to improve data discoverability and governance. Metadata & Lineage Management: Automate metadata collection, establish data lineage, and More ❯

Data Engineer Are you ready to shape the future of data engineering at a leading UK retailer? We're on the lookout for a talented Data Engineer to join a forward-thinking organisation as they embark on an exciting migration to Microsoft Fabric. This is your chance to be at the heart of a major transformation … integrating multiple data systems into a scalable, unified platform and building a brand-new data warehouse to power smarter, faster reporting. With offices across the UK and a vibrant tech hub just outside Bristol, you'll collaborate closely with the Engineering Manager, fellow Engineers, and the wider IT team to unlock the full potential of the company … s data and drive data-led decision-making. As part of this role, you will be responsible for some of the following areas Architect and build a scalable data platform integrating diverse data sources Develop and maintain robust, efficient data pipelines Write clean, reliable code to transform and manipulate data Partner with senior technical More ❯

Data Engineer Are you ready to shape the future of data engineering at a leading UK retailer? We're on the lookout for a talented Data Engineer to join a forward-thinking organisation as they embark on an exciting migration to Microsoft Fabric. This is your chance to be at the heart of a major transformation … integrating multiple data systems into a scalable, unified platform and building a brand-new data warehouse to power smarter, faster reporting. With offices across the UK and a vibrant tech hub just outside Bristol, you'll collaborate closely with the Engineering Manager, fellow Engineers, and the wider IT team to unlock the full potential of the company … s data and drive data-led decision-making. As part of this role, you will be responsible for some of the following areas Architect and build a scalable data platform integrating diverse data sources Develop and maintain robust, efficient data pipelines Write clean, reliable code to transform and manipulate data Partner with senior technical More ❯

Salary: 50.000 - 60.000 € per year Requirements: • 3+ years of hands-on experience as a Data Engineer working with Databricks and Apache Spark • Strong programming skills in Python, with experience in data manipulation libraries (e.g., PySpark, Spark SQL) • Experience with core components of the Databricks ecosystem: Databricks Workflows, Unity Catalog, and Delta Live Tables • Solid understanding of data warehousing principles, ETL/ELT processes, data modeling and techniques, and database systems • Proven experience with at least one major cloud platform (Azure, AWS, or GCP) • Excellent SQL skills for data querying, transformation, and analysis • Excellent communication and collaboration skills in English and German (min. B2 levels) • Ability to work independently as well as part of a … team in an agile environment Responsibilities: As a Data Engineer with a focus on Databricks, you will play a key role in building modern, scalable, and high-performance data solutions for our clients. You'll be part of our growing Data & AI team and work hands-on with the Databricks platform, supporting clients in solving complex data More ❯

Job Title : GCP Data Engineer Location : New York, NY Duration : 06+ Months, with extension Key Responsibilities: Design, build, and maintain scalable data pipelines on GCP, primarily using BigQuery. Develop and manage DBT models to transform raw data into clean, tested, and documented datasets. Write complex and optimized SQL queries for data extraction, transformation, and analysis. Implement … and maintain data warehousing solutions, ensuring performance, scalability, and reliability. Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements and deliver high-quality solutions. Monitor and troubleshoot data pipeline performance and data quality issues. Automate data workflows and tasks using Python scripts where necessary. Ensure data governance, security … and compliance standards are met. Required Qualifications: Bachelors degree in Computer Science, Information Systems, or a related field. 8+ years of experience in data engineering or a similar role. Strong expertise in SQL with the ability to write efficient, complex queries. Proficiency in DBT for data modeling and transformation Hands-on experience with BigQuery and other GCP More ❯

technological excellence to become the preferred partner for banks and consultancies worldwide. As a company, everyone is expected to contribute to delivering great outcomes for our clients. We are engineering-led and seek someone excited by the potential of Engine's technology to transform banking markets globally. Hybrid Working We support a hybrid work model, preferring team members to … be within commuting distance of our offices for in-person collaboration. About the Role As Engine's SaaS platform, we manage all data necessary for our client banks. Your role involves modeling, extracting, joining, and securely sharing data to provide insights, regulatory reports, and support marketing. We process millions of data rows daily, with plans to expand. … We are enhancing our reporting tools to deliver better, faster insights and improve internal operations. You will be central to our reporting tools, developing new data features, enhancing data exposure to clients and teams, and building tools for data lineage, quality, and documentation accuracy. You will also support platform engineers in modeling new features for client use. More ❯

a digital insurance provider with ambitious plans to become The Best and Biggest in the UK market. Over the past few years, we've made significant investments in our data and tech capabilities, particularly within our CIO function. Our CIO team is at the forefront of driving innovation and ensuring our technology infrastructure supports our ambitious goals. We've … in this journey, working on cutting-edge projects that enhance our digital presence and improve customer engagement. As a Principal AI Engineer, you will be part of the Technology Engineering team within CIO, leading the design, development, and deployment of advanced AI and machine learning solutions that drive innovation, efficiency, and strategic value across the organisation. You will collaborate … closely with cross-functional teams, including Data Science, Engineering, Product, and Business stakeholders, to understand complex business challenges and identify opportunities where AI can deliver measurable impact. You will lead the end-to-end lifecycle of AI initiatives - from problem framing and data exploration to model development, deployment, and monitoring - ensuring solutions are scalable, ethical, and aligned More ❯

competitive salary of £60,000 - £70,000 per annum. About the role: As our Senior Databricks Engineer, you will operate within an Agile delivery environment, working closely with the Data Product Manager and Data Architect to ensure your team maintains a pipeline of delivery against the Backlog; providing vital insight from our wide-ranging dataset to support executive … very much a hands-on role, where the majority of your time will be spent actively developing solutions. You will also have management responsibilities for a small team of Data Engineers, who you will coach, support and organise to ensure we sustain a predictable pipeline of delivery, whilst ensuring all appropriate governance and best practice is adhered to. Your … responsibilities as our Senior Databricks Engineer will include: Understand the business/product strategy and supporting goals with the purpose of ensuring data interpretation aligns Provide technical leadership on how to break down initiatives into appropriately sized features, epics and stories that balance value and risk. Take a leadership role on setting standards, driving quality and consistency in solution More ❯

competitive salary of £60,000 - £70,000 per annum. About the role: As our Senior Databricks Engineer, you will operate within an Agile delivery environment, working closely with the Data Product Manager and Data Architect to ensure your team maintains a pipeline of delivery against the Backlog; providing vital insight from our wide-ranging dataset to support executive … very much a hands-on role, where the majority of your time will be spent actively developing solutions. You will also have management responsibilities for a small team of Data Engineers, who you will coach, support and organise to ensure we sustain a predictable pipeline of delivery, whilst ensuring all appropriate governance and best practice is adhered to. Your … responsibilities as our Senior Databricks Engineer will include: Understand the business/product strategy and supporting goals with the purpose of ensuring data interpretation aligns Provide technical leadership on how to break down initiatives into appropriately sized features, epics and stories that balance value and risk. Take a leadership role on setting standards, driving quality and consistency in solution More ❯

self-starter to serve as an ADVANA Developer supporting the Southern Command Operations, Planning, and Engagement Support (SCOPES) program. This position will reside in the Office of the Chief Data Officer as part of a project spanning various development, data science, and knowledge management functions. This position requires a strong background in software development, data engineering principles, and cloud technologies. The ADVANA Developer will contribute to building and enhancing capabilities that enable data-driven decision-making for SOUTHCOM. Responsibilities: • Design and Development: Participate in the full software development lifecycle, including requirements gathering, system design, development, testing, and deployment of applications and data pipelines within the ADVANA environment. • Data Engineering: Develop and … maintain robust and scalable data pipelines to ingest, transform, cleanse, and integrate data from various DoD source systems into the ADVANA data lake. • Cloud Technologies: Utilize and contribute to the development within ADVANA's cloud based architecture, leveraging cloud-native services for data storage, processing, and analytics. • Programming and Scripting: Write efficient and maintainable code in More ❯

Senior Application Developer () Federated Hermes, Inc., a global leader in active, responsible investing, is seeking a Senior Application Developer to join our Enterprise Data and Reporting department based in our Warrendale, Pennsylvania office. What Youll Do As part of Federated Hermes Global Technology Organization, you will be responsible to: Design, build, and maintain scalable data pipelines on Databricks … using Spark, Delta Lake, etc.) Write clean, efficient and maintainable PySpark or SQL code for data transformation Design robust data models for analytics and reporting Ensure data quality, consistency, and governance Handle batch and streaming data workflows Provide architectural guidance and support in platform usage Drive best practices in data engineering across the team … Monitor and optimize performance of Spark jobs and cluster usage Ensure compliance with security and data privacy standards This position offers a hybrid schedule (in-office/remote) and is located in Federated Hermes Warrendale, Pennsylvania office (15086). The Expertise We are Looking For Bachelors degree in Computer Science, Engineering, or a related field Minimum of More ❯

and Media Ref # Description & Requirements Smarter, Faster, and as always - First. That's our philosophy. Bloomberg Media empowers global business leaders with breaking news, expert opinion, and proprietary data distributed on every platform, across every time zone. Like our products and solutions, our teams are agile, dynamic, and innovative. We work hard, and we work fast - while keeping … communities around us, too. You can do amazing work here. Work you couldn't do anywhere else. It's up to you to make it happen. Bloomberg runs on data, and data drives the market. Our Consumer Media Insights team is an integral part of driving our business through data-backed decision making for Bloomberg Media. Individuals … who can bring both strategic thinking and hands-on technical skills. You will partner closely with leaders across Subscriptions, Product, Marketing, Editorial, and support additional business units including commercial, engineering, research, and strategy/operations. This highly visible, cross-functional role will require technical expertise in SQL and Python, strong analytical storytelling, and the ability to influence product and More ❯

Your new company A Principal Data Engineer is required on a permanent basis for a forward-thinking organisation at the heart of Leeds. The Data Services team are on a mission to unlock the value of data by delivering high-quality, secure, and accessible data services. With a focus on modern cloud-based technologies and strong … partnerships, they help colleagues navigate the complexities of a data-driven world. Your new role As a Principal Data Engineer, you will be instrumental in shaping the organisations strategic cloud data platform. You'll lead the design and implementation of scalable data pipelines, drive innovation in data-centric products, and champion automation and predictive analytics. … technical leadership role where you'll establish best practices, ensure compliance, and deliver smart, customer-focused solutions. What you'll need to succeed You'll bring extensive experience in data engineering within Azure environments, with a strong track record in modernisation and large-scale migration projects. You'll be confident designing metadata-driven frameworks and managing Databricks environments More ❯

an opportunity to join a collaborative, science-led team making a tangible impact on global healthcare. This role will offer you: The opportunity to work on diverse, high-impact data engineering projects across multiple research and development areas, including Clinical Trials, Omics, Real World Data, and more. Collaboration with international teams of researchers, data scientists, and … stakeholders in a cross-functional setting. Exposure to cutting-edge cloud technologies, modern data architecture, and the latest in healthcare data standards. A meaningful role where your work directly supports the development of life-changing medicines. Responsibilities: Design, develop, and maintain data pipelines for diverse research datasets using cloud-based technologies. Create and optimise ETL/ELT … processes for structured and unstructured data. Build and manage data repositories and warehousing solutions. Develop and implement data quality frameworks, validation processes, and KPIs. Ensure data traceability and regulatory compliance through versioning and lineage tracking. Collaborate with internal teams to understand data requirements and deliver scalable solutions. Maintain compliance with data privacy regulations such as More ❯

Your new company A Principal Data Engineer/Architect is required on a permanent basis for a forward-thinking organisation at the heart of Leeds. The Data Services team are on a mission to unlock the value of data by delivering high-quality, secure, and accessible data services. With a focus on modern cloud-based technologies … and strong partnerships, they help colleagues navigate the complexities of a data-driven world. Your new role As a Principal Data Engineer, you will be instrumental in shaping the organisations strategic cloud data platform. You'll lead the design and implementation of scalable data pipelines, drive innovation in data-centric products, and champion automation and … technical leadership role where you'll establish best practices, ensure compliance, and deliver smart, customer-focused solutions. What you'll need to succeed You'll bring extensive experience in data engineering within Azure environments, with a strong track record in modernisation and large-scale migration projects. You'll be confident designing metadata-driven frameworks and managing Databricks environments More ❯

Lead Azure Data Engineer The Lead Azure Data Engineer will play a pivotal role in managing and optimising data solutions within the financial services sector. This position focuses on leveraging Azure-based technologies to support the analytics department in delivering high-performing data solutions. Client Details Lead Azure Data Engineer The organisation is a medium … within the financial services industry, known for its focus on innovation and technology-driven solutions. It offers a collaborative environment, fostering growth within the analytics field. Description Lead Azure Data Engineer Design and implement scalable data solutions using Azure technologies. Collaborate with the analytics team to align data architecture with business objectives. Develop and maintain robust ETL … pipelines for data processing and integration. Ensure data security and compliance with industry standards and regulations. Monitor and optimise data storage and processing performance within Azure environments. Provide technical leadership and mentoring to junior team members. Document processes, system designs, and workflows for future reference. Stay updated on emerging trends and technologies in data engineering More ❯

matters, but delivery, stability, and scalability always come first? Hold onto those thoughts. Now let us introduce you to something special, a chance to join us as VP of Engineering at ASK BOSCO as we build the foundations for our next phase of hyper-growth. By the end, if it doesn't feel like the right fit, no worries. … But if you feel that spark, the same one we've got, this could be the start of something extraordinary. The Role at a Glance: VP of Engineering(Python) Hybrid Leeds HQ, 2 Days per Week £120,000 + Equity Potential Plus Benefits: 4-day week, 23 days annual leave + bank holidays, health insurance, retail & leisure perks, electric … Visionary Founder. Backed by renowned tech entrepreneurs, including co-founder of SkyScanner. Profits with Purpose - 10% of profits donated to 1moreChild orphanage annually Your Expertise: You're a proven engineering leader with deep experience in building, scaling, and managing cross-functional tech teams: data engineers, data scientists, data analysts, and developers. You've led teams through More ❯

matters, but delivery, stability, and scalability always come first? Hold onto those thoughts. Now let us introduce you to something special, a chance to join us as VP of Engineering at ASK BOSCO as we build the foundations for our next phase of hyper-growth. By the end, if it doesn’t feel like the right fit, no worries. … But if you feel that spark, the same one we’ve got, this could be the start of something extraordinary. The Role at a Glance: VP of Engineering Hybrid Leeds HQ, 2 Days per Week £120,000 Equity Potential Plus Benefits: 4-day week, 23 days annual leave bank holidays, health insurance, retail & leisure perks, electric car scheme Values … entrepreneurs, including co-founder of SkyScanner. Profits with Purpose — 10% of profits donated to 1moreChild orphanage annually Markets: Marketing & eCommerce Agencies, eCommerce retailers Your Expertise: You’re a proven engineering leader with deep experience in building, scaling, and managing cross-functional tech teams: data engineers, data scientists, data analysts, and developers. You’ve led teams through More ❯

matters, but delivery, stability, and scalability always come first? Hold onto those thoughts. Now let us introduce you to something special, a chance to join us as VP of Engineering at ASK BOSCO as we build the foundations for our next phase of hyper-growth. By the end, if it doesn't feel like the right fit, no worries. … But if you feel that spark, the same one we've got, this could be the start of something extraordinary. Role at a Glance VP of Engineering Hybrid Leeds HQ, 2 Days per Week £120,000 + Equity Potential Plus Benefits: 4-day week, 23 days annual leave + bank holidays, health insurance, retail & leisure perks, electric car scheme … Visionary Founder. Backed by renowned tech entrepreneurs, including co-founder of SkyScanner. Profits with Purpose - 10% of profits donated to 1moreChild orphanage annually Your Expertise You're a proven engineering leader with deep experience in building, scaling, and managing cross-functional tech teams: data engineers, data scientists, data analysts, and developers. You've led teams through More ❯

matters, but delivery, stability, and scalability always come first? Hold onto those thoughts. Now let us introduce you to something special, a chance to join us as VP of Engineering at ASK BOSCO as we build the foundations for our next phase of hyper-growth. By the end, if it doesn't feel like the right fit, no worries. … But if you feel that spark, the same one we've got, this could be the start of something extraordinary. The Role at a Glance VP of Engineering Hybrid Leeds HQ, 2 Days per Week £120,000 + Equity Potential Plus Benefits: 4-day week, 23 days annual leave + bank holidays, health insurance, retail & leisure perks, electric car … Visionary Founder. Backed by renowned tech entrepreneurs, including co-founder of SkyScanner. Profits with Purpose - 10% of profits donated to 1moreChild orphanage annually Your Expertise You're a proven engineering leader with deep experience in building, scaling, and managing cross-functional tech teams: data engineers, data scientists, data analysts, and developers. You've led teams through More ❯

matters, but delivery, stability, and scalability always come first? Hold onto those thoughts. Now let us introduce you to something special, a chance to join us as VP of Engineering at ASK BOSCO as we build the foundations for our next phase of hyper-growth. By the end, if it doesn t feel like the right fit, no worries. … But if you feel that spark, the same one we ve got, this could be the start of something extraordinary. The Role at a Glance: VP of Engineering (Python) Hybrid Leeds HQ, 2 Days per Week £120,000 + Equity Potential Plus Benefits: 4-day week, 23 days annual leave + bank holidays, health insurance, retail & leisure perks, electric … entrepreneurs, including co-founder of SkyScanner. Profits with Purpose 10% of profits donated to 1moreChild orphanage annually Markets: Marketing & eCommerce Agencies, eCommerce retailers Your Expertise: You re a proven engineering leader with deep experience in building, scaling, and managing cross-functional tech teams: data engineers, data scientists, data analysts, and developers. You ve led teams through More ❯

matters, but delivery, stability, and scalability always come first? Hold onto those thoughts. Now let us introduce you to something special, a chance to join us as VP of Engineering at ASK BOSCO® as we build the foundations for our next phase of hyper-growth. By the end, if it doesn't feel like the right fit, no worries. … But if you feel that spark, the same one we've got, this could be the start of something extraordinary. The Role at a Glance: VP of Engineering (Python) Hybrid Leeds HQ, 2 Days per Week £120,000 + Equity Potential Plus Benefits: 4-day week, 23 days annual leave + bank holidays, health insurance, retail & leisure perks, electric … entrepreneurs, including co-founder of SkyScanner. Profits with Purpose — 10% of profits donated to 1moreChild orphanage annually Markets: Marketing & eCommerce Agencies, eCommerce retailers Your Expertise: You're a proven engineering leader with deep experience in building, scaling, and managing cross-functional tech teams: data engineers, data scientists, data analysts, and developers. You've led teams through More ❯

matters, but delivery, stability, and scalability always come first? Hold onto those thoughts. Now let us introduce you to something special, a chance to join us as VP of Engineering at ASK BOSCO® as we build the foundations for our next phase of hyper-growth. By the end, if it doesn't feel like the right fit, no worries. … But if you feel that spark, the same one we've got, this could be the start of something extraordinary. The Role at a Glance: VP of Engineering (Python) Hybrid Leeds HQ, 2 Days per Week £120,000 + Equity Potential Plus Benefits: 4-day week, 23 days annual leave + bank holidays, health insurance, retail & leisure perks, electric … entrepreneurs, including co-founder of SkyScanner. Profits with Purpose — 10% of profits donated to 1moreChild orphanage annually Markets: Marketing & eCommerce Agencies, eCommerce retailers Your Expertise: You're a proven engineering leader with deep experience in building, scaling, and managing cross-functional tech teams: data engineers, data scientists, data analysts, and developers. You've led teams through More ❯

matters, but delivery, stability, and scalability always come first? Hold onto those thoughts. Now let us introduce you to something special, a chance to join us as VP of Engineering at ASK BOSCO® as we build the foundations for our next phase of hyper-growth. By the end, if it doesn't feel like the right fit, no worries. … But if you feel that spark, the same one we've got, this could be the start of something extraordinary. The Role at a Glance: VP of Engineering (Python) Hybrid Leeds HQ, 2 Days per Week £120,000 + Equity Potential Plus Benefits: 4-day week, 23 days annual leave + bank holidays, health insurance, retail & leisure perks, electric … entrepreneurs, including co-founder of SkyScanner. Profits with Purpose — 10% of profits donated to 1moreChild orphanage annually Markets: Marketing & eCommerce Agencies, eCommerce retailers Your Expertise: You're a proven engineering leader with deep experience in building, scaling, and managing cross-functional tech teams: data engineers, data scientists, data analysts, and developers. You've led teams through More ❯