1 to 25 of 407 Remote Permanent Data Lake Jobs

Senior Data Engineer - (Azure/Databricks) Axis Capital London, United Kingdom Apply now Posted 15 days ago Permanent Competitive Senior Data Engineer - (Azure/Databricks) Axis Capital London, United Kingdom Apply now This is your opportunity to join AXIS Capital - a trusted global provider of specialty lines insurance and reinsurance. We stand apart for our outstanding … data solutions are secure, efficient, and optimized. Key Responsibilities: Design and implement data solutions using Azure services, including Azure Databricks, ADF, and Data Lake Storage. Develop and maintain ETL/ELT pipelines to process structured and unstructured data from multiple sources. - Automate loads using Databricks workflows and Jobs Develop, test and … warehousing, and real-time streaming. Knowledge of developing and processing full and incremental loads. Experience of automated loads using Databricks workflows and Jobs Expertise in Azure Databricks, including Delta Lake, Spark optimizations, and MLflow. Strong experience with Azure Data Factory (ADF) for data integration and orchestration. Hands-on experience with Azure DevOps, including pipelines, repos More ❯

Senior Data Engineer - (Azure/Databricks) page is loaded Senior Data Engineer - (Azure/Databricks) Apply locations London - Scalpel time type Full time posted on Posted 15 Days Ago job requisition id REQ05851 This is your opportunity to join AXIS Capital - a trusted global provider of specialty lines insurance and reinsurance. We stand apart for our … data solutions are secure, efficient, and optimized. Key Responsibilities: Design and implement data solutions using Azure services, including Azure Databricks, ADF, and Data Lake Storage. Develop and maintain ETL/ELT pipelines to process structured and unstructured data from multiple sources. - Automate loads using Databricks workflows and Jobs Develop, test and … warehousing, and real-time streaming. Knowledge of developing and processing full and incremental loads. Experience of automated loads using Databricks workflows and Jobs Expertise in Azure Databricks, including Delta Lake, Spark optimizations, and MLflow. Strong experience with Azure Data Factory (ADF) for data integration and orchestration. Hands-on experience with Azure DevOps, including pipelines, repos More ❯

will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and More ❯

will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and More ❯

will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and More ❯

will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and More ❯

will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and More ❯

Salary: 50.000 - 60.000 € per year Requirements: • 3+ years of hands-on experience as a Data Engineer working with Databricks and Apache Spark • Strong programming skills in Python, with experience in data manipulation libraries (e.g., PySpark, Spark SQL) • Experience with core components of the Databricks ecosystem: Databricks Workflows, Unity Catalog, and Delta Live Tables • Solid understanding of … data warehousing principles, ETL/ELT processes, data modeling and techniques, and database systems • Proven experience with at least one major cloud platform (Azure, AWS, or GCP) • Excellent SQL skills for data querying, transformation, and analysis • Excellent communication and collaboration skills in English and German (min. B2 levels) • Ability to work independently as well … ingest, transform, and load data from various sources (databases, APIs, streaming platforms) into cloud-based data lakes and warehouses • Leveraging the Databricks ecosystem (SQL, Delta Lake, Workflows, Unity Catalog) to deliver reliable and performant data workflows • Integrating with cloud services such as Azure, AWS, or GCP to enable secure, cost-effective data More ❯

European locations. We believe in the power of agile and cross-functional collaboration, bringing together people from various backgrounds to create outstanding digital solutions. Aufgaben As a Data Engineer with a focus on Databricks , you will play a key role in building modern, scalable, and high-performance data solutions for our clients. You'll be part … of our growing Data & AI team and work hands-on with the Databricks platform, supporting clients in solving complex data challenges. Your Job's Key Responsibilities Are: Designing, developing, and maintaining robust data pipelines using Databricks, Spark, and Python Building efficient and scalable ETL processes to … ingest, transform, and load data from various sources (databases, APIs, streaming platforms) into cloud-based data lakes and warehouses Leveraging the Databricks ecosystem (SQL, Delta Lake, Workflows, Unity Catalog) to deliver reliable and performant data workflows Integrating with cloud services such as Azure, AWS, or GCP to enable secure, cost-effective data More ❯

European locations. We believe in the power of agile and cross-functional collaboration, bringing together people from various backgrounds to create outstanding digital solutions. Aufgaben As a Data Engineer with a focus on Databricks , you will play a key role in building modern, scalable, and high-performance data solutions for our clients. You'll be part … of our growing Data & AI team and work hands-on with the Databricks platform, supporting clients in solving complex data challenges. Your Job's Key Responsibilities Are: Designing, developing, and maintaining robust data pipelines using Databricks, Spark, and Python Building efficient and scalable ETL processes to … ingest, transform, and load data from various sources (databases, APIs, streaming platforms) into cloud-based data lakes and warehouses Leveraging the Databricks ecosystem (SQL, Delta Lake, Workflows, Unity Catalog) to deliver reliable and performant data workflows Integrating with cloud services such as Azure, AWS, or GCP to enable secure, cost-effective data More ❯

European locations. We believe in the power of agile and cross-functional collaboration, bringing together people from various backgrounds to create outstanding digital solutions. Aufgaben As a Data Engineer with a focus on Databricks , you will play a key role in building modern, scalable, and high-performance data solutions for our clients. You'll be part … of our growing Data & AI team and work hands-on with the Databricks platform, supporting clients in solving complex data challenges. Your Job's Key Responsibilities Are: Designing, developing, and maintaining robust data pipelines using Databricks, Spark, and Python Building efficient and scalable ETL processes to … ingest, transform, and load data from various sources (databases, APIs, streaming platforms) into cloud-based data lakes and warehouses Leveraging the Databricks ecosystem (SQL, Delta Lake, Workflows, Unity Catalog) to deliver reliable and performant data workflows Integrating with cloud services such as Azure, AWS, or GCP to enable secure, cost-effective data More ❯

Are you an experienced Data Engineer with in depth knowledge of both on-premises SQL data warehouses and modern Lakehouse architectures hosted on Azure? Do you enjoy bringing ideas to the table and sharing knowledge with stakeholders? If so, the Data Engineer role here at Harding+ could be perfect for you. About the role … smooth integration between the on-prem and future cloud environments. Cloud Infrastructure Design: Design and implement Azure-based data architecture, leveraging tools like Azure Data Lake, Azure Synapse Analytics, and Fabric’s data capabilities to future-proof the platform Azure Expertise: Utilize Azure tools such as Synapse Analytics, Logic Apps, and Azure Functions … applying data architecture principles to create robust, scalable solutions Azure Cloud Proficiency: Deep understanding of Azure cloud tools such as Azure Synapse Analytics, Azure Data Lake, Azure Data Factory, and Logic Apps Microsoft Fabric: Hands-on experience with Microsoft Fabric or similar modern cloud platforms, with a strong focus on data More ❯

Overview Role: Senior Data Engineer and Platform Lead -Manufacturing Location: Hybrid/Remote Position: Staff Morgan Advanced Materials is a world leader in the development and production of advanced materials. We produce a wide range of specialist, high specification materials that have extraordinary attributes and properties. Despite the complexity of our technologies, our focus is simple - we supply … advanced materials that enable our customers' products to perform more efficiently, more reliably and for longer. Morgan is making a significant investment in establishing a world-class global data team, and we are excited to welcome new employees who will play a crucial role in this initiative. As part of this team, you will be instrumental in building … the future data platform that will drive the success of our enterprise. Your contributions will not only shape the foundation of our data capabilities but also help position Morgan as a leader in leveraging data to achieve strategic business goals. This is a unique opportunity to be a part of a transformative journey, where More ❯

significant decisions with confidence, provide strong foundations for the future and guide them towards their goals. Job Description Job Purpose Evelyn Partners is recruiting a skilled and experienced Data Engineer to join a growing team to deliver a large data modernisation programme. As a Data Services Data Engineer, you will be responsible … for designing, developing, and maintaining our MS SQL Server Data Warehouses and associated data feeds into and out of the warehouses, and developing on our new modern cloud data platform, requiring Snowflake, dbt and Azure Data Factory experience. Our data platform's support regulatory requirements, business intelligence & reporting needs and … GitHub. • Extensive experience in designing, building, deploying, and supporting cloud-based data products and pipelines. • Experience with Azure Storage services such as Blob Storage, Data Lake Storage, or Azure Files. • Hands-on experience designing and developing data pipelines using Azure Data Factory. • Experience of data warehouse design and implementation More ❯

their unique goals and ambitions. Role Summary The purpose of the MI/BI & Insight Manager is to effectively lead and co-ordinate a team of MI Analysts, Data Analysts and BI Developers to generate, analyse and present information for key operational and business activities in order to deliver insightful analysis and reporting to support Business Managers. And … policies, procedures, legislative and regulatory requirements, while providing exceptional internal customer service and driving business growth. Play a key role in the development of the roadmap for the data platform and reporting solutions. Act as key curator of data within the team, being responsible for the processes of collection, governance, storage, security and accessibility of all … Cloud Computing platforms (ADLS Gen2), Microsoft Stack (Synapse, DataBricks, Fabric, Profisee), Azure Service Bus, Power BI, DeltaLake, Azure DevOps, Azure Monitor, Azure Data Factory, SQL Server, Azure DataLake Storage, Azure App service, Azure ML is a plus Languages: Python, SQL, T-SQL, SSIS DB: Azure SQL Database, Cosmos DB, NoSQL, Methodologies: Agile, DevOps must have Concepts: ELT/ More ❯

Senior Manager at Tenth Revolution Group - Helping organisations across the UK hire the best Cloud Talent. Azure Data Engineer - £70,000 - Home based with occasional client visits. Locations: London, Edinburgh, Manchester About Us: We are a leading data consultancy, dedicated to empowering businesses with cutting-edge data solutions. Our focus is on AI readiness … data literacy, real-time reporting, and complex data management projects, including mergers and acquisitions. By fostering a culture of innovation and problem-solving, we help organizations unlock the full potential of their data. The Role: We are looking for a Senior Data Engineer to join our dynamic and growing team. In this role, you … will work closely with clients to design and implement high-performance data solutions, primarily leveraging Microsoft Azure technologies. You will be instrumental in guiding businesses through their data transformation journeys, helping them make informed, data-driven decisions. Key Responsibilities: Develop and implement data engineering solutions using tools like Azure Data More ❯

Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £50,000 - £77,500 - depending on experience Department: Technology and Data We’re First Central Insurance & Technology Group (First Central for short), an innovative, market-leading insurance company. We protect the things customers love so they can get on with what matters to them in life. Data drives us. It fuels our outstanding distribution, finance, technology and legal services. Our underwriting skills are built on data expertise; it creates the insights we need to give the right cover to the right customers at the right price. But, it’s the people inside and outside our business that power us. They make us stand … Data pipelines, promoting self-testing pipelines that proactively identify processing issues or discrepancies. You’ll build solutions that pipe transform data into data lake storage areas, physical database models and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications. You’ll build physical data More ❯

Senior Data Engineering Consultant - MS Fabric - London - Hybrid - £80k My client are an emerging Microsoft-partnered consultancy looking to expand their data engineering team. If you are an expert data engineer with Microsoft products and a consultancy background, this should be a great fit for you. Salary and Benefits Competitive salary of up to … working (2-3 days in London-based office) Competitive annual leave package Private medical care Health insurance And many more Role and Responsibilities Possess a wide range of data engineering skills, with a focus on having delivered in Microsoft Fabric Develop good working relationships with clients on a project including interpersonal skills with both business and technical focused … colleagues. Experience working as a data engineer to develop performant end-to-end solutions in a collaborative team environment. Delivering high-quality pieces of work, proven ability to escalate problems to client/senior team members where necessary and propose possible solutions. Support building the Consulting practice through contribution to ongoing initiatives. This can include contributing to knowledge More ❯

Senior Data Engineering Consultant - MS Fabric - London - Hybrid - £80k My client are an emerging Microsoft-partnered consultancy looking to expand their data engineering team. If you are an expert data engineer with Microsoft products and a consultancy background, this should be a great fit for you. Salary and Benefits Competitive salary of up to … working (2-3 days in London-based office) Competitive annual leave package Private medical care Health insurance And many more Role and Responsibilities Possess a wide range of data engineering skills, with a focus on having delivered in Microsoft Fabric Develop good working relationships with clients on a project including interpersonal skills with both business and technical focused … colleagues. Experience working as a data engineer to develop performant end-to-end solutions in a collaborative team environment. Delivering high-quality pieces of work, proven ability to escalate problems to client/senior team members where necessary and propose possible solutions. Support building the Consulting practice through contribution to ongoing initiatives. This can include contributing to knowledge More ❯

to technology, delivering bespoke software solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science and AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles, with openings at senior or lead level to suit your experience. You may be … or solving tough engineering challenges. You'd also be expected to spend some time on-site with clients in the London area on an ad-hoc basis. Our data engineers combine a strong software engineering approach with solid data fundamentals and experience with modern tools. We’re technology agnostic, and we’re open minded when it More ❯

to technology, delivering bespoke software solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science and AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles, with openings at senior or lead level to suit your experience. You may be … or solving tough engineering challenges. You'd also be expected to spend some time on-site with clients in the London area on an ad-hoc basis. Our data engineers combine a strong software engineering approach with solid data fundamentals and experience with modern tools. We’re technology agnostic, and we’re open minded when it More ❯

to technology, delivering bespoke software solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science and AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles, with openings at senior or lead level to suit your experience. You may be … or solving tough engineering challenges. You'd also be expected to spend some time on-site with clients in the London area on an ad-hoc basis. Our data engineers combine a strong software engineering approach with solid data fundamentals and experience with modern tools. We’re technology agnostic, and we’re open minded when it More ❯

to technology, delivering bespoke software solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science and AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles, with openings at senior or lead level to suit your experience. You may be … or solving tough engineering challenges. You'd also be expected to spend some time on-site with clients in the London area on an ad-hoc basis. Our data engineers combine a strong software engineering approach with solid data fundamentals and experience with modern tools. We’re technology agnostic, and we’re open minded when it More ❯

My client is based in the London area and is currently looking to recruit an experienced Fabric Data Engineer to join their team. They are one of the leaders within the Insurance space. They are currently going through a period of growth and are looking for an experienced Data Engineer to join their team. They are … Factory, Onelake(nice to have), and Fabric (nice to have). Excellent understanding of Microsoft SQL Server and data modelling, An understanding of Notebooks, One Lake, Data Factory, Data Modelling, Fabric (MUST), and Data Pipelines. Strong understanding of the wider Microsoft solution stack. Strong hands-on experience in Data Warehouse and Data Lake technologies, preferably around Azure. This role is an urgent requirement; there are limited interview slots left. If interested, send an up-to-date CV to Shoaib Khan - or call for a catch-up in complete confidence. TRG's Data Team offers more opportunities across the UK than any other More ❯

Job Title: Data Engineer (Fabric, Synapse & ADF) Location: Remote (UK-based candidates only) Contract: 3–6 Month Rolling Contract IR35 Status: Outside IR35 Day Rate: £500–£600 per day Overview: We’re looking for an experienced Data Engineer to join a dynamic team working across a variety of exciting data projects. This role involves … a blend of greenfield builds, brownfield enhancements, and support of existing solutions, giving you the chance to work across the full data engineering lifecycle. This is a remote-based position, open to UK-based candidates only, and is offered on an Outside IR35 basis. Key Responsibilities: Design, build, and maintain scalable data pipelines using Microsoft Fabric … brownfield projects. Comfortable working independently in a remote setup. Strong communication and stakeholder engagement skills. Nice to Have: Experience with other Azure services such as Azure Data Lake, Databricks, or Power BI. Familiarity with DevOps/DataOps processes and tools. Microsoft Certified: Fabric Analytics Engineer Associate Start Date: ASAP or July start acceptable Apply now to join More ❯