1 to 25 of 145 Remote Data Lake Jobs

Data/Data Specialisation). Extensive experience in Data Engineering, in both Cloud & On-Prem, Big Data and Data Lake environments. Expert knowledge in data technologies, data transformation tools, data governance techniques. Strong analytical and problem-solving abilities. Good understanding of Quality and … or Azure hands-on experience. ETL Tools such as Azure Data Fabric (ADF) and Databricks or similar ones. Data Lakes: Azure Data, Delta Lake, Data Lake or Databricks Lakehouse. Certifications: AWS, Azure, or Cloudera certifications are a plus. To be considered for this role you MUST have in-depth experience … Engineer, Spark, Java, Python, PySpark, Scala, Big Data, AWS, Azure, Cloud, On-Prem, ETL, Azure Data Fabric, ADF, Hadoop , HDFS , Azure Data, Delta Lake, Data Lake Please note that due to a high level of applications, we can only respond to applicants whose skills and qualifications are suitable for this More ❯

About Us: ATREIDES is a leader in advanced geospatial technologies, big data solutions, and data analytics. We specialize in providing cutting-edge software platforms that enable our clients to process, analyze, and visualize large-scale geospatial and sensor data for critical decision-making. Our mission is to deliver innovative, scalable, and high-performance platforms … that help organizations unlock the full potential of their data for various industries, including defense, national security, environmental monitoring, and urban planning. We are seeking a highly skilled Senior Data Engineer with a strong focus on big data, data analytics, and geospatial data intelligence to join our engineering team. In … this role, you will help design and develop robust, scalable platforms that handle vast amounts of geospatial data and provide actionable insights through data analytics. Job Overview: As a Senior Data Engineer at ATREIDES, you will be responsible for developing and optimizing our core software platform, with an emphasis on integrating and processing big More ❯

Job Description: BLN24 is seeking a highly skilled Data Engineering Specialist with demonstrated experience in developing data models for implementation in a data lake architecture. The ideal candidate will have a proven track record of successfully handling projects of similar size and scope. Key Responsibilities: Design and develop data models for … implementation in a data lake architecture. Collaborate with cross-functional teams to understand data requirements and translate them into effective data models. Ensure data models are optimized for performance and scalability. Implement and maintain data pipelines to support data lake architecture. Monitor and troubleshoot data … guidance and support to team members and stakeholders. Qualifications: Bachelors of Science in relevant field of study Proven experience in developing data models for data lake architectures. Strong understanding of data modeling principles and best practices. Proficiency in data modeling tools and technologies. Excellent problem-solving and analytical skills. Strong communication More ❯

Key Responsibilities: Data Pipelines and ETL Processes ETL Design: Design and implement ETL processes within MaPS architectural patterns to extract, transform, and load data from various source systems into our reporting solutions. Pipeline Development: Develop and configure meta-data driven data pipelines using data orchestration tools such as Azure Data … unusual data profiles and establish recovery processes to maintain data integrity. Azure Services Utilise Azure Cloud based data technology platforms, Data Lake based storage & Cloud data pipeline/orchestration tools for efficient data storage, processing, and transfer. Ensure the scalability and reliability of data solutions … implementing ETL processes. Experience in using SQL to query and manipulate data. Proficiency in Azure data tooling such as Synapse Analytics, Microsoft Fabric, Azure Data Lake Storage/One Lake, and Azure Data Factory. Understanding of data extraction from vendor REST APIs. Spark/Pyspark or Python skills a bonus More ❯

Join our rapidly expanding team as a hands-on Cloud Data Analytics Platform Engineer and play a pivotal role in shaping the future of data at Citi. We're building a cutting-edge, multi-cloud data analytics platform that empowers our users with secure, scalable, and efficient data insights. This role sits … like S3/GCS, Glue, BigQuery, Pub/Sub, SQS/SNS, MWAA/Composer, and more to create a seamless data experience. (Required) Data Lake , Data Zone, Data Governance: Design, build, and manage data lakes and data zones within our cloud environment, ensuring data … Infrastructure Automation Cloud Expertise: Proven hands-on experience with AWS and/or GCP, including a deep understanding of their data analytics service offerings. Data Lake/Zone/Governance Experience: Demonstrable experience designing, building, and managing data lakes and data zones. Familiarity with data governance tools and frameworks. More ❯

Senior Data Engineer - (Azure/Databricks) page is loaded Senior Data Engineer - (Azure/Databricks) Apply locations London - Scalpel time type Full time posted on Posted 7 Days Ago job requisition id REQ05851 This is your opportunity to join AXIS Capital - a trusted global provider of specialty lines insurance and reinsurance. We stand apart for our … data solutions are secure, efficient, and optimized. Key Responsibilities: Design and implement data solutions using Azure services, including Azure Databricks, ADF, and Data Lake Storage. Develop and maintain ETL/ELT pipelines to process structured and unstructured data from multiple sources. - Automate loads using Databricks workflows and Jobs Develop, test and … warehousing, and real-time streaming. Knowledge of developing and processing full and incremental loads. Experience of automated loads using Databricks workflows and Jobs Expertise in Azure Databricks, including Delta Lake, Spark optimizations, and MLflow. Strong experience with Azure Data Factory (ADF) for data integration and orchestration. Hands-on experience with Azure DevOps, including pipelines, repos More ❯

expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using Oracle, Snowflake and AWS tech stack. Qualifications We are looking for a skilled Lead Data … pipeline/ELT development, including performance tuning Very good SQL skills Past experience and solid understanding of end to end Data Warehouse, Data Lake and BI design and delivery at scale (high level and detailed) and various architectural strategies Solid information architecture skills/experience: Data ingestions, and Data Warehouse and Date Lake modelling experience (Star Schema, Snowflake Schema, Data Vault etc.) Past hands-on development experience in at least one enterprise analytics database like Oracle/Terradata/SQL Server/Snowflake Understanding of AWS cloud and fundamental services like IAM, Lambda, S3 etc. Experience of liaising with both in-house and third More ❯

expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using Oracle, Snowflake and AWS tech stack. Qualifications We are looking for a skilled Lead Data … pipeline/ELT development, including performance tuning Very good SQL skills Past experience and solid understanding of end to end Data Warehouse, Data Lake and BI design and delivery at scale (high level and detailed) and various architectural strategies Solid information architecture skills/experience: Data ingestions, and Data Warehouse and Date Lake modelling experience (Star Schema, Snowflake Schema, Data Vault etc.) Past hands-on development experience in at least one enterprise analytics database like Oracle/Terradata/SQL Server/Snowflake Understanding of AWS cloud and fundamental services like IAM, Lambda, S3 etc. Experience of liaising with both in-house and third More ❯

Engineer to join our Data Platform Team in the Data Intelligence Camp. You'll build, enhance and optimise a key data lake platform that will enable storage and preparation of data across billions of data points, powering analytics platforms and reporting systems throughout our organization and helping … data, platform engineering, and product development. As part of this team of amazing humans, You will Architect for scale and performance : Design and implement Data Lake platforms that support storage and processing of billions of rows, while maintaining cost efficiency and a pragmatic approach to delivery of solutions and architecture. Drive platform evolution : Lead technical … decisions that shape Data Lake platforms, balancing performance, security, and developer experience. Partner with product teams : Collaborate closely with product teams and engineering teams, data science teams, product managers, key vendors, security and privacy experts to understand their data needs and requirements and agree on solutions to build. Champion technical excellence : Drive standards More ❯

Engineer to join our Data Platform Team in the Data Intelligence Camp. You'll build, enhance and optimise a key data lake platform that will enable storage and preparation of data across billions of data points, powering analytics platforms and reporting systems throughout our organization and helping … data, platform engineering, and product development. As part of this team of amazing humans, You will Architect for scale and performance : Design and implement Data Lake platforms that support storage and processing of billions of rows, while maintaining cost efficiency and a pragmatic approach to delivery of solutions and architecture. Drive platform evolution : Lead technical … decisions that shape Data Lake platforms, balancing performance, security, and developer experience. Partner with product teams : Collaborate closely with product teams and engineering teams, data science teams, product managers, key vendors, security and privacy experts to understand their data needs and requirements and agree on solutions to build. Champion technical excellence : Drive standards More ❯

Engineer to join our Data Platform Team in the Data Intelligence Camp. You'll build, enhance and optimise a key data lake platform that will enable storage and preparation of data across billions of data points, powering analytics platforms and reporting systems throughout our organization and helping … data, platform engineering, and product development. As part of this team of amazing humans, You will Architect for scale and performance : Design and implement Data Lake platforms that support storage and processing of billions of rows, while maintaining cost efficiency and a pragmatic approach to delivery of solutions and architecture. Drive platform evolution : Lead technical … decisions that shape Data Lake platforms, balancing performance, security, and developer experience. Partner with product teams : Collaborate closely with product teams and engineering teams, data science teams, product managers, key vendors, security and privacy experts to understand their data needs and requirements and agree on solutions to build. Champion technical excellence : Drive standards More ❯

Broster Buchanan are partnered global business within the food industry with a turnover of £8Bn+ who are looking for a Fabric Data Engineer to join as they set up an exciting new project team within the group. This would suit an experienced Azure Data Engineer with good Fabric experience looking to join a new, growing team … Collaborate with their wider technology and business teams to ensure goals and visions are aligned and achieved Help with setting up the data warehousing and lake processes, including collaborating with their architecture teams to figure out what that will look like At times, guide and mentor the junior data engineers within the team … end project lifecycle Strong experience with setting up and using big data storage solutions, including data warehouses, data lakes or data lake houses Able to build and demonstrate a solid understanding of the concepts of real time data streaming, batch data processing and data transformation More ❯

will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and More ❯

will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and More ❯

will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and More ❯

will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and More ❯

will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and More ❯

will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and More ❯

will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and More ❯

will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and More ❯

will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and More ❯

Data Engineer/Scientist Department: Consultancy Employment Type: Full Time Location: United Kingdom/Hybrid Description As a Data Engineer/Scientist at Actica, you will have the opportunity to design, build, and maintain data pipelines while developing advanced analytics solutions to unlock business problems for high-profile UK public sector organisations. Your expertise … will enable organisations to maximise the value of their data assets through robust data infrastructure and sophisticated analysis, playing a key role in nationally critical projects that make a real difference to people's everyday lives. Locations: London, Guildford, Bristol, M4 corridor Hybrid working Roles and Responsibilities Actica recognises that data engineering, analytics, and … data science are distinct but interconnected disciplines. Our data engineers focus on building and maintaining the data infrastructure that enables analytics and data science work, while our data scientists and analysts focus on deriving insights and developing models. At Actica, we're at the forefront of the UK government's More ❯

Data Engineer/Scientist Department: Consultancy Employment Type: Full Time Location: United Kingdom/Hybrid Description As a Data Engineer/Scientist at Actica, you will have the opportunity to design, build, and maintain data pipelines while developing advanced analytics solutions to unlock business problems for high-profile UK public sector organisations. Your expertise … will enable organisations to maximise the value of their data assets through robust data infrastructure and sophisticated analysis, playing a key role in nationally critical projects that make a real difference to people's everyday lives. Locations: London, Guildford, Bristol, M4 corridor Hybrid working Roles and Responsibilities Actica recognises that data engineering, analytics, and … data science are distinct but interconnected disciplines. Our data engineers focus on building and maintaining the data infrastructure that enables analytics and data science work, while our data scientists and analysts focus on deriving insights and developing models. At Actica, we're at the forefront of the UK government's More ❯

Data Engineer/Scientist Department: Consultancy Employment Type: Full Time Location: United Kingdom/Hybrid Description As a Data Engineer/Scientist at Actica, you will have the opportunity to design, build, and maintain data pipelines while developing advanced analytics solutions to unlock business problems for high-profile UK public sector organisations. Your expertise … will enable organisations to maximise the value of their data assets through robust data infrastructure and sophisticated analysis, playing a key role in nationally critical projects that make a real difference to people's everyday lives. Locations: London, Guildford, Bristol, M4 corridor Hybrid working Roles and Responsibilities Actica recognises that data engineering, analytics, and … data science are distinct but interconnected disciplines. Our data engineers focus on building and maintaining the data infrastructure that enables analytics and data science work, while our data scientists and analysts focus on deriving insights and developing models. At Actica, we're at the forefront of the UK government's More ❯

bad debt improvements: Support the Bad Debt Transformation programme by providing data-led insights that drive operational improvements and policy recommendations. Transition to the Data Lake: Support the transition to a data lake environment, allowing us to link together big data sets and unlock insights that we have not had … Python and/or R for data manipulation, modelling, and visualisation. Familiarity with cloud-based data platforms and tools, such as Azure Data Lake, AWS, or Google Cloud. Degree, or equivalent experience, in a quantitative field such as Data Science, Mathematics, Statistics, Computer Science, or related discipline. Strong working knowledge of … Microsoft Office products, specifically MS Excel. Desirable Experience Prior involvement in transitioning data environments, such as migrating from traditional databases to a data lake architecture. Experience within Utilities or Financial Services. Location: Hybrid - Walnut Court - SN2 8BN. Hours: 36 hours per week, Monday to Friday. What's in it for you? Competitive starting salary of More ❯