151 to 175 of 389 Data Lake Jobs in England

Recruiter Ltd seeks an experienced Data Engineer to support a data migration and integration programme in a relatively low maturity Azure … environment. You will design, build and maintain data pipelines, migrating data from diverse legacy systems to Azure Data Lake and Databricks. You will also integrate data into a proprietary transformation solution and work with a range of source systems including Oracle ...

Title: Data Engineer Location: Liverpool, UK Salary: £65,000 - £70,000 per annum, depending on experience Job Type: Permanent, Full Time Working Hours: 37.5 hours per week, Monday to Friday, 9am to 5:30pm We are seeking a talented and experienced Data Engineer to join … innovative and collaborative Database and AI Team. In this role, you will play a key part in shaping our data strategy and driving business success. Your skills will contribute directly to our forward-thinking initiatives. At Acorn we value and prioritise innovation, teamwork, and continuous development. Key part ...

Warehouse and OneLake Power BI development Data models and analytics solutions ETL/ELT SQL and SQL Server Azure Data Lake Internal and third-party API integrations Azure DevOps and Git CI/CD and production deployments Synapse solutions during the transition Production monitoring, troubleshooting … solution as the environment evolves. SQL Data modelling ETL/ELT development Azure data platforms and Azure Data Lake API integrations Git/source control Azure DevOps and CI/CD Developing, deploying and supporting production data solutions Synapse experience ...

Data Idols, we are working with a large-scale, data-driven organisation investing heavily in its data platform, analytics and AI capabilities. They are now looking for a Data Solutions Architect to provide design and architecture guidance across a broad portfolio … data platforms Experience with Databricks or similar modern data platforms Good understanding of data warehouse, data lake or lakehouse architectures If you are looking for a new challenge and want to help shape data solutions across a large-scale ...

experience working with SQL Server Strong experience working with Azure Data Factory and Azure DevOps Hands-on experience with data lake platforms, Azure Synapse, Databricks, or equivalent experience/skills Experience with tooling such as CI/CD pipelines and version control The ability … will be responsible for the design, build, and maintenance of Python-based ETL pipelines Accounting and leading the SQL development Data lake development within Azure Synapse, working to the organisation’s architecture standards Meeting with business stakeholders to define requirements and translate them into solution designs Keeping ...

Coventry Building Society is undergoing an exciting period of transformation and growth, with Data & Analytics playing a key role in driving innovation and delivering value across the business. The team is focused on building smarter, more efficient ways of working, continuously improving processes, and delivering high-quality data … related programming skills SQL/Python/Spark/Scala. Database technologies in relation to Data Warehousing/Data Lake/Lake housing patterns and relevant experience when handling structured and non-structured data. (Information Modeler) Experience in data modelling techniques ...

Contract Business Analyst | Data Lake Migration | Outside IR35 | 6 Months Role: Business Analyst Location: London – 1 day in the office every fortnight Duration: 6 months Start: ASAP We’re looking for a Business Analyst to join a data lake migration/carve-out project … make sure the right data, reports and applications are identified, tested and signed off as part of the data lake migration. We’re looking for a hands‐on data‐focused Business Analyst who is comfortable running discovery, gathering requirements and coordinating UAT through ...

Envitia is a UK-based software and services company that helps organisations unlock the full value of their data to make better, faster decisions. With over 30 years of experience, we specialise in delivering innovative software products, solutions, and consultancy services that transform complex data challenges … into actionable insights. Our mission is to empower customers across defence, government, and national security sectors to harness the power of data — from geospatial intelligence to advanced analytics and AI integration. We are proud to be a trusted partner to UK defence and government organisations, delivering technology that ...

Data Engineer/Data Analyst to support a ledger migration and data-cleanup across the data lake, reporting, and downstream feeds. The role focuses on large-scale batch processing, data validation, and regression testing within a dynamic financial services … environment. Key tasks include data extraction, transformation and reconciliation to ensure data integrity throughout migration, contributing to migration readiness and timely delivery in a fast-paced #J-18808-Ljbffr ...

About the job you're consideringWe are looking for an experienced Lead Data Engineer to help shape and grow our data engineering capability on the south coast, based out of our new Hove office. At Capgemini it is important to create an environment where individuals … pipeline design, build, monitoring and operations.• Batch and real-time data integration patterns.• AWS cloud data platforms.• Data lake, lakehouse, warehouse or large-scale analytical platform delivery.• Python, Bash or other scripting and automation approaches.• Workflow orchestration and scheduling tools, such as Airflow ...

innovative solutions to life. Your visionary leadership and pursuit of excellence makes a lasting impact on the firm and industry. As a Principal Data Engineer at JPMorganChase within the [insert LOB or sub LOB], youprovide expertise and data engineering excellence as an integral part … analytics, and collaborative development, as well as proficiency in managing large datasets using Apache Iceberg for efficient, reliable table management and data lake optimization Experience architecting and implementing enterprise-scale data warehouses on cloud platforms (e.g., AWS, Azure, GCP), including migration from legacy systems Advanced ...

driven delivery. What Youll Take On: Joining the BIS domain, you will leverage tools such as Azure stack (Azure Data Factory, Azure Datalake), Databricks and PowerBI to innovate and streamline workflows to provide valuable data for the business . Working as part of a product team … infrastructure. Technical Expertise Languages: Strong proficiency in SQL and Python. Data Platform: Hands-on experience with Azure Data Lake and Databricks. Data Integration (ETL): Proven capability in building efficient data pipelines using Azure Data Factory (ADF), SSIS ...

Canopius, our delivery teams are responsible for ensuring that business users can effectively harness data insights to drive strategic decision making. Our data strategy is centred around an enterprise Lakehouse platform on Databricks, avoiding fragmented, ungoverned silos on legacy technologies that hamper creativity and scalability. … aligned with organisational standards and governance requirements. Design, build, and optimise data pipelines on Databricks using PySpark and Spark SQL, applying Delta Lake and a medallion/Lakehouse architecture. Implement data validation and reconciliation checks, and automated testing across pipelines to ensure trusted, accurate outputs. ...

Head of Data & Analytics Department: Technology Employment Type: Full Time Location: London Reporting To: Chief Information Officer Compensation: £100,000 - £110,000/year Description Job Title: Head of Data & Analytics Salary: £100,000- £110,000 + Bonus + EV Allowance Location: Hybrid (2-3 days … week in London office) We're looking for a Head of Data and Analytics to own our data strategy and turn the information flowing through Pod into decisions that grow the business. You'll build and lead a small central data team, and work ...

Recruiter Ltd is seeking an experienced Data Engineer to support a data migration and integration programme within … relatively low maturity Azure environment. You will design, build and maintain data migration and ingestion pipelines, support the Azure Data Lake, and create integrations between source systems, Azure Data Lake and Databricks. Collaboration with stakeholders will shape data transformation ...

infrastructure for Azure-based data platforms Work with Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake to support data pipeline infrastructure and platform reliability Develop and maintain infrastructure-as-code using Terraform Build and maintain CI/CD pipelines … experience with Azure cloud services Experience with Azure Data Factory Experience with Azure Synapse Analytics Experience with Azure Data Lake Experience with Terraform for infrastructure as code Experience building and maintaining CI/CD pipelines using GitLab A proactive, self-motivated approach, comfortable identifying issues ...

CLEARED*** Data Engineer 6 Month contract initially + Extensions Based: Hybrid - Max 2 days p/w onsite. Flexible on location: Newcastle, London, Leeds, Manchester, Blackpool or Sheffield Rate: £400 - £450 p/d - (via Umbrella company) We have a great opportunity with a world leading organisation where … Hive, Impala, Spark) to AWS Cloud. Design, develop, and optimise data ingestion, transformation, and loading processes into Amazon S3 Data Lake and Amazon Redshift. Develop and maintain SQL-based data integration, transformation, validation, and reconciliation processes. Integrate and support data services ...

Capabilities Digital and Data Office Setup Hybrid Job ID #43951 Playing in picture-in-picture Playing in picture-in-picture (opens a new window) Like Add to Watch Later At Jacobs, we're challenging today to reinvent tomorrow by solving the world's most critical problems for thriving … workloads and integration services Work with AWS services such as S3, Glue, Lambda, Athena and Step Functions, or Azure equivalents including Data Lake Storage Gen2, Data Factory, Synapse, Azure Functions and Logic Apps Contribute to documentation, runbooks, data dictionaries and reusable engineering assets ...

government client is looking for candidates who have at least one production AI/ML implementation, recent experience with AWS data services, Terraform, CI/CD, Python, and SQL. Candidates should have more than five years of overall experience and meet the other requirements outlined in the attached … solutions for data platform, ETL, integration and analysis solutions. Our toolset includes AWS hosted databases (postgres, S3 based data lake, MySQL, Athena), integration services (AWS API gateway, lambda functions), ETL services (AWS Glue, Step functions, AWS Batch), infrastructure a management tool such as Terraform ...

high‐performing connectivity across a global footprint. Experience with Palo Alto's extended security suite, including GlobalProtect, Prisma Access, Panorama, Cortex Data Lake, and DLP, is essential. Key Responsibilities Architect, deploy, and manage Azure‐based network infrastructure, including VNets, Azure Firewall, Application Gateway, NSGs, Load Balancers, Private … Panorama and security extension through Prisma Access. Deploy and administer GlobalProtect for secure remote access across endpoints and locations. Leverage Cortex Data Lake for threat visibility and log analytics; implement and monitor Data Loss Prevention (DLP) policies. Collaborate with cloud, application, and infrastructure teams ...

financial services company that provides markets and post-trade technology, including systems for collecting, storing, processing, and analysing data. Задачи: Build and maintain data architecture pipelines for transferring and processing durable, complete, and consistent data Design and implement data warehouses and data … members Ability to analyse complex data from multiple sources and communicate complex information Nice to have: Exposure to AWS, data lake architectures, catalogue-based querying environments, and machine learning model delivery Условия: London office. #J-18808-Ljbffr ...

Work—reflecting our commitment to our people and our culture. For more details, visit: Website or LinkedIn Page Role: Associate Technical Architect - Data Experience Level: 8+ years Employment type: Full Time Location: Remote (UK) Basic Qualifications: 8+ years of experience in designing and implementing data warehouses … distributed teams in collaborative delivery environments. Deep working knowledge across key AWS Data & Analytics services, including: Building large-scale data lake architectures on Amazon S3 and open table formats Implementing governance and cataloging through AWS Lake Formation. Developing ETL and metadata frameworks using ...

Photon Group in London, UK is seeking a Data Engineer/Data Analyst … support a major ledger migration and data clean-up in a financial services setting. You will work across the data lake, reporting systems, and downstream feeds to ensure data integrity and robust processes. The role focuses on large-scale batch processing, data ...

Engineer/Data Analyst to support ledger migration and data clean-up initiatives across the data lake, reporting systems and downstream feeds. You will engage in large-scale batch processing, data validation, regression testing and migration readiness. Applicants must ...

Elevate your career by steering multi-faceted technology programs, integrating innovative solutions, and driving impact across global operations. The Chief Data & Analytics Office (CDAO) at JPMorganChase is responsible for accelerating the firm’s data and analytics journey. This includes ensuring the quality, integrity, and security … data platforms such as Databricks and Snowflake Good understanding of AWS data analytics services, including Redshift, EMR, Glue, Athena, Kinesis, Lake Formation, MSK, and S3 data lake patterns, with demonstrated experience architecting end-to-end data solutions Experience navigating complex ...