251 to 275 of 396 Data Lake Jobs in England

years hands-on with Azure Databricks in production environments Proven experience designing and implementing medallion architecture (Bronze/Silver/Gold) using Delta Lake on Azure Databricks Strong hands-on experience with Unity Catalog — metastore setup, catalog and schema design, access controls, and governance policies Experience configuring Azure Data Lake Storage Gen2 — containers, access control lists, lifecycle policies, and integration with Databricks Hands-on experience with Microsoft Fabric — specifically Mirrored Azure Databricks Unity Catalog and Power BI connectivity to Databricks SQL Warehouses Experience with enterprise data source integration — MS SQL Server (on-premises ...

years hands-on with Azure Databricks in production environments Proven experience designing and implementing medallion architecture (Bronze/Silver/Gold) using Delta Lake on Azure Databricks Strong hands-on experience with Unity Catalog — metastore setup, catalog and schema design, access controls, and governance policies Experience configuring Azure Data Lake Storage Gen2 — containers, access control lists, lifecycle policies, and integration with Databricks Hands-on experience with Microsoft Fabric — specifically Mirrored Azure Databricks Unity Catalog and Power BI connectivity to Databricks SQL Warehouses Experience with enterprise data source integration — MS SQL Server (on-premises ...

Summary Our talented Microsoft Fabric team is made up of globally recognised experts and there’s room for more analytical, innovative, client driven data professionals. If you’re passionate about helping clients make better, data driven decisions to tackle their most complex business challenges … including large‐scale projects Experience working with modern Microsoft Fabric and Azure technologies, such as Synapse, Data Factory, Azure Data Lake Storage (Gen2), Purview, Cosmos DB, OpenAI, Azure ML, and AI Foundry Solid understanding of software engineering concepts, with hands‐on experience using Python, Scala ...

team has grown extremely quickly as a result. With this rapid growth, we are looking for Platform Engineers to join our team. The data platform team works across the whole customer domain, handling everything from natural language understanding of our customer communications to processing billions of smart meter … application deployments Airflow purely for job scheduling and tracking CircleCI for continuous deployment Parquet and Delta file formats on S3 for data lake storage Postgres/Aurora for our relational databases Spark for data processing dbt for data modelling SparkSQL for analytics Streamlit ...

thrive in it. Loyalty – We stand by each other and our mission. Job Summary About the Role Movar is seeking a Senior Data Engineer who thrives on building scalable, cloud-first data systems. You will design and manage data pipelines that support analytics … engineers to deliver robust and reusable data products. Manage data lakes and warehouses using formats such as Delta Lake and Parquet. Implement best practices for data governance, performance, and security. Continuously evaluate and adopt new technologies to evolve Movar's data ...

Oracle Data & AI Consultant (Associate Manager, CL8) Location: UK Salary: Competitive salary and package dependent on experience Career Level: Associate Manager (CL8) Accenture is a leading global professional services company, providing a broad range of services in strategy and consulting, interactive, technology and operations, with digital capabilities across … delivering cloud native solution on Oracle Cloud, our Oracle practice offers and delivers an unparalleled digital footprint for our customers. As an Oracle Data & AI Consultant, you will: Manage delivery of Oracle Data & AI projects across strategy, design, implementation and deployment phases. Design and implement modern ...

Oracle Data & AI Consultant (Associate Manager, CL8) Location: UK Salary: Competitive salary and package dependent on experience Career Level: Associate Manager (CL8) Accenture is a leading global professional services company, providing a broad range of services in strategy and consulting, interactive, technology and operations, with digital capabilities across … delivering cloud native solution on Oracle Cloud, our Oracle practice offers and delivers an unparalleled digital footprint for our customers. As an Oracle Data & AI Consultant, you will: Manage delivery of Oracle Data & AI projects across strategy, design, implementation and deployment phases. Design and implement modern ...

solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science … AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles ...

Python Data Engineer – Investment Management90k, Bonus, 3 days a week in the office. Quant Capital is urgently looking for a Python Data Developer to join our high profile client. Our client is a well known Systematic Trading Hedge Fund. They like technology especially the opensource variety … about. Day to Day the Python Data Engineer will: Support and monitor the end-to-end lifecycle of a data lake system, including fixing errors and building out further functionality. Assist ingestion of external data that will result in seamless integration of internal ...

solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science … AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles ...

solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science … AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles ...

Accenture is seeking a Data Engineer Manager in London to lead data architecture initiatives and deliver scalable data platforms across cloud environments. You will guide transformation roadmaps, govern data governance, and mentor engineers within a global AI-focused practice. The role requires ...

Data Architect Up to £80k West Midlands - Hybrid - twice per week in the office Benefits: Bonus Scheme Hybrid Working Life Assurance Cycle to Work Scheme 25 days holiday, increasing with length of service Employee Assistance Program I am working with a client in the West Midlands … looking for an Enterprise level Data Architect with Databricks experience to join the team. Databricks is an absolute necessity for this role. The architecture has been outsourced up to this point, and is being brought back in house, so you should be experienced enough to take over responsibility ...

Role: Data Analyst Retail Banking Location: Milton Keynes, UK Work Mode: 12 Months FTC Employment JOB DESCRIPTION: Required Qualifications Expertise: Strong history of data analytics experience, heavily focused within UK Retail Banking . Strong understanding of ETL processes. Experience in creating source-to-target mapping documents. … proficiency in Python or R for data manipulation. Cloud Infrastructure: Practical, hands-on experience working in an AWS data lake environment (eg, S3, Athena, Redshift, Glue). Soft Skills: Strong analytical and problem-solving skills with the ability to interpret complex datasets and business rules. ...

Data Architect needed in Lincoln Paying £30.29 per hr ref 376142 Full time hours on a temporary basis Key Responsibilities Data Architecture & Strategy Develop, implement, and maintain the organisation's data architecture strategy. Design scalable data models, data warehouses, data ...

Data Architect Scroll down to find an indepth overview of this job, and what is expected of candidates Make an application by clicking on the Apply button. Up to £80k West Midlands - Hybrid - twice per week in the office Benefits: Bonus Scheme Hybrid Working Life Assurance Cycle … length of service Employee Assistance Program I am working with a client in the West Midlands who are looking for an Enterprise level Data Architect with Databricks experience to join the team. Databricks is an absolute necessity for this role. The architecture has been outsourced up to this ...

Essential Employment in Lincoln is seeking a Data Architect to design and manage the organisation's data architecture. The role focuses on building scalable data models, data warehouses, data lakes, and integration solutions to align with business goals. Responsibilities include … leading data projects, establishing governance and security standards, and guiding data engineers and BI teams. The position is a full-time, temporary role based in Lincoln. #J-18808-Ljbffr ...

seeking 3 experienced SC Cleared Data Engineers with strong expertise in AWS Glue to work for our client in the defence sector. You will support the design, development, and optimisation of cloud-based data integration and analytics solutions. You will play a key role in building … Glue, developing Glue Jobs using PySpark and Python, AWS Glue Data Catalog, Crawlers, Workflows and triggers, Amazon S3 data lake implementation and management, AWS IAM roles, policies and security best practice. You will also need experience with several of the following: Amazon Redshift, AWS Lambda ...

Engineer to work on the Data Platform at Depop. This team owns Kafka and streaming infrastructure, the bronze data lake layer, and event tracking and sessionisation and is building out the next generation of streaming frameworks that will underpin how the rest … business ingests and processes data. This role sits within the Data Enablement and you'll partner closely with Data Infrastructure and Analytics Engineering on the boundary between Bronze and Silver, and with ML and Insights, who depend on low-latency streaming data for features ...

starts with you. About the Role The data engineering team is on a mission to create a hyper scale data lake, which helps find bad actors and stop breaches. The team builds and operates systems to centralize all of the data the falcon … platform collects, making it easy for internal and external customers to transform and access the data for analytics, machine learning, and threat hunting. As a Senior Software Engineer on the team, you will contribute to the full spectrum of our systems, from foundation processing and data ...

Elliptic is the leader in digital asset decisioning, we have built the most comprehensive platform for efficiently extracting crypto data and intelligence across blockchains with the greatest accuracy. Our platform’s unrivalled uptime, scalability, depth and breadth of our data and intelligence means exacting organizations choose … capability, including deciding what was good enough. Experience with a modern data stack comparable to ours: a cloud data lake, Spark or Databricks, and AWS. Clear communication with technical and non technical stakeholders, and the ability to cascade direction to a team so that each ...

Keka Technologies Private Limited is seeking an experienced Data Engineer to architect scalable data solutions and data pipelines is the focus. This role emphasizes data integrity, security, and performance across the data lifecycle. Location: Remote. The ideal candidate has 7+ … years in data engineering, strong SQL and Python/Java skills, and experience with data lakes, ETL, and Power BI to deliver insightful visualizations for stakeholders. #J-18808-Ljbffr ...

analytics platforms across on-premises and AWS environmentsDesigning and implementing new platform features that enhance usability, scalability and the developer experienceCollaborating with research, data and engineering teams to accelerate time-to-insight through modern analytics solutionsDriving improvements in automation, observability and resilience across analytics servicesEvaluating and adopting emerging … approach to diagnosing and resolving issuesHighly desirable skillsExperience with streaming frameworks such as Flink, Kafka Streams and Kafka ConnectKnowledge of modern data lake technologies including Delta Lake, Iceberg and Glue Data CatalogExposure to DataOps practices and collaboration with Data Engineering teamsFamiliarity with ...

Capital One UK is seeking a Senior Manager Architect in Data to shape the architecture of a cloud-based data ecosystem. You will lead cross-functional teams, influence senior stakeholders, and define standards for distributed data processing, data lakes, and data products. You will collaborate with engineers, data scientists, and governance teams to drive real-time data capabilities, ML/AI readiness, and scalable data platforms across the organization. #J-18808-Ljbffr ...

across on‐premises and AWS environments Designing and implementing new platform features that enhance usability, scalability and the developer experience Collaborating with research, data and engineering teams to accelerate time‐to‐insight through modern analytics solutions Driving improvements in automation, observability and resilience across analytics services Evaluating … resolving issues Highly Desirable Skills Experience with streaming frameworks such as Flink, Kafka Streams and Kafka Connect Knowledge of modern data lake technologies including Delta Lake, Iceberg and Glue Data Catalog Exposure to DataOps practices and collaboration with Data Engineering teams Familiarity ...