276 to 300 of 498 Data Lake Jobs

Senior Data Engineering Consultant We are open to full-time or part-time applicants for this role! Are you returning from maternity leave? We'd love to hear from you! Salary : £70,000 to £90,000 (depending on experience). Location : Remote – must be based within the UK. … performance queries, understanding how queries execute on different compute technologies Azure Data Factory or other cloud orchestration tools Azure Data Lake storage and Delta Lake Unity Catalog, Purview or other Data Governance tools IAC tool such as Terraform, Azure DevOps Other technology ...

over day-to-day engineering delivery within agreed priorities, standards and assurance arrangements. This role will be part of our growing Geospatial and Data team. You will be responsible for shaping and delivering data engineering solutions that support major infrastructure, planning, environmental, energy and transportation projects … UK. Beyond technical delivery, you will contribute to the development of technical standards, inform strategic decisions, mentor colleagues and lead improvements to data platforms and digital services within the direction set by senior technical leadership. You will work closely with technical specialists, project managers, solution architects and business ...

Deloitte - Recruitment is recruiting a Principal Data Engineer to lead Azure-based data lake solutions, focusing on governance, performance, and scalable design in a high-volume environment. This role emphasizes strategic and technical leadership across Databricks, Unity Catalog, and Delta Live Tables, with hands … delivery and mentorship of teams to align data initiatives with business goals. You will collaborate with executives to translate complex data challenges into actionable insights, #J-18808-Ljbffr ...

Opus Recruitment Solutions Limited is seeking an Azure Data Engineer to help build a modern Azure-based data platform. The role focuses on scalable cloud data solutions, robust data integration … handling large datasets in secure, regulated environments. Ideal candidates will have hands-on experience with Azure Data Factory, Data Lake, and Advanced SQL, plus strong Python development for data engineering. #J-18808-Ljbffr ...

Senior Data Platform Engineer Primary location: Salford (M50 3SP) or Staines (TW18 3DZ) or London (EC2R 7HJ) Flexible/Hybrid working options. Permanent Salary Negotiable depending on experience & location 10% Bonus+ fantastic benefits Full time 37.5 hours We consider all types of flexibility, including locations, hours and working … Azure-based data solutions. Expert-level knowledge of Azure and/or Snowflake services, including Data Factory, Data Lake, Azure ML, and Power BI/Fabric. Proven experience with infrastructure-as-code using Terraform and building CI/CD pipelines via Azure DevOps ...

growth and development opportunities in an environment that embraces your unique skills and experience. Your role and responsibilities Join IBM as an AWS Data Scientist, advising and delivering data, analytics, and AI solutions for public sector clients as they navigate complex business, operational, and societal challenges. … Working at the intersection of data science, cloud technology, and consulting, you will help organisations translate data into actionable insights, strengthen decision‐making, and deliver measurable outcomes for citizens and communities. As part of IBM’s AI, Analytics & Data Science practice, you will partner ...

Role & Key Responsibilities Job Title : Data Analyst (12 month fixed term contract) Location : Peterborough (Hybrid - One day per week in the office) This role is perfect for someone with a passion for data storytelling, who excels at translating complex data into impactful insights that … drive strategic decisions. As a Business Intelligence Developer, you will play a critical role in shaping data-driven narratives and enabling our stakeholders to see the actionable stories behind the numbers. Key Responsibilities Data Storytelling : Craft and deliver compelling data narratives that translate complex ...

Matchtech is seeking a Data Engineer to design and maintain scalable Azure data platforms, build robust data pipelines … support data-driven solutions across the business. You will work with Azure Data Factory, Databricks, Synapse, Data Lake Storage, and SQL databases, ensuring data quality, governance and CI/CD automation. The role offers permanent employment in a leading technology organization ...

influential company. Among top performers, you can make a direct and meaningful impact. As a Lead Engineer at JPMorgan Chase within our Market Data Services team you will play a pivotal role in designing, delivering and maintaining critical data distribution systems within the firm. These systems … skills Formal training or certification on infrastructure engineering concepts and advanced applied experience in Cloud technologies including Kubernetes, Terraform and AWS Data Lake technologies (e.g. Snowflake, Databricks, AWS Glue/Athena, Lake Formation) Demonstrated experience using enterprise-authorized AI capabilities within the work environment to support ...

experience on enterprise scale Databricks platforms on Azure Strong hands on data engineering background with Python or PySpark and advanced SQL Delta Lake, Unity Catalog, medallion architecture, Databricks Workflows and Auto Loader Declarative pipelines (Delta Live Tables or Lakeflow) and Structured Streaming CI/CD for Databricks … using Databricks Asset Bundles, Azure DevOps or GitHub Actions, and Terraform or Bicep Azure Data Factory, Azure SQL, Data Lake Storage Gen2 Entra ID, Key Vault, private endpoints, RBAC Experience of data governance and lineage, ideally with Microsoft Purview UK GDPR ...

hands-on Solution Architect from a .NET background to act as design authority across their core platforms, customer-facing APIs, commercial systems and data architecture. You'll translate business and product strategy into secure, scalable and cost-effective designs that engineering teams can deliver with confidence, working closely … commercial stack covering CRM, contracting, payments, entitlements and renewals Shaping the Azure data architecture (Data Factory, Data Lake, Fabric or Synapse) to support BI, reporting, AI and stakeholder transparency Embedding security by design, including Entra ID, zero trust, secrets management and network security ...

powered by people, driven by innovation, and committed to creating an inclusive environment where everyone can thrive. We are currently looking for a Data Engineer/Database Administrator (DBA) to design, build, operate and continuously improve reliable, secure and scalable data platforms. Based in Leeds with … Hands-on experience managing Microsoft Azure environments and data services, such as Azure SQL, Data Factory, Storage, Data Lake or Fabric Experience designing, building and supporting robust ETL or ELT pipelines and data integrations Knowledge of automation, source control, CI/ ...

years of commercial experience in data engineering/analytics engineering/BI development. Experience with data warehouse, data lake and data lakehouse concepts. Proven experience in designing, implementing and supporting ETL/ELT pipelines. Experience with AWS, Amazon Redshift, Apache Airflow. … cost‐cohort resolve, last‐click vs raw events). Integrations with external sources: Meta Marketing API, AppsFlyer, AppMetrica, Stripe, Tableau Server (TSC), Birch. Data quality assurance: schema/freshness/volume checks, broken‐snapshot detection, anti‐bot‐traffic filtering. Performance optimization of queries and procedures in Redshift. Collaboration ...

Group is a global Consulting firm specialising in Data & Analytics. We are committed to unlocking an organisations’ potential and hidden value by offering in-depth analytics expertise that empowers our clients’ business models to become successful data-driven enterprises. Innovation is in our DNA. We constantly … solutions. SDG Group has partnerships with the leading technology vendors: AWS, Microsoft, Snowflake, Matillion, ThoughtSpot & Dataiku. We are currently looking for a Data Consultant to join our Data practice based out of our Milton Keynes. As a Data Consultant, you will work on projects ...

Gismart is seeking a data engineer to own and optimize analytics pipelines across data warehouse, data lake, and data lakehouse, enabling cohort revenue, LTV, and retention insights for our BI platforms. You will collaborate with BI, Product, UA, and Billing teams ...

just to execute a function, but to help redefine the future of how work gets done. Solution Engineer: Accelerate the AI Data Cloud We are looking for a Solution Engineer who is accustomed to solving customer’s most complex problems and closing large deals. In this role … experience within Data platforms, analytics, and cloud technologies, including deep knowledge of data warehousing, data lakes, and lake house architectures. Proven ability to discuss and demonstrate the value of Generative AI and Machine Learning (ML) use cases for enterprises. Hands-on experience with ...

Senior Data Platform Engineer in the Cyber Data Platform team, you will play a key role in building and maintaining a robust data platform that enables users to develop advanced analytics, machine learning, and GenAI solutions to strengthen our security defences. You will collaborate … closely with cross functional data teams to ensure the platform is scalable, secure, and aligned with cybersecurity goals. Also, you will contribute to the data platform architecture and mentor junior team members to deliver high-quality data services. Data Architecture : Design, build ...

place of high expectations, integrity, innovation and a willingness to challenge consensus. About the Team The DRW C/FICCO Data Engineering team is essential to developing valuable datasets and scalable data infrastructure critical to our trading operations. We work closely with traders, researchers, and other … concurrent, high-throughput, low-latency software systems Experience with pipeline orchestration frameworks (e.g. Airflow, Dagster) Experience with streaming platforms (e.g. Kafka), data lake platforms (e.g. Delta Lake, Apache Iceberg), and relational databases Have a Bachelors or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering ...

Data & Integration Engineer Department: Engineering Employment Type: Full Time Location: Plymouth Description We are seeking an AI Data & Integration Engineer to connect Plessey's data and systems to AI. The company operates an advanced compound semiconductor fab and develops complex MicroLED display and optical … interconnect technologies. This role will give AI agents secure, efficient and reliable access to data from across the business, including manufacturing, engineering, quality and business systems, so they can deliver real outcomes. The successful candidate will combine strong data and software engineering skills with a deep ...

other non-disability related questions, please reach out to our Talent Partners. Role We’re looking for a Staff Backend Engineer – Data Platform to be a key technical leader within the teams responsible for Depop’s data platform. … drive the technical vision and implementation for our foundational data platform — from experimentation, event ingestion pipelines to our data lake, governance frameworks, and data observability and real-time analytics capabilities. You will work closely with data scientists, machine learning engineers, backend ...

Data Engineer – Consultant/Sr. Consultant Our talented Data Engineering team is made up of globally recognised experts – and there’s room for more analytical, innovative, client‐driven data professionals. If you’re passionate about helping clients make better data‐driven decisions … large‐scale projects Experience in working with the latest Azure technologies, such as Databricks, Microsoft Fabric, Data Factory, Azure Data Lake Storage (Gen2), Purview, Cosmos DB, OpenAI, AzureML, AIFoundry, Kubernetes Understanding of software engineering tools and concepts including experience in Python, Scala or PySpark, database ...

work in regulatory change at the society. We’re looking for a Scrum Master to support the delivery of our Data Lake programme. This is an opportunity to join a growing team delivering strategic data and reporting capabilities that support important business and regulatory outcomes. … each team member delivers value towards the overall project goals. The team works across multiple deliverables covering regulatory reporting and strategic data lake work and upcoming Virgin Money integration activities. We support all reporting across the Finance function. In this role you’ll get to experience ...

About the job Data Architect – Legal Technology James Carrera ofDigital Data Foundation is sourcing an experienced Data Architect to be a key contributorin Legal Technology platforms data storage and manipulation, as well as promoting cloud technology, AI & Machine Learning. Drive theadoption … data driven decisions, revenue streams and reporting. Supportdata analysis and business intelligence through conceptual, logical andphysical data models. EnterpriseData Strategy creation and roadmap for Data Governance. Create non-functionalrequirements for all data related projects & technology. Continualresearch on data technology, management ...

/Hybrid (2 days a week)Is it Permanent/Contract: Open for Both (If contract initial 6 months)Key ResponsibilitiesDefine the enterprise data strategy, reference architectures, and target-state blueprints anchored on the Snowflake AI Data Cloud, spanning data ingestion, storage, processing, serving … platforms (AWS, Azure, or GCP) including Snowflake deployment, networking (Private Link), and cloud storage integration (S3, ADLS, GCS); familiarity with lakehouse stacks (Databricks, Delta Lake, Apache Iceberg) is a plus.Mastery of Snowflake security and governance: RBAC, tag-based governance, dynamic data masking, row access policies, column-level ...

Data Engineering Lead required by our client an international educational establishment to provide the technical engine for the Value Management Office automating the visibility of portfolio performance and benefit realization across the organization. It is responsible for building and maintaining the "Value Dashboard," ensuring that data … integrated to provide a real-time view of strategic ROI. The role holder defines technical standards for value-tracking tools and creates automated data objects that link project outputs to the organisations strategic objectives. Role specific skills Full-Stack Analytics Engineering: Mastery of the lifecycle from data ...