126 to 150 of 192 Data Lake Jobs in England

Data Architect - Azure/Spark/Databricks Role: Data Architect Location: London (3 days a week) Salary: £100k - £110k A leading technology firm, renowned for connecting people globally, is looking for a skilled Data Architect to join their expanding team. You will be spearheading … Azure-based data solutions and helping them further the development of their award winning data platform. In this pivotal role, you'll be responsible for leading the design and implementation of cutting-edge data solutions. Key Responsibilities: Lead the design and implementation of Azure … data design documents to articulate architecture decisions and implementation plans clearly. Requirements: Strong proficiency in Azure services, including Spark, Data Lake, Synapse, and Databricks. Exceptional stakeholder management skills with the ability to communicate effectively with both technical and non-technical audiences. Experienced and knowledgeable of more »

an experienced Business Development Manager with a passion for driving sales and fostering growth? Are you well-versed in any of the following? Data, data warehousing, data lakes,, data engineering, Business Intelligence solutions? A legacy of potential clients waiting to be re … ignited!!! Then, I have an exciting opportunity for you! My client is a leading IT solutions provider specialising in Data, BI and ERP solutions, serving a diverse clientele ranging from FTSE 100 companies. Retail, manufacturing, FTSE500, NHS, Blue Light, and Local Authorities. The mission is to unlock insights … in data, drive performance, and create value by leveraging cutting-edge technology and expertise. As a Senior Business Development Manager, you will play a pivotal role in driving sales and expanding the solutions portfolio. Your responsibilities will include identifying new clients, nurturing relationships with key stakeholders, conducting market more »

Senior Data Engineer Manchester (Hybrid Role) £90,000 per annum Position Summary: We are seeking a talented Senior Data Engineer to spearhead the design and implementation of robust data pipelines and advanced scripts. You will play a key role in architecting dynamic data warehousing systems on the Azure platform, harnessing the power of data lakes, Databricks, and Synapse Analytics. Your contributions will significantly propel this organisation into a new era of data-driven excellence, driving innovation and delivering impactful solutions. Key Responsibilities: Collaborate closely with cross-functional … teams, including Data Scientists, Software Engineers, and Business Analysts, to deliver impactful solutions aligned with business goals. Develop and deploy scalable data pipelines for the ingestion, incremental loading, transformation, and modeling of data. Architect agile data warehousing systems on the Azure platform, utilising data more »

We are looking for a passionate Junior Data Analyst. The successful candidate will have a keen eye for detail, a willingness to learn and an understanding of the link between data, insights and business decisions. Role Develop and implement databases, data collection systems and … data engineering solutions that optimise reporting efficiency and clarity Acquire data from primary or secondary data sources and maintain databases/data lakes Interpret data, analyse results using statistical techniques and provide ongoing reports Identify, analyse, and interpret trends or … patterns in complex data sets Filter and “clean” data by reviewing raw data, reports, and performance indicators to locate and correct code problems Work with management to prioritise business and information needs Locate and define new process improvement opportunities Training Data Analyst more »

AWS Data Architect/Enterprise Architect | Contract | Initial 6 months London - 3x a week Length: Initial 6 months Contract, Inside IR35 Delivery of AWS-based data & analytics capabilities, built on foundational services such as EMR, Glue, MWAA, Dynamo, Kinesis, Kafka and Sagemaker AWS Cloud Data Platforms Architecture and AWS Cloud Security & Infrastructure Insurance or Regulated Financial Services Industries Solutioning within a modern data architecture context such as data fabric or data mesh, and of cornerstone data & analytics capabilities (including data lakes, data more »

subject matter experts, solving interesting problems, and building the products of tomorrow, this opportunity is for you. On our mission to revolutionize the Data Strategy & Management space, we are seeking a dynamic and seasoned Solution Architect with a stellar track record in Data Products. As our … client navigates the complexities of a legacy IT landscape, we need someone who can not only conceptualize, design and build robust data platforms but also provide strategic guidance and stakeholder management expertise. Leveraging your software engineering expertise, you'll play a pivotal role in ensuring the integrity, efficiency … innovative solutions in challenging environments. Bachelor’s degree in computer science, computer engineering, or a relevant field. Responsibilities: Design and implement scalable database and datalake solutions tailored to client requirements. Evaluate client operations, applications, and programming to identify database structural necessities and ensure alignment with organizational goals. Create robust data more »

is made possible through our family of trusted brands and businesses. Across the Centrica group we have established a vast rudimentary data lake comprising of UK & Ireland wide customer and enterprise data for group and our trusted businesses (British Gas, Bord Gais Energy, Centrica Business … Solutions, Centrica Energy and Upstream). This data source presents a huge opportunity to create significant value for our customers, for us to build innovative products, provide new services and improve the capabilities of our Centrica employees to drive our journey as we transition towards NetZero. This is … in. We are looking for a highly skilled and motivated AI Product Owner to drive the entire product lifecycle for AI/ML, data, and analytic products. You will collaborate closely with Data Scientists, ML/Data Engineers, business leaders, privacy, Solution Architects, and more »

Python Technical Lead (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking Asset Manager Financial Services … DBT Buy-side asset management (hedge fund, asset manager, investment management) Role: Python Technical Lead (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with Python, Java, AWS and Iceberg. If you more »

Senior Python Software Engineer (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking Asset Manager Financial Services … DBT Buy-side asset management (hedge fund, asset manager, investment management) Role: Senior Python Software Engineer (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with Python, Java, AWS and Iceberg. If you more »

Python or TensorFlow ) Familiarity with natural language processing or AI technologies ( e.g LLMs such as ChatGPT or BARD , Embeddings , Prompt Engineering ) Experience with data pipelines and preferably processing of document s ( e.g using Google Cloud Fusion/Azure Data Factory ) Strong background in either Python/… Service Orientated Architecture, API-Centric Design, Twelve-Factor App, FAIR, etc.). Experience supporting digital platforms, including Integrations, Release Management, Regression Testing, Integrations, Data Obfuscation, etc. Knowledge of Azure … Data Factory/GCP Cloud Data Fusion , Microsoft Azure Machine Learning or GCP Cloud ML Engine , Azure Data Lake , Azure Databricks or GCP Cloud Dataproc . Familiarity with big data technologies and distributed computing frameworks, such as Hadoop, Spark, or Apache more »

Data Product Owner London Hybrid – 3 days pw onsite £50,000 - £55,000 We have an exciting opportunity for a Data Product Owner working for a unique customer centric within the financial services industry, which is undergoing the biggest transformation it has ever seen. The Data Product Owner will join a newly formed data team. This role will ensure systems are fit for purpose today and ready for the challenges of the future, providing a bridge between operational teams and the technology department and facilitating better data decision making for … acting on user feedback and effectively communicating on updates and issues. Collaborate with key business stakeholders from a variety of teams, including Analytics, Data Engineering, Pricing, Risk, and Economic Capital to develop backlog and priorities in-line with business requirements. Proactively investigate and understand issues and pain points more »

have created is unique and difficult to replicate, with our ‘best of both’ approach combining deep human expertise with advanced digital, tech and data capabilities. This combination not only allows us to deliver excellent customer experiences, but to do so efficiently and at scale. We are proud of … of a business that cares too Want to continue to grow professionally and be the best version of yourself Job Description The Lead Data Engineer is a key role to ensure Shawbrook unlocks the value contained in its data across the organisation in a well-governed … and table formats (Delta etc) This is an incredibly exciting role that rarely becomes available. You will own a well-designed data lake serving a 50+ user community who run '000s of queries across TBs of data each month with a mandate to take it more »

available PAYE or via approved umbrella Initial CED 31/12/2024 The Power BI Developer reports directly to the Head of Data & Reporting/Project Controls Manger who is responsible for the co-ordination of Project Controls activities associated with the development, design, manufacture, construction and … safety, quality, time and cost milestones for a specific area/scope of work. The Power Bi Developer duties include identifying, gathering, analysing data and making their insights accessible to the SZC team through easy-to-understand graphs, charts, tables and reports. The Power Bi developer will work … and implementation of Digital reports and dashboards within SZC and to external clients using data extracted from the SZC Data Lake and information gathering systems. * Support the production of monthly reports through the provision of intelligent information and analysis. * Preparation of training materials and conducting more »

specific business challenges. Implement and maintain scalable and efficient AI systems, ensuring they meet business requirements and performance benchmarks. Collaborate with business analysts, data scientists, and IT teams to integrate AI solutions into existing systems and workflows, enhancing their capabilities and impact. Stay abreast of advancements in AI … efforts. Conduct data analysis and feature engineering to prepare data for use in AI models, utilizing Azure Data Lake and other data storage solutions. Develop robust testing and validation processes to ensure the accuracy and reliability of AI models and solutions. … Open AI Service, Azure Cognitive Services, and Azure Machine Learning. Familiarity with Azure Databricks is a plus. Solid background in machine learning algorithms, data pre-processing, feature engineering, and model evaluation. Experience with deep learning frameworks like TensorFlow or PyTorch is desirable. Proficiency in handling large datasets, experience more »

Data Engineer £35,00o To £45,000 (Dependent on Experience) Norwich Hybrid (2/3 Days per Week) An exciting opportunity for a data engineering professional to take full ownership of new projects. Join a longstanding business with a talented and dedicated internal IT team as … well as an environment that fosters personal progression. This job role is ideal for someone with a strong background in data engineering and an interest in data analysis. Duties: Lead the implementation and ongoing management of data strategy and analysing raw data for trends and patterns Design & build robust data systems Conduct advanced data analysis Participate in Agile ceremonies and practices Required Skills: ETL Data Pipeline development experience Designing, developing and maintaining data lakes and warehouses SQL Database Design, Coding and Maintenance more »

work together to minimise risk and shorten delivery times. Our team consists of highly-skilled cross-functional consultants, analysts, and support staff. ROLE: Data Engineer LOCATION: Remote (UK) CLEARANCE: SC eligible Job Description: We are seeking a highly skilled Data Engineer to join our team. The … project uses Java to ingest the data into the platform. The Consultant would be helping to build out the Data Lake and Lakehouse on Databricks, working with AWS. Stack: AWS: ECS, KMS, SNS, SQS, Lambda, Python, Databricks, MongoDB, Spring Boot AWS, Java (to support ingestion … Databricks - experience in PowerBi would also be useful. Engineer with past experience with Java, Data, and Infrastructure (DevOps). Java is a key skill Programming: Java, Python, PySpark Storage Mechanisms: MongoDB, Redshift, AWS S3 Cloud Environments/Infra: AWS (required), [AWS Lambda, Terraform] (nice to have) Data more »

Salary : £55,000 GBP per annum and Benefits applicable by the Client Purpose of Role: At Client we are committed to ensuring our data and processes are successfully maintained and enhanced to keep our customers moving. We are therefore recruiting for a Data Product Owner to … purpose today and ready for the challenges of the future, providing a bridge between our operational teams and technology department and facilitating better data decision making for our customers. Reporting to the Data Product Manager, you will: Play a vital role in owning and developing the … on their needs; successfully gathering and acting on user feedback and effectively communicating on updates and issues. Become an expert in Asset Risk data systems and processes and provide business knowledge when interacting with internal stakeholders and 3rd parties. Collaborate with key business stakeholders from a variety of more »

Are you a skilled Data Engineer passionate about delivering top-notch data products and frameworks that drive business success? My client is on the lookout for an experienced Data Engineer to join our team on a contract basis for 12 months. You'll have … work on exciting things in the FMCG sector that have a real impact on our business and beyond. As a member of our data engineering team, you'll be responsible for: Delivering data pipelines and products that support our business operations and scientific endeavors, ensuring clear … documentation on specifications and a deep understanding of each solution at the data, technical, and business process levels. Implementing data engineering best practices to standardize the development process and ensure high-quality outcomes. Ensuring that high-quality data is presented to our researchers from more »

Data Product Owner London Hybrid – 3 days pw onsite £50,000 - £65,000 We have an exciting opportunity for a Data Product Owner working for a unique customer centric within the financial services industry, which is undergoing the biggest transformation it has ever seen. The Data Product Owner will join a newly formed data team. This role will ensure systems are fit for purpose today and ready for the challenges of the future, providing a bridge between operational teams and the technology department and facilitating better data decision making for … acting on user feedback and effectively communicating on updates and issues. Collaborate with key business stakeholders from a variety of teams, including Analytics, Data Engineering, Pricing, Risk, and Economic Capital to develop backlog and priorities in-line with business requirements. Proactively investigate and understand issues and pain points more »

vehicles, it is crucial Motability Operations (MO) continues to evolve and adapt through this period. At MO we are committed to ensuring our data and processes are successfully maintained and enhanced to keep our customers moving. We are therefore recruiting for a Data Product Owner to … purpose today and ready for the challenges of the future, providing a bridge between our operational teams and technology department and facilitating better data decision making for our customers. Reporting to the Data Product Manager, you will: Play a vital role in owning and developing the … on their needs; successfully gathering and acting on user feedback and effectively communicating on updates and issues. Become an expert in Asset Risk data systems and processes and provide business knowledge when interacting with internal stakeholders and 3rd parties. Collaborate with key business stakeholders from a variety of more »

fight financial crime, and reduce scams in online payments! The team is very early-stage, and you’d be joining as the Founding Data Engineer, working closely with the Founders who have a previous success story in FinTech. You’ll be taking very high ownership: Designing, building and … maintaining scalable and reliable data storage, processing pipelines, and analytics infrastructure. Apply your expertise in data analysis and model development: conduct experiments and build production-grade, transparent data products that drive impact for the business and our customers. About you; Proficiency with language/… tools for data processing and analytics, such as SQL, Python/Scala, Spark, Airflow, etc Strong understanding of data architectures, data modelling, and designing scalable and fault-tolerant data pipelines and data lakes/warehouses. You’ve worked with cloud more »

skilled resources and growing your career. Candidates must have the following Strong Developer experience on C# Azure, Logic Apps Database experience SQL Server Data Factory/Data Warehousing/ETL Skills required: Experience of developing technology solutions for large, complex business change programmes Experience of working … their pros and cons in the context of large organisations. Integration Architectures and patterns, including knowledge of Enterprise Service Bus. Working knowledge of data warehousing, data lakes, data migration and Big Data. Good secure coding standards such as OWASP. Auditing and monitoring approaches and more »

Senior Java Software Engineer (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking Asset Manager Financial … Buy-side asset management (hedge fund, asset manager, investment management) Role: Senior Java Software Engineer (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with Java, Python and AWS. If you have more »

Python Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset Manager Financial Services … appreciation of asset classes such as Fixed Income, equities, FX or commodities Role: Python Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with AWS, Glue, Dremio, Snowflake, Python and Java. more »

include design and development experience with various relevant Microsoft platforms, tools, technologies, patterns, and techniques related to MSFT suites, Azure tools, integration, and data is required. Experience with industry/domains like pharmaceutical, finance, HR, sales, marketing, and manufacturing is highly preferred. Experience with healthcare industry regulations, data … experience using Azure integration tools like Data factory, Logic Apps, etc. Along with knowledge of utilizing Azure SQL Server, Data lake, etc. In-depth knowledge & experience using Visual Studio, with one of the programming languages: C#/Java/JavaScript/Python, and PowerShell. Thorough … Queries, Datatype conversions, etc.). Experience working with APIs, Postman/SOAPUI tools, MS D365, ServiceNow, Azure Analytics tools, Azure Synapse, Azure BYOD & Data verse, Azure DevOps, Informatica, BI tools, etc. is a big plus. General business skills: Excellent communication to translate and explain business requirements to technology more »