151 to 175 of 318 Data Lake Jobs

Enterprise Data Warehouse Solution Architect - Dublin - 75,000 - 85,000 euros FRG Data are working with a well esteemed Financial Services Group in Ireland who are on a digital first transformation journey. They are looking for experienced data warehouse solution Architects highly experienced in … premise and cloud, this role will sit above highly experienced Engineering teams. Required Experience: Designing solutions for data warehouse & data lake projects and programmes working in complex, multi-vendor change delivery organisations. You have a continuous improvement and innovative attitude and the ability to work … independently with minimal guidance You have data/data-warehousing knowledge and experience particularly on the Teradata EDW platform or similar technology. You are experienced in modern engineering practices and technologies and Informatica and data architecture. Responsibilities: Accountable for delivering effective solution designs within more »

What you’ll do We are looking for a Data Platform Engineer, someone who can deliver operational excellence and stability in our data platforms that underpin the services we deliver for our customers. You’ll be part of the team helping to build strong, collaborative relationships … help define the future of hospitality both in the UK and abroad. Responsibilities will involve:- Implement and maintain secure, scalable, and highly available data platforms within our datacentre and public cloud environments. Build and continually improve tooling, monitoring, and security controls. Own the data platform aspects … d like you to have experience in design, implementation and day-to-day running of enterprise level data platforms, data lake concepts and data handling. We’d also like you to have experience of solid monitoring and tuning skills in highly available transactional more »

Role - Azure Data Engineer Rate - £600 per day inside Hybrid working - 1 day a week onsite (Centre of London) Duration - Initial 6 months My client is a large Financial services organisation based out of London and they are going through a huge data transformation that is … expected to run for at least 18 months. My client is seeking experienced Azure Data Engineers for a stakeholder-facing project. This role will have particular emphasis on Azure, Databricks and DevOps. Our client is in the consultancy sector but does not have a preference for previous experience … There is a massive emphasis on Pyspark and Databricks for this particular role. Technical Skills Required: Azure (ADF, Functions, Blob Storage, Data Lake Storage, Azure Data Bricks) Databricks Spark Delta Lake SQL Python PySpark ADLS Day To Day Responsibilities: Extensive experience in designing, developing more »

Data Analyst/Engineer - £50,000 - £60,000/Carmarthenshire (South Wales) + Hybrid 2 days on-site Are you looking to join an exciting business as they continue their scale-up plans in 2024? This is a fantastic opportunity with a business proud to be expanding in … Wales. This is a great opportunity for a Data Engineer or Data Analyst/BI dev who wants to develop their skills in Data Engineering. If you have a background in creating dashboards in Power BI feel free to apply or reach out for … ll be doing: You’ll be the brain behind developing and putting into action strategies to gather, process, and dissect large sets of data, all aimed at giving clients actionable insights. You’ll focus on crafting and maintaining data pathways to ensure data accuracy more »

Lead Data Engineer - £70k plus benefits - hybrid 2 days in Manchester An exciting opportunity has arisen to join this leading household name, based in Manchester city centre (hybrid). The role will be critical in delivering and ensuring data quality, consistency, and reliability working closely with … other data engineers in the team as well as the analytics team, architecture team and stakeholders. You will be responsible for the development, operation and maintenance of data pipelines to extract, load and transform data sources from both internal and external/third-party … candidate will have led a team or projects and used to working in an Azure environment with a focus on Azure Data Lake, Databricks, Azure Data Factory and Power BI architectures. Working with Python, SQL, Spark and Databricks, you will build, rebuild and maintain data more »

Lead Data Engineer - £70k plus benefits - hybrid 2 days in Manchester An exciting opportunity has arisen to join this leading household name, based in Manchester city centre (hybrid). The role will be critical in delivering and ensuring data quality, consistency, and reliability working closely with … other data engineers in the team as well as the analytics team, architecture team and stakeholders. You will be responsible for the development, operation and maintenance of data pipelines to extract, load and transform data sources from both internal and external/third-party … candidate will have led a team or projects and used to working in an Azure environment with a focus on Azure Data Lake, Databricks, Azure Data Factory and Power BI architectures. Working with Python, SQL, Spark and Databricks, you will build, rebuild and maintain data more »

Your new company We are currently working with a large scale UK wide infrastructure and construction organisation, supportingin their recruitment of a data engineer for a 3 to 6-month contract. The organisation is a large multipurpose organisation that offers multiple different services across the UK, including working … to be predominantly working from home (with very occasional travel to site when needed). What you'll need to succeed Experience with data modelling … snowflake, etc schemas and performance optimisation of data tables Experience with data warehousing solutions (e.g. Snowflake) and data lake architecture. Azure Databricks/Pyspark & ADF. Strong skills in data normalisation and the ability to present complex technical concepts to diverse stakeholders. more »

Data Engineering in Animal Health London/Kent – approx. 80% remote £60-70k basic salary plus 10% bonus If you’re as much of an animal lover as you are a data engineer, you won’t find a better opportunity to use your skills for … good. In this newly created role you’ll be setting up the data infrastructure that will help this thriving veterinary care company to hugely improve outcomes for pets – and their two-legged friends[MW1] . It's a role with the potential to be both personally and professionally … a UK work visa already in place. Able to set up, maintain and support a cloud data platforms/data lake such as Snowflake A solid understanding of analytics, reporting and dashboarding technologies Proficiency in API integration, and data extraction methodologies. Strong coding more »

business critical reporting systems across the Protein Works including marketing, trading, operations and finance. You will have a strong understanding and appreciation of data engineering concepts and how to apply them using the Google Cloud Platform. You will possess an unwavering passion for data and how … it can improve business performance. The role: Data Engineer Immediate Responsibilities Managing and delivering end to end BI reporting projects from initial brief/requirement gathering to data pipeline development (APIs/ETL/ELT/SQL) to visualization Undertaking ad hoc BI tasks based on … be responsible for the day to day maintenance and enhancement of the data quality, security and performance of the Data Lake/Warehouse Assisting your Data Analyst colleagues to generate impactful business insights and analysis Support the Senior Data Engineer in more »

and enables the rapid deployment of innovation and standard methodologies across the global business About the Role We are looking for an experienced Data Architect/Data & Reporting Technical Lead to join the team working on our Global Business Systems (GBS) platform. You will lead data and reporting architecture and initiatives across the GBS program, including the RX Data Lake. You will manage the engineering team throughout the development life cycle to implement functionality to cost, quality and schedule. Responsibilities Designing and developing RX's data and reporting systems which … development experience Have excellent experience of cloud data platforms (Azure or AWS) and attendant technologies and concepts such as Data Lake, Virtualization, ETL, ELT. Have substantial Powe BI hands on experience Demonstrate experience with Oracle Business Intelligence Enterprise Edition (OBIEE), Oracle Enterprise Data more »

Digital are happy to be supporting one of our clients in the Research sector who are currently on the look-out for a Data Engineer. Data Engineer Tech Stack & Experience; Python & large volumes of data. SQL. Google DataFlow would be handy. Cloud Experience (AWS, Google, Azure … a mindset to grow into more of a leadership position would be very helpful. Have come from a highly statistical/mathematical background. Data Engineer Responsibilities; Design, develop, and maintain scalable data pipelines. Implement ETL/ELT processes to extract data from a variety … of sources and load it into the data warehouse or data lake. Collaborate with data scientists and analysts to understand their requirements and design data models that support their needs. Write efficient Python code to perform data transformation, cleaning, and more »

Data Software Engineer with expertise in Java, Kafka Connect & Flink. Key skills: Expertise with Kafka, Kafka Connect and knowledge of RabbitMQ. Good experience with data process technologies like Apache (Flink/Beam/Spark), Oracle ODI, and Confluent’s Platform. Good knowledge of Hadoop Cluster Architecture … languages, such as Java, Python, Shell Scripting, or PERL. The ideal candidate will have an outstanding knowledge of fast-moving and large volume data in multi-tiered data and analytics platforms. The role involves the design … development, implementation, and support of a cutting-edge real-time data platform, which includes data streaming, a data lake, and a blazing fast analytics database. We are looking for someone who is passionate, motivated, driven, and up for the challenge. Strong knowledge of more »

Data Modeller/Oslo 3 days per week onsite/12 months +/Start ASAP Responsibility: * Work tight with different data domains, business areas, initiative to define and develop certified data products and information flow. * Build relation and show direction for how new … solution can affect our existing services and deliveries. * Hold the "Data Engineering Community of Practice" within our Tech Family * Establish new communication channels for technical knowledge sharing of modern data engineering. Experience: * Experience with Datamodelling. * Experience with data warehouse, data lakes, data fabric, Mesh etc. * Experience with both data- and software engineering, and how to combine those to build data products. * Experience with DevOps methods. * Experience with Middleware, ETL/ELT, SQL, Apache Kafka, Streamsets, DBT, Apache Airflow, Snowflake or similar tooling stack. * Experience with building more »

Data Engineer - Glasgow Bright Purple are working in close partnership with a successful Glasgow based organisation who specialise in cutting-edge surveillance technology. They are undergoing an exciting data transformation strategy that will see new and emerging technologies leveraged to overhaul how they store, manage and … harness their data. We are looking to recruit a Data Engineer to work closely with their Senior Analyst and Head of Transformation and play a central role in this project. You will enjoy the benefits of their Glasgow office three days (3) a week, a place where they … quality . Working with Analysts to visualise and evaluate big data sets . Developing a new, company wide data lake Your technical experience will include: . Knowledge of SQL and SQL based DBs ie SQL Server or PostgreSQL . Cloud Computing ie Azure, AWS more »

Senior Data & Insight Analyst Bristol - Hybrid £50,000 - £60,000 + Bonus + Great Pension + Private Healthcare + 28 days holiday + Hybrid Working + Many more fantastic perks Are you looking to join a company that can propel your career forward, and also provide you with … forward? This company are market leaders in their division and with their constant development and growth they are looking to add a Senior Data & Insight Analyst to the team. With a fantastic client base and working with some of the biggest brands out there you would be joining … team. Manipulate and analyse data to derive insights effectively and accurately. Play a pivotal role in utilising a new data lake efficiently. Provide actionable insights based on data analysis. Contribute to enhancing data-driven decision-making processes. Engage in continuous learning more »

specific business challenges. Implement and maintain scalable and efficient AI systems, ensuring they meet business requirements and performance benchmarks. Collaborate with business analysts, data scientists, and IT teams to integrate AI solutions into existing systems and workflows, enhancing their capabilities and impact. Stay abreast of advancements in AI … efforts. Conduct data analysis and feature engineering to prepare data for use in AI models, utilizing Azure Data Lake and other data storage solutions. Develop robust testing and validation processes to ensure the accuracy and reliability of AI models and solutions. … Open AI Service, Azure Cognitive Services, and Azure Machine Learning. Familiarity with Azure Databricks is a plus. Solid background in machine learning algorithms, data pre-processing, feature engineering, and model evaluation. Experience with deep learning frameworks like TensorFlow or PyTorch is desirable. Proficiency in handling large datasets, experience more »

change the status quo, we’ll help you make your moment. Join Team Purple. Join IFS. Job Description As a Principal/Senior Data Engineer, you will spearhead our data initiatives, transforming raw data into strategic assets that propel our business forward. This role … who excel in a dynamic environment, offering the freedom to innovate and the responsibility to deliver. Core Responsibilities: Identify and harness high-value data opportunities within our product suite, converting raw data into impactful features and reusable assets. Act as the authoritative voice on data technology , steering our organization towards cutting-edge platforms and methodologies. Architect and execute comprehensive data projects, ensuring robust scalability and performance from conception to deployment . Collaborate with a team of ML Engineers, Data Scientists, and other key stakeholders to design, implement, and maintain more »

Data Architect - Azure/Spark/Databricks Role: Data Architect Location: London (3 days a week) Salary: £100k - £110k A leading technology firm, renowned for connecting people globally, is looking for a skilled Data Architect to join their expanding team. You will be spearheading … Azure-based data solutions and helping them further the development of their award winning data platform. In this pivotal role, you'll be responsible for leading the design and implementation of cutting-edge data solutions. Key Responsibilities: Lead the design and implementation of Azure … data design documents to articulate architecture decisions and implementation plans clearly. Requirements: Strong proficiency in Azure services, including Spark, Data Lake, Synapse, and Databricks. Exceptional stakeholder management skills with the ability to communicate effectively with both technical and non-technical audiences. Experienced and knowledgeable of more »

TO WORK IN INVESTMENT DOMAIN* WHAT WE OFFER and WHAT THE POSITION IS ABOUT? Tools & Technologies: You’ll program in Java and model data using Alloy/Legend – a data management and data governance open-source platform that we will teach you. Other technologies … suggest improvements to products and to propose ways in which we can add value for our stakeholders. Interpersonal Communication: You’ll engage with data producers and consumers across all areas of the business to understand their requirements and to propose solutions tailored to their needs. Training: Your manager … Maven/Gradle/Ant) Experience with continuous delivery and deployment Proficient at working with large and complex code bases Alloy, Data Lake PURE Being able to describe, connect and visualise data Model to model mapping Creating data models NOTE : If you have more »

an experienced Business Development Manager with a passion for driving sales and fostering growth? Are you well-versed in any of the following? Data, data warehousing, data lakes,, data engineering, Business Intelligence solutions? A legacy of potential clients waiting to be re … ignited!!! Then, I have an exciting opportunity for you! My client is a leading IT solutions provider specialising in Data, BI and ERP solutions, serving a diverse clientele ranging from FTSE 100 companies. Retail, manufacturing, FTSE500, NHS, Blue Light, and Local Authorities. The mission is to unlock insights … in data, drive performance, and create value by leveraging cutting-edge technology and expertise. As a Senior Business Development Manager, you will play a pivotal role in driving sales and expanding the solutions portfolio. Your responsibilities will include identifying new clients, nurturing relationships with key stakeholders, conducting market more »

Senior Data Engineer Manchester (Hybrid Role) £70,000 per annum Position Summary: We are seeking a talented Senior Data Engineer to spearhead the design and implementation of robust data pipelines and advanced scripts. You will play a key role in architecting dynamic data warehousing systems on the Azure platform, harnessing the power of data lakes, Databricks, and Synapse Analytics. Your contributions will significantly propel this organisation into a new era of data-driven excellence, driving innovation and delivering impactful solutions. Key Responsibilities: Collaborate closely with cross-functional … teams, including Data Scientists, Software Engineers, and Business Analysts, to deliver impactful solutions aligned with business goals. Develop and deploy scalable data pipelines for the ingestion, incremental loading, transformation, and modeling of data. Architect agile data warehousing systems on the Azure platform, utilising data more »

We are looking for a passionate Junior Data Analyst. The successful candidate will have a keen eye for detail, a willingness to learn and an understanding of the link between data, insights and business decisions. Role Develop and implement databases, data collection systems and … data engineering solutions that optimise reporting efficiency and clarity Acquire data from primary or secondary data sources and maintain databases/data lakes Interpret data, analyse results using statistical techniques and provide ongoing reports Identify, analyse, and interpret trends or … patterns in complex data sets Filter and “clean” data by reviewing raw data, reports, and performance indicators to locate and correct code problems Work with management to prioritise business and information needs Locate and define new process improvement opportunities Training Data Analyst more »

Data Architect Fully Remote (Cardiff Based) Salary Up to £55,000 + Benefits CPS Group are currently working with a bespoke software consultancy who have a fantastic opportunity for a Data Architect to join their growing team. In this position you will be working on exciting … brining life to the defined architecture. This is the perfect growth opportunity as this position will be a great fit for an experienced data engineer who is looking for the next step in their career. This opportunity will also be a great fit for an experienced Data Architect as it will be a chance to strengthen and grow the data team using your own vision. Key Responsibilities: * Support the design and implementation of new cloud native data lakes, data pipelines, and data visualisation solutions using GCP and more »

AWS Data Architect/Enterprise Architect | Contract | Initial 6 months London - 3x a week Length: Initial 6 months Contract, Inside IR35 Delivery of AWS-based data & analytics capabilities, built on foundational services such as EMR, Glue, MWAA, Dynamo, Kinesis, Kafka and Sagemaker AWS Cloud Data Platforms Architecture and AWS Cloud Security & Infrastructure Insurance or Regulated Financial Services Industries Solutioning within a modern data architecture context such as data fabric or data mesh, and of cornerstone data & analytics capabilities (including data lakes, data more »

subject matter experts, solving interesting problems, and building the products of tomorrow, this opportunity is for you. On our mission to revolutionize the Data Strategy & Management space, we are seeking a dynamic and seasoned Solution Architect with a stellar track record in Data Products. As our … client navigates the complexities of a legacy IT landscape, we need someone who can not only conceptualize, design and build robust data platforms but also provide strategic guidance and stakeholder management expertise. Leveraging your software engineering expertise, you'll play a pivotal role in ensuring the integrity, efficiency … innovative solutions in challenging environments. Bachelor’s degree in computer science, computer engineering, or a relevant field. Responsibilities: Design and implement scalable database and datalake solutions tailored to client requirements. Evaluate client operations, applications, and programming to identify database structural necessities and ensure alignment with organizational goals. Create robust data more »