176 to 200 of 345 Data Lake Jobs

change the status quo, we’ll help you make your moment. Join Team Purple. Join IFS. Job Description As a Principal/Senior Data Engineer, you will spearhead our data initiatives, transforming raw data into strategic assets that propel our business forward. This role … who excel in a dynamic environment, offering the freedom to innovate and the responsibility to deliver. Core Responsibilities: Identify and harness high-value data opportunities within our product suite, converting raw data into impactful features and reusable assets. Act as the authoritative voice on data technology , steering our organization towards cutting-edge platforms and methodologies. Architect and execute comprehensive data projects, ensuring robust scalability and performance from conception to deployment . Collaborate with a team of ML Engineers, Data Scientists, and other key stakeholders to design, implement, and maintain more »

About Tredence­: - Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions at scale –empowering end users to improve decision … methodology; think strategically and execute methodically Develop and manage capacity and growth projection forecasts of the environment within budgets Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional/non-functional business requirements Drive optimization, testing and tooling to improve … in Data bricks Experience managing distributed teams preferred. Strong technical experience in large distributed systems, Data Warehousing, Data Lake at scale Project management skills: financial/budget management, scheduling and resource management experience with medium and large-scale projects Comfortable working with ambiguity more »

development, implementation, and support of a cutting-edge real-time data platform, which includes data streaming, a data lake, and a blazing fast analytics database. We are looking for someone who is passionate, motivated, driven, and up for the challenge. Strong knowledge of … database design and development with previous experience in developing ETL processes, and multidimensional data models. High understanding of both relational and multidimensional modelling principles. Deep knowledge of Object-Oriented Programming languages and must have a strong experience in Java. Strong experience on data quality standards and … contribution on defining and monitoring data quality metrics and KPIs Key Skills Needed: Flink Beam Kafka Connect Java more »

Lead Data Engineer A brand new and exciting opportunity has recently arisen for a Lead Data Engineer with an excellent knowledge in ETL, Azure Data Factory, Azure Databricks and CRM Implementations to join one of the UK's Largest Charity based in London. As … the Lead Data Engineer you will be implementing a new CRM (Salesforce) and also leading the migration to Azure. This is an excellent opportunity for an Lead Data Engineer who is looking to work for the Largest UK Charity who are working on exciting projects and … this is the perfect opportunity for you! Skills that are required for a Lead Data Engineer are: Experience in Azure (ADF and Datalake) Experience working with ETL pipelines Previous experience Managing or Mentoring Engineers CRM Implementation experience Lead Data Engineer/Senior Data Engineer more »

SENIOR DATA ENGINEER (EU Remote Opportunity) Xcede are delighted to be working with a very exciting Web3/Blockchain organisation with a remote working culture. Their company makes life easier for organisations in the Web3 space by providing managed services across a range of operational tasks and responsibilities … in one space. As a Senior Data Engineer in the company, you will have several clear tasks that are essential to the smooth running of processes that make this Product so unique. Responsibilities Design and implement both batch & stream Data Pipelines around the data stores & data lake. Lead by example, always aiming to work towards software engineering best practice and disaster prevention (rather than recovery). Maintain and optimise the infrastructure across the company. Requirements An academic background in Statistics, Mathematics, or Computer Science (or similar) A number of years more »

Senior Data Engineer – Higher Education – 6 Months (Rolling) - London - £522.50 One of the UK’s leading higher education clients now requires a Senior Data Engineer on an initial six-month contract to improve their learning engagement platform. The Data Engineer will be predominantly responsible … for setting up and configuring a new Azure Data Lake. The ideal Data Engineer will have the following skills/experience: Proven Experience working on Azure Data Factory Previously worked with Python and SQL Previously worked with Power BI Interpersonal and Stakeholder Management Skills … position and would require you onsite 1 – 2 day(s) per week onsite at their office in London. If you’re an experienced Data Engineer looking for an exciting new opportunity with a leading Higher Education client, please apply more »

Senior Azure Data Engineer (Consultancy) £70,000-£80,000 salary Hybrid (London) Immediate start One of my long-standing consultancy clients, one of the UK's leading Microsoft Solutions Partners for over 20 years and experts in digital transformation with Azure, have just reached out with an urgent … hire for a Senior Azure Data Engineer to join the team. **This is a permanent position ( no contractors will be considered ), and you must have full right to work in the UK to apply** They have a new project starting in mid-February, so are looking ideally for … interviews next week, and they are looking to have this position filled by next Friday . Essentials: Experience in a consultancy . Azure Data Engineer certification . Experience working with Dynamics 365 Experience with Azure Synapse , Data Factory , Data Lakes 4+ years as a more »

A global leader in the design, marketing and distribution of premium lifestyle products is seeking a customer data platform product manager, to join their global customer insights team. You will be responsible for leading the development of their customer data platform. The ideal candidate will understand … customer facing businesses, have ROI-driven digital marketing acumen, be data fluent, and play a pivotal role to bridge the gap between business and technical teams. Responsibilities: Bridge the gap between the business and IT; ensure all requirements are documented, understood, and delivered. Own customer data … and EMEA, managing best practice communication and guidelines. Serve as the first point of contact for platform-related questions and support resolution of data issues. Understand consumer privacy regulations like GDPR and work with DPO, legal, engineering, and marketing teams to ensure compliance. Work to define data more »

will include… You will be able to produce a variety of reports focusing on a range of areas, including; Security, Performance, compliance audits, data collected from various IT Systems and tools. Strong ability to maintain and develop technical documentation, including system configurations, network diagrams, operating procedures to support … clients IT Environments. You will be analysing large data-sets to identify trends, patterns and anomalies, and have the ability to extract worthwhile insight to be included in the reports. Be an SME around identifying opportunities where automation report created can be used, using scripting languages and reporting … tools to enhance efficiency and scalability. What you’ve got… Experienced background in Report Writing, Data Analysis, or technical documentation within the IT/Tech industry. Experience on Microsoft office applications! Particularly Excel + Word, for documenting and report writing purposes. Being confident on Azure is a must more »

A Senior Data Engineer required by this leading research and analytics vendor to join an existing Data engineering/product function as they look to continually improve their product and application suite. As a senior member of the data practice you will - Promote best … practice for data related projects Mentoring engineers Coordinating resources Aim for continuous improvement of the team Innovate with the use of new technologies Ideally you can demonstrate experience across a breadth of tools and technologies, including - Demonstrable professional Data experience Experience of working with semi or … warehouses and data lakes. Knowledge of Azure Cloud Services Good understanding T-SQL programming Good exposure to Azure Data Lake technologies such as ADF, HDFS and Synapse Good knowledge of Data Governance, Data Catalog, Master Data Management Knowledge more »

Principal, Data Architect Salary: Open + Bonus Location: Chicago, IL or Dallas, TX Hybrid … days onsite, 2 days remote Qualifications 10+ years of related experience leading to a Senior Architect level. Experience in design of data lake/warehouse solutions, preferably in the cloud. Experience in schema design for relational and non-relational data and messaging protocols. Experience in … Protocol Buffers SQL and No SQL databases BI tools (Tableau, Power BI etc.) Federated query tools such as Presto/Trino Data lake file formats such as Avro, Parquet, ORC Responsibilities Design the data architecture of organization to support data driven vision. Create more »

LOCATION: Chicago, IL Hybrid 3 days in office and 2 days remote Looking for a candidate that does data architecture and design. Datalakes, data warehouse solutions. schema designs relational nonrelational data messaging design of data science data analytics Kafka and … ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform the primary functions. Experience in design of data lake/warehouse solutions, preferably in the cloud Experience in schema design for relational and non-relational data and messaging protocols Experience in … databases Expertise with BI tools (Tableau, Power BI etc) Expertise with federated query tools such as Presto/Trino Experience with data lake file formats such as Avro, Parquet, ORC [Required] Experience in extracting and developing technical requirements from business goals and needs. [Required] Experience in solution more »

App Services, virtual networks, Exchange Online, Intune). * Implement Azure security best practices and Microsoft Defender. * Monitor and mitigate security incidents. * Protect sensitive data and ensure data governance compliance. * Collaborate … with Data and AI teams on Azure-based solutions. * Guide on Azure services for Data and AI (Data Lake, Data Factory, OpenAI). * Integrate Data and AI solutions with existing systems. * Maintain on-premises infrastructure (Windows Server, Active Directory … CV to connor . thomas @ nextech - group . co . uk. They are interviewing IMMEDIATELY!! Keywords: Azure, Entra ID, SQL, Exchange Online, Intune, Data, Windows Server, Active Directory, Oracle, VMware, Red Hat, Enterprise, Linux, Cisco Switches, Palo Alto Firewalls, PowerShell, Python more »

This Global Pharmaceutical Services provider are looking for a Data Engineer to work within their growing Business Intelligence technical service function. You will be supporting the technical development of their cloud data platforms, offering the options for near real time process reporting solutions. Client Details Global … when needed, accurate and understood. Key Technical Skills required: Extensive experience of working with Azure data platform technologies including Data Lake gen 2, Synapse, Analysis Services, Power BI Extensive experience of working with Azure Data Factory & Databricks Extensive SQL knowledge (Microsoft SQL Server … . Metadata management/Data quality Profile Extensive experience of working with Azure data platform technologies including Data Lake gen 2, Synapse, Analysis Services, Power BI Extensive experience of working with Azure Data Factory & Databricks Extensive SQL knowledge (Microsoft SQL Server more »

Write high-quality, maintainable code using languages such as Python and SQL Establish data tools like Snowflake and Azure Data Lake Services (ADLS) Gen 2 Utilize PowerBI, Tableau, or similar tools to design and create interactive and visually appealing dashboards and reports. Work closely with … goals. Qualifications: 10+ years of overall IT experience , with 2-4 years of hands-on experience in Azure. Proficiency in at least one data visualization tool, such as PowerBI, Tableau, or similar. Knowledge of database management systems (DBMS) and proficiency in SQL Server or similar platforms. Experience with more »

Lead Azure Data Engineer, Manchester - My client has an immediate and exciting opportunity available for an experienced Azure data engineer to join and help lead their small team of developers. You'll have the opportunity to expand your skills by delivering valuable data insights … and reporting solutions using the latest Microsoft technologies: SQL Server Integration Services, Azure Synapse Analytics, Azure Analysis Services, Azure Data Lake, Azure SQL Database, Azure Data Factory, and Power BI. Collaborate with team members or directly with business users to understand requirements and … propose suitable solutions. Ensure all work is properly managed through environments, source controlled, and deployed efficiently. Maintain data quality and support data governance efforts. Establish best practices for code management and deployment between cloud environments. Experience Required: Strong customer focus and communication skills Experience with Microsoft more »

Data Scientist (Pharma) Fully remote (UK/Ireland/Europe) Salary up to £75k depending on experience MBN Solutions are delighted to have been retained by their client, a powerhouse in the Pharmaceuticals industry, to onboard a talented and innovative Data Scientist to join the team. … This Data Scientist will help rocket the business into the future, masterfully crafting, launching, and fine-tuning cutting-edge Advanced Analytics Models. You will be the person behind transforming raw data into actionable insights, ensuring the organisation makes decisions that are not just informed but inspired. … & modelling lifecycles (ML Ops). Seek to improve model efficiency, performance, and scalability Microsoft Technology Stack experience sought (Azure Data Lake, Databricks, Azure ML, Power BI), and capabilities of programming in and understanding R & Python. You will also likely have: A passion for problem-solving more »

Data Engineer Grade: Consultant Analyst/Consultant Location: Belfast – BT6 8DN In-Office: 2 days per week Employment Type: Full Time The Opportunity: A Tier One Technology Consultancy seeks a highly ambitious and technically astute AWS Data Engineer to help design, build and deploy cloud-based … in data cleaning, wrangling, visualization, and reporting. Specialised in AWS cloud technologies for ETL, data warehouse, and data lake design. Hands-on experience with AWS services like EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. Capable of processing large volumes of structured and unstructured data … AWS cloud, including Platform-as-a-Service, server-less, and container technologies. Diverse skills in ETL, data warehouse, and Data Lake design. Familiarity with various tools, cloud technologies, and approaches. Expertise in AWS or equivalent open-source tools. Proficient in defining the end-to-end more »

Role: Data Modelling Job Type: Permanent Location: London (Hybrid) Ready to utilize your Data analysis and Investigatory skills ? Are you passionate about RDBMS systems and converting data requirements into logical models and physical solutions? We have an exciting role for you as a Data … the future of technology. with some of the brightest global minds in the industry. access to endless learning opportunities. The Role As a Data Modeler, you will utilise your analytical skills to design, implement and create conceptual, logical, and physical data models. Key responsibilities: modelling standards … to convert data requirements into logical models and physical solutions. with data warehousing solutions (e.g. Snowflake) and data lake architecture, Azure Databricks/Pyspark & ADF. retail data model standards - ADRM. communication skills, organisational and time management skills. to innovate, support change more »

Salary: Up to £100,000 depending on experience Location: Hybrid working in either Swansea, Bristol, Manchester, London. Are you a skilled Data Engineer who can deliver Data Platforms? Are you familiar of working on agile delivery-led projects? Data Engineers at Made Tech help … build data platforms to enable predictive government services that make a positive impact on the people in the UK. So, if you are looking to be part of this mission, we would love to hear from you. Support in applying If you need this job description in another … interviews and any other needs. We also welcome any feedback on how we can improve the experience for future candidates. As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by more »

Salary: Up to £100,000 depending on experience Location: Hybrid working in either Swansea, Bristol, Manchester, London. Are you a skilled Data Engineer who can deliver Data Platforms? Are you familiar of working on agile delivery-led projects? Data Engineers at Made Tech help … build data platforms to enable predictive government services that make a positive impact on the people in the UK. So, if you are looking to be part of this mission, we would love to hear from you. Support in applying If you need this job description in another … interviews and any other needs. We also welcome any feedback on how we can improve the experience for future candidates. As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by more »

Azure Data Engineer | Cheltenham | £50,000-£70,000 Locke & McCloud are working with a leading Cyber Security Consultancy that is home to over 4000 specialists who support clients across manufacturing, defence and security, energy and utilities, financial services and many other industries. They have offices globally and are … requirements. Design and implement scalable data solutions on the Azure platform, leveraging services such as Azure SQL Database, Azure Data Lake, and Azure Synapse Analytics. Develop and maintain ETL pipelines to ingest, transform, and load data from various sources. Optimize data … SQL, T-SQL, and data modelling concepts. Hands-on experience with Azure services such as Azure SQL Database, Azure Data Lake, Azure Synapse Analytics, Azure Data Factory, and Azure Databricks. Familiarity with data governance, security, and compliance frameworks. Excellent communication and more »

Azure Data Engineer (SC Cleared) Location: Bristol Salary: £50,000 - £60,000 We're seeking Azure Data Engineer with active SC Clearance. This is a fantastic opportunity to join one of the most reputable digital solution provider's in the United Kingdom providing exposure to the … biggest and most ambitious programmes undertaken to keep our country safe. The SC Cleared Azure Data Engineer will be joining the Defence & Security arena, where you will help digitise defence with new thinking on technology capabilities and adoption processes, so we need someone who is sensitively able to … have Active SC Clearance* Role requirements Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. Utilizing Azure data and analytics services, including but not limited to Azure Data Factory more »

Senior Analytics Data Engineer 🌐 Global Insurance Leader 💵 £120,000 + 20% Bonus 🏠 1-2 days in the office (Central London) 🌐 Join a Global Insurance Leader: Exceptional Opportunity for a Visionary Data Engineering Expert! Are you an experienced Senior Analytics Data Engineer who thrives on … transforming data into actionable insights? Are you ready to join a top-tier global insurer on an ambitious journey to become the industry's gold standard in data-driven decision-making? Look no further - this is your chance to make a difference and shape the future … of insurance! Our client, a prestigious global insurer, is at the forefront of leveraging data and technology to revolutionize decision-making across the organization. Their ambitious Data and Analytics strategy aims to provide a 360-degree view of data to empower every team member more »

Data Integration Manager A brand new and exciting opportunity has recently arisen for a Data Integration Manager with excellent knowledge in Azure and Salesforce SQL to join one of the UK's most notorious Charities. We're in search of an … experienced Data Integration Manager to lead the smooth integration of data from diverse sources into our Azure Data Lake and Salesforce NFP Cloud. The ideal candidate will oversee the entire data flow process, including cleansing, harmonization, and integration into Salesforce NFP … Cloud and Marketing Cloud. Proficiency in data management technologies, especially Azure Data Lake, Salesforce NFP, and Azure Data Factory, is essential for this role. Skills that are required for a Data Integration Manager are: Expert in Azure Experience working with data more »