26 to 50 of 629 Big Data Jobs

benefits including a fresh perspective on workplace flexibility. Position Purpose: This role will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth … flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and Cleaning: Acquiring data More ❯

benefits including a fresh perspective on workplace flexibility. Position Purpose: This role will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth … flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and Cleaning: Acquiring data More ❯

benefits including a fresh perspective on workplace flexibility. Position Purpose: This role will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth … flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and Cleaning: Acquiring data More ❯

benefits including a fresh perspective on workplace flexibility. Position Purpose: This role will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth … flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and Cleaning: Acquiring data More ❯

benefits including a fresh perspective on workplace flexibility. Position Purpose: This role will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth … flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and Cleaning: Acquiring data More ❯

benefits including a fresh perspective on workplace flexibility. Position Purpose: This role will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth … flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and Cleaning: Acquiring data More ❯

Lead Data Engineer (Databricks) - Leeds (Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI/CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Lead Data Engineer, Team Lead, Technical Lead … Senior Data Engineer, Data Engineer) Our client is a global innovator and world leader with one of the most recognisable names within technology. They are looking for a Lead Data Engineer with significant Databricks experience as well as leadership responsibility to run an exceptional Agile engineering team and provide technical leadership through coaching and mentorship. We are … seeking a Lead Data Engineer capable of leading client delivery, ensuring the highest standards. This will include working with architects, creating automated tests, instilling a culture of continuous improvement and setting standards for the team. You will be responsible for building a greenfield modern data platform using cutting-edge technologies, architecting big data solutions and developing More ❯

Trade Data Architect - £800 - £900 Per Day – 6 Months – London (Hybrid) - Commodities Overview: A market leading organisation operating in the physical commodities space are searching for an experienced Data Architect with strong experience on the Azure Data stack to join one of their growing teams in London on a hybrid basis. Role & Responsibilities: Design and develop Enterprise … Data Architecture for Trade, Sales Ops and Finance use cases. Deliver effective Big Data solutions aligned with Business objectives. Responsible for creating a target state architecture that best enable seamless integration of complex systems and valuable Analytics. Own and develop Conceptual, logical, and Physical data models. Technical Requirements: Experience designing and developing enterprise data architecture … and delivering effective big data solutions aligned with business objectives. Proven experience in designing Lakehouse Architecture, Data Governance, and Data Modelling Strong understanding of data integration, data quality, and data governance. Extensive experience in working with big data technology tools and platforms such as Microsoft Azure Data Factory, Databricks, Unity More ❯

We have 9 NEW open positions based in our London office. As a Big Data Solutions Architect (Resident Solutions Architect) in our Professional Services team, you will work with clients on short to medium-term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and … and productionalizing customer use cases Work with engagement managers to scope a variety of professional services work with input from the customer Guide strategic customers as they implement transformational big data projects, 3rd party migrations, including end-to-end design, build and deployment of industry-leading big data and AI applications Consult on architecture and design … Engineering and Databricks Customer Support to provide product and implementation feedback and to guide rapid resolution for engagement specific product and support issues. What we look for: Proficient in data engineering, data platforms, and analytics with a strong track record of successful projects and in-depth knowledge of industry best practices Comfortable writing code in either Python or More ❯

We have 9 open positions based in our London office. As a Big Data Solutions Architect (Resident Solutions Architect) in our Professional Services team you will work with clients on short to medium-term customer engagements on their big data challenges using the Databricks Platform. You will provide data engineering, data science, and cloud … s and productionalising customer use cases Work with engagement managers to scope a variety of professional services with input from the customer Guide strategic customers as they implement transformational big data projects, 3rd party migrations, including end-to-end design, build and deployment of industry-leading big data and AI applications Consult on architecture and design … Engineering and Databricks Customer Support to provide product and implementation feedback and to guide rapid resolution of engagement-specific product and support issues. What we look for: Proficient in data engineering, data platforms, and analytics with a strong track record of successful projects and in-depth knowledge of industry best practices Comfortable writing code in either Python or More ❯

Data Engineering Manager, Amazon Music Technology We are seeking an ambitious Data Engineering Manager to join our Metrics and Data Platform team. The Metrics and Data Platform team plays a critical role in enabling Amazon Music's business decisions and data-driven software development by collecting and providing behavioral and operational metrics to our internal … teams. We maintain a scalable and robust data platform to support Amazon Music's rapid growth, and collaborate closely with data producers and data consumers to accelerate innovation using data. As a Data Engineering Manager, you will manage a team of talented Data Engineers. Your team collects billions of events a day, manages petabyte-scale … datasets on Redshift and S3, and develops data pipelines with Spark, SQL, EMR, and Airflow. You will collaborate with product and technical stakeholders to solve challenging data modeling, data availability, data quality, and data governance problems. At Amazon Music, engineering managers are the primary drivers of their team's roadmap, priorities, and goals. You will More ❯

accordingly. This is an incredible opportunity to be part of this transformation journey. Responsibilities: The Solution Architect will be responsible for re-engineering the interaction of incoming and outgoing data flows from the Core Accounts DDA platform to Reference Data platforms, Data Warehouse, Data Lake as well as other local reporting systems which consume data from Core Accounts Drive the data architecture and roadmap for eliminating non-strategic point to point connections and batch handoffs Define canonical data models for key entities and events related to Customer, Account, Core DDA in line with the Data Standards Assess opportunities to simplify/rationalize/refactor the existing database schemas paving way for … modularization of the existing stack Provide technical guidance to Data Engineers responsible for designing an Operational Data Store for intra-day and end-of-day reporting. Implementing data strategies and developing logical and physical data models. Formulate efficient approach to rationalize and formulate strategy to migrate reports Build and nurture a strong engineering organization to deliver More ❯

Artificial Intelligence Engineer/Data Scientist £50k - £90k dependant on experience bonus good bens. Flexible Working Location opportunity. This role may suit individuals who have previously held roles such as Data Engineer, Data Architect, Big Data Consultant, Data Scientist, Data Modeller, Big Data Analyst, or AI Engineer. We are assisting in … recruiting AI Engineers/Data Scientists to join an innovative and growing team within the data practice of a prestigious global technology consulting firm. The client offers excellent career growth, professional development, and a personalized benefits package. Candidates must ideally have UK security clearance and be fully flexible regarding working location. The successful candidate will be a key … team member designing modern analytical data solutions, engaging in the full project lifecycle. The role offers a diverse range of exciting work. Key Skills We are recruiting at various levels within the salary range, so candidates are not expected to be experienced in all areas listed below. AI techniques (supervised and unsupervised machine learning, deep learning, graph data More ❯

of the competitive consulting companies, headquartered in United Kingdom that provide cutting-edge technology solutions, that enable businesses to thrive in the digital era. We specialize in Cloud, DevOps, Data Science, Blockchain, IoT, and Metaverse technologies, and our team of experts is dedicated to delivering innovative solutions that drive business growth and transformation. Our team of experts has years … mandatory that the candidate should have handled more than 2 projects in the above framework using Scala. Should have 4+ years of relevant experience in handling end to end Big Data technology. Meeting with the development team to assess the company's big data infrastructure. Designing and coding Hadoop applications to analyze data collections. Creating … data processing frameworks. Extracting data and isolating data clusters. Testing scripts and analyzing results. Troubleshooting application bugs. Maintaining the security of company data. Training staff on application use Good project management and communication skills. Designing, creating, and maintaining Scala-based applications Participating in all architectural development tasks related to the application. Writing code in accordance with the More ❯

We believe in better. And we make it happen. Better content. Better products. And better careers. Working in Tech, Product or Data at Sky is about building the next and the new. From broadband to broadcast, streaming to mobile, SkyQ to Sky Glass, we never stand still. We optimise and innovate. We turn big ideas into the products … content and services millions of people love. And we do it all right here at Sky. The team is looking for a Data Architect to join the IoT platform team, supporting technical initiatives aimed at enhancing data architecture and improving the platform's data handling capabilities. This role will focus on designing scalable data models, ensuring … data quality, and streamlining the integration of data sources for real-time analytics and platform performance. The Data Architect will also play a key role in implementing data governance policies to ensure compliance, security, and proper management of IoT data. Additionally, the role will involve aligning IoT data practices with broader company data standards More ❯

totaled $13.8 billion. Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver data solutions and integration pipelines in accordance with agreed organizational standards that ensure services are resilient, scalable and future-proof … implement cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data platforms which involves Cloud & related technologies, Graph databases, Virtualization Technology Perspective Worked in multiple large distributed mission critical applications as an architect. Proven experience as architect and engineering lead … in Data & Analytics stream. In-depth understanding of data structure principles and data platforms Used Architecture tools for modelling. Working experience on Modern data platforms which involves Cloud & related technologies Keeps track of industry trends and incorporates new concepts Advanced understanding of AI concepts , LLMS, RAG, Agentic apps Advance Understanding in Data visualization and Data More ❯

totaled $13.8 billion. Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver data solutions and integration pipelines in accordance with agreed organizational standards that ensure services are resilient, scalable and future-proof … implement cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data platforms which involves Cloud & related technologies, Graph databases, Virtualization Technology Perspective Worked in multiple large distributed mission critical applications as an architect. Proven experience as architect and engineering lead … in Data & Analytics stream. In-depth understanding of data structure principles and data platforms Used Architecture tools for modelling. Working experience on Modern data platforms which involves Cloud & related technologies Keeps track of industry trends and incorporates new concepts Advanced understanding of AI concepts , LLMS, RAG, Agentic apps Advance Understanding in Data visualization and Data More ❯

BT drives security decision making impacting all levels of the organization. As a large, distributed, multinational IT-based company, BT has a unique view of global cyber threat, including data sets that have never been available to the industry before. We are developing novel and sophisticated ways of analysing this data to ensure we stay ahead in this … exciting and challenging environment. As an experienced data engineer, you will be responsible for developing and maintaining data pipelines, so that this highly skilled team of data scientists, data engineers and developers, continue to generate unique, innovative and impactful intelligence. This role is hybrid (3 days in office) & can be based in either Bristol or Manchester … What you'll be doing Developing and maintaining Data Pipelines for extraction, transformation and loading processes Assembling large, complex data sets that meet user and business requirements Collaborating with data scientists and intelligence analysts, to support and deliver against their requirements Identifying and implementing process improvements to enhance data delivery and scalability Build and maintain collaboration More ❯

firm and across the globe, Deloitte is an environment where you and your career can flourish. The SAP Analytics+ team consists of 5 core capability groups: Strategy and Architecture Data & Platforms Planning, Budgeting and Forecasting Advanced Analytics Performance, Consolidation & Close Connect to your career at Deloitte Deloitte drives progress. Using our vast range of expertise, we help our clients … how and where it mattersmost . Connect to your opportunity There is an opportunity for you to join and help develop our SAP Analytics+ team, specifically focusing on SAP Data & data Platforms, based on best in class solutions, we expect you to be an expert in using one or more of: SAP ECC/S4/HANA SAP … DataSphere SAP Business Warehouse for HANA (SAP BW/4HANA) SAP Business Transformation Platform (BTP) This represents a unique opportunity to develop your career in consulting within an established Big 4 consulting firm. You will have the chance to develop your technical and functional expertise in the Analytics+ tools, as well as in the delivery and implementation of large More ❯

firm and across the globe, Deloitte is an environment where you and your career can flourish. The SAP Analytics+ team consists of 5 core capability groups: Strategy and Architecture Data & Platforms Planning, Budgeting and Forecasting Advanced Analytics Performance, Consolidation & Close Connect to your career at Deloitte Deloitte drives progress. Using our vast range of expertise, we help our clients … how and where it mattersmost . Connect to your opportunity There is an opportunity for you to join and help develop our SAP Analytics+ team, specifically focusing on SAP Data & data Platforms, based on best in class solutions, we expect you to be an expert in using one or more of: SAP ECC/S4/HANA SAP … DataSphere SAP Business Warehouse for HANA (SAP BW/4HANA) SAP Business Transformation Platform (BTP) This represents a unique opportunity to develop your career in consulting within an established Big 4 consulting firm. You will have the chance to develop your technical and functional expertise in the Analytics+ tools, as well as in the delivery and implementation of large More ❯

firm and across the globe, Deloitte is an environment where you and your career can flourish. The SAP Analytics+ team consists of 5 core capability groups: Strategy and Architecture Data & Platforms Planning, Budgeting and Forecasting Advanced Analytics Performance, Consolidation & Close Connect to your career at Deloitte Deloitte drives progress. Using our vast range of expertise, we help our clients … how and where it mattersmost . Connect to your opportunity There is an opportunity for you to join and help develop our SAP Analytics+ team, specifically focusing on SAP Data & data Platforms, based on best in class solutions, we expect you to be an expert in using one or more of: SAP ECC/S4/HANA SAP … DataSphere SAP Business Warehouse for HANA (SAP BW/4HANA) SAP Business Transformation Platform (BTP) This represents a unique opportunity to develop your career in consulting within an established Big 4 consulting firm. You will have the chance to develop your technical and functional expertise in the Analytics+ tools, as well as in the delivery and implementation of large More ❯

Broster Buchanan are partnered global business within the food industry with a turnover of £8Bn+ who are looking for a Fabric Data Engineer to join as they set up an exciting new project team within the group. This would suit an experienced Azure Data Engineer with good Fabric experience looking to join a new, growing team with plenty … of £55k - £65k + 10% bonus is on offer. Responsibilities: Help set up and deliver the future direction of strategy and approach to the management, storage and usage of data Collaborate with their wider technology and business teams to ensure goals and visions are aligned and achieved Help with setting up the data warehousing and lake processes, including … collaborating with their architecture teams to figure out what that will look like At times, guide and mentor the junior data engineers within the team, reviewing their ideas, providing feedback and identifying their knowledge gaps to support their development Design, develop, and manage data pipelines using Fabric Data Factory Leverage Fabric Data Integration for seamless data More ❯

or operational military experience. If you're looking for a challenging and rewarding career with a leading organization, come see what we can offer you! Position JSE V&V Data Scientist Location: Patuxent River, Maryland Security Clearance: Active Secret Clearance Required - U.S. citizenship required Salary: $120,000 - $160,000 Depending on Experience and Education Travel: 5% Benefits: SURVICE Engineering … include competitive salaries, comprehensive insurance options, paid time off, 401(k) with company match, flexible spending, tuition reimbursement. Position Summary SURVICE Engineering is currently seeking a JSE V&V Data Scientist to support our Patuxent Area Operation. You will accelerate your career and become an integral team member within the defense community. Primary Duties and Responsibilities of JSE V … V Data Scientist Modeling and Simulation Verification and Validation using data science tools and skills. Conduct Data Mining, Data Analysis, Data Transformation, and Data Visualization on large data sets (Big Data). Research and apply data science techniques to assess, extract, evaluate, and compare M&S outputs with representative real More ❯

Move to Skip to Content Link Select how often (in days) to receive an alert: Date: 2 Aug 2025 Company: Royal London Group Job Title: Lead Software Engineer (Azure Data) Contract Type: Permanent Working style: Hybrid 50% home/office based Closing date: 15th August 2025 We are seeking a highly skilled and experienced Lead Software Engineer (Azure Data … our applications and will provide a blend of both solid leadership experience and technical expertise. This role is focussed within the Engagement Services platform with a focus on Azure Data and contributes to our purpose of strengthening the mutual choice for our customers, by providing the best technology solutions to our customers. About the role Design, develop, and maintain … ETL/ELT data pipelines using Azure Data Factory (ADF) for automating data ingestion, transformation, and orchestration from diverse data sources. Build scalable data integration processes to bring in data from on-premises , cloud , and external APIs into Azure Data Lake Storage (ADLS). Data Transformation & Modeling : Utilize Azure data Factory More ❯

Data Engineer (Hybrid) Position location: Columbia, MD, United States Additional details: We are seeking a talented Lead Data Engineer to support the ingestion of mission-critical and mission-support data sets into a big data environment. The ideal candidate will have a background in supporting cyber and/or network-related missions within military spaces … professional culture where everyone can thrive. We welcome anyone who is willing to contribute positively to the success of our clients and their missions. Essential Job Responsibilities • Work with big data systems and complex structured and unstructured data sets. • Support government data acquisition, analysis, and sharing efforts. • Focus on software infrastructure for big data scaled ingestion, including understanding and ingesting new data sources, modifying existing data sources, implementing testing, establishing monitoring, and troubleshooting. • Lead the department in achieving strategic goals, ensuring data integrity, and fostering a collaborative and innovative work environment. Minimum Qualifications • Security Clearance-Current active TS/SCI • At least 10 years of experience in one of the More ❯