1 to 25 of 619 Permanent Big Data Jobs

About Us: ATREIDES is a leader in advanced geospatial technologies, big data solutions, and data analytics. We specialize in providing cutting-edge software platforms that enable our clients to process, analyze, and visualize large-scale geospatial and sensor data for critical decision-making. Our mission is to deliver innovative, scalable, and high-performance platforms that help … organizations unlock the full potential of their data for various industries, including defense, national security, environmental monitoring, and urban planning. We are seeking a highly skilled Senior Data Engineer with a strong focus on big data, data analytics, and geospatial data intelligence to join our engineering team. In this role, you will help design … and develop robust, scalable platforms that handle vast amounts of geospatial data and provide actionable insights through data analytics. Job Overview: As a Senior Data Engineer at ATREIDES, you will be responsible for developing and optimizing our core software platform, with an emphasis on integrating and processing big data, performing advanced data analytics, and More ❯

BIG DATA ENGINEER - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A BIG DATA ENGINEER WITH DV CLEARANCE Permanent job opportunity for a Big Data Engineer Leading National Security & Defence SME Salary up to £80,000 plus clearance bonus London based organisation in an easily accessible location To … apply please call or email WHO WE ARE? We are recruiting multiple Big Data Engineers to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold DV or enhanced DV Security Clearance. WHAT WILL THE BIG DATA ENGINEER BE DOING? You will be joining a leading SME who … is working hard to support National Security projects within UK Govt. Departments in London. As part of a team, you will be responsible for implementing Big Data Solutions in Mission-Critical areas. WE NEED THE BIG DATA ENGINEER TO HAVE.... Current DV clearance - Standard or Enhanced Must have experience with big data tools such More ❯

company that solves real-world problems for large blue-chip companies and governments worldwide. We're pioneers of meaningful AI : our solutions go far beyond chatbots. We are using data and AI to solve the world's biggest issues in telecommunications, sustainable water management, energy, healthcare, climate change, smart cities, and other areas that have a real impact on … We're underpinned by over 300 engineers and scientists working across Africa, Europe, the UK and the US. ABOUT THE ROLE Sand Technologies focuses on cutting-edge cloud-based data projects, leveraging tools such as Databricks, DBT, Docker, Python, SQL, and PySpark to name a few. We work across a variety of data architectures such as Data Mesh, lakehouse, data vault and data warehouses. Our data engineers create pipelines that support our data scientists and power our front-end applications. This means we do data-intensive work for both OLTP and OLAP use cases. Our environments are primarily cloud-native spanning AWS, Azure and GCP, but we also work on systems More ❯

Job Description Job Title: Data Architect Location: London - 3 days travel to office SC Cleared: Required Job Type: Full-Time Experience: 10+ years Job Summary : We are seeking a highly experienced and visionary Data Architect to lead the design and implementation of the data architecture for our cutting-edge Azure Databricks platform focused on economic data. This … platform is crucial for our Monetary Analysis, Forecasting, and Modelling efforts. The Data Architect will be responsible for defining the overall data strategy, data models, data governance framework, and data integration patterns. This role requires a deep understanding of data warehousing principles, big data technologies, cloud computing (specifically Azure), and a strong … grasp of data analysis concepts within the economic domain. Key Experience: Extensive Data Architecture Knowledge: They possess a deep understanding of data architecture principles, including data modeling, data warehousing, data integration, and data governance. Databricks Expertise: They have hands-on experience with the Databricks platform, including its various components such as Spark, Delta More ❯

company that solves real-world problems for large blue-chip companies and governments worldwide. We're pioneers of meaningful AI : our solutions go far beyond chatbots. We are using data and AI to solve the world's biggest issues in telecommunications, sustainable water management, energy, healthcare, climate change, smart cities, and other areas that have a real impact on … We're underpinned by over 300 engineers and scientists working across Africa, Europe, the UK and the US. ABOUT THE ROLE Sand Technologies focuses on cutting-edge cloud-based data projects, leveraging tools such as Databricks, DBT, Docker, Python, SQL, and PySpark to name a few. We work across a variety of data architectures such as Data Mesh, lakehouse, data vault and data warehouses. Our data engineers create pipelines that support our data scientists and power our front-end applications. This means we do data-intensive work for both OLTP and OLAP use cases. Our environments are primarily cloud-native spanning AWS, Azure and GCP, but we also work on systems More ❯

Data Analyst, Data Engineer, SQL, Informatica, ETL, Data Ingestion, Data Integration, Data Analytics, Data Science There is a new role with an industry-leading Data Analytics and Data Science company based in London, looking for a Data Analyst/Data Engineer to join their business and build a career within … the business. Established six years ago, the company have grown rapidly and are now recognized as one of the industry leaders in the Data Analytics/Data Science space. They provide complex data solutions for blue chip and enterprise grade clients using cutting-edge data and cloud technology. They are looking for a Data Analyst …/Data Engineer to work across all areas of the business, defining data requirements across business units, analysing the relationships of data and technical data feed requirements aswell as working in proximity to architects on the Data Warehouse design, build and deployment This is a junior role, and as such will have a large focus More ❯

We are searching for an experienced Lead Data Engineer for an exciting data-driven business with multiple office locations across the UK. The role is offered as a remote position, but you MUST be based in the UK to be considered for the opportunity. In this role you will be involved in determining the future direction and impact … of data engineering within the business. This is an extremely exciting Lead Data Engineering role, a fantastic opportunity for an experienced, innovative and hands-on data professional to help shape our client's products and solutions. Reporting directly to the Head of Data Engineering, you will play a crucial role in driving the team's vision … and objectives to completion. You will be expected to provide technical leadership, own the solution, ensure the reliability of data products, and collaborate closely with your team and other teams to optimise data solutions. This is a fantastic opportunity for highly skilled and motivated Lead Data Engineer with strong expertise in data architecture, ETL pipelines, cloud More ❯

delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology. Your role and responsibilities IBM is currently seeking a seasoned Big Data Java Developer to join our Public Sector team for a significant project. The ideal candidate will possess a deep understanding of Big Data technologies, particularly … maintain Java-based applications for processing and analyzing large datasets, utilizing frameworks such as Apache Hadoop, Spark, and Kafka. Collaborate with cross-functional teams to define, design, and ship data-intensive features and services. Optimize existing data processing pipelines for efficiency, scalability, and reliability. Develop and execute unit tests, ensuring the quality and robustness of the code. Implement … development, including version control, continuous integration, and automated testing. Provide technical guidance and mentorship to junior developers. Stay abreast of the latest trends, best practices, and emerging technologies in Big Data and Java development. Contribute to the design and implementation of highly scalable, secure, and resilient data processing systems. Preferred technical and professional experience Bachelor's or More ❯

Job summary If you are really passionate about data, understand the power that data can have and want to use your knowledge in a role that can make a difference, the NHS Business Services Authority (NHSBSA) have the role for you! We are looking for a Data Architect to join our Digital, Data & Technology Directorate. It … perfect opportunity to take the next step in your career whilst supporting the NHS. If you are excellent at problem solving, great at building relationships and have outstanding technical data architecture skills, you have what this role needs! You will join the Data Strategy & Governance team, as part of a newly developed data architecture function. You will … work in partnership with stakeholders, analysing how data is modelled and collected, understanding gaps, and making recommendations for improvements. You will help design, develop, and implement data principles and standards across the organisation. You will need to be enthusiastic, a logical thinker and have a drive to succeed! What do we offer ? 27 days leave (increasing with length More ❯

Join to apply for the Data Architect role at NTT DATA 2 days ago Be among the first 25 applicants Join to apply for the Data Architect role at NTT DATA We are seeking a highly skilled and experienced Data Architect to join our dynamic team. The ideal candidate will have a strong background in … full data modelling life cycle, e.g. design, implement, and maintain complex data models that align with organisational goals and industry standards. This role requires a deep understanding of data architecture, data modelling methodologies, and ideally in real-time data integrations. The successful candidate will collaborate with cross-functional teams to ensure optimal data structures … that support business intelligence, analytics, and operational requirements. This role is creating, assuring, and overseeing the implementation of data models within analytical and real-time streaming domains. What you'll be doing: Develop conceptual, logical, and physical data models to support data analytics, streaming and data products implementation. Define and maintain data architecture standards, principles More ❯

DATA ARCHITECT - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ARCHITECT WITH ENHANCED DV CLEARANCE Permanent job opportunity for a Data Architect Leading National Security SME Salary up to £100,000 + Bonus London based organisation in an easily accessible location To apply please call or email WHO WE … ARE? We are recruiting multiple a Data Architect to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold enhanced DV Security Clearance. WHAT WILL THE DATA ARCHITECT BE DOING? You will be joining a leading SME who is working hard to support National Security projects within UK Govt. Departments … in London. As part of a team, you will be responsible for designing and implementing Data Solutions in Mission-Critical areas. WE NEED THE DATA ARCHITECT TO HAVE.... Current DV clearance - Enhanced Good at understanding complexity and abstracting that into a form that is consumable for a non-technical audience. Experience of achieving data interoperability between More ❯

Data Scientist - skills in statistics, physics, mathematics, Computer Science, Engineering, Data Mining, Big Data (Hadoop, Hive, MapReduce) This is an exceptional opportunity to work as a Data Scientist within a global analytics team, utilizing various big data technologies to develop complex behavioral models, analyze customer uptake of products, and foster new product innovation. … and reviewing large datasets through advanced quantitative and statistical techniques. Designing, building, and utilizing consumer behavioral forecasting models across different business sectors to maximize opportunities. Leading initiatives to enhance data accuracy, availability, granularity, and coverage. Developing analytics strategies to improve customer and product strategies. Designing better data analysis processes for future use. Proactively deriving actionable insights from large … statistical techniques. Analyzing customer behavior patterns to optimize product performance and customer experience. Building complex behavior forecasting models to identify links between behavior and new opportunities. Manipulating high-level data and presenting findings clearly to senior stakeholders. Supporting the development of analytics strategies to enhance product plans and customer engagement. Ideal candidates are talented scientists with exceptional data More ❯

enjoying your free time, we can't wait to meet you and build the future of health and well-being together. Description de la fonction As a Team Lead Data Engineer , you will be responsible for providing leadership and guidance to the data engineering team, overseeing the management and optimization of Partenamut's core data infrastructure, supporting … the implementation of large-scale Big Data projects, and ensuring efficient data processing and retrieval on a daily basis. On a daily basis : Leadership and Team Enablement : You will provide leadership and guidance to the data engineering team, fostering a culture of continuous improvement and collaboration. Data Infrastructure Management : You will oversee the management and … optimization of Partenamut's core data infrastructure, ensuring high performance and reliability. Project Implementation : You will support the implementation of large-scale Big Data projects, including the development and maintenance of data pipelines. Performance Optimization : You will support the data team with design and performance optimization, ensuring efficient data processing and retrieval. Data More ❯

Senior Data Engineer - (Azure/Databricks) page is loaded Senior Data Engineer - (Azure/Databricks) Apply locations London - Scalpel time type Full time posted on Posted 7 Days Ago job requisition id REQ05851 This is your opportunity to join AXIS Capital - a trusted global provider of specialty lines insurance and reinsurance. We stand apart for our outstanding client … status, civil union status, family or parental status, or any other characteristic protected by law. Accommodation is available upon request for candidates taking part in the selection process. Senior Data Engineer (Azure/Databricks Job Family Grouping: Chief Underwriting Officer Job Family: Data & Analytics Location: London How does this role contribute to our collective success? The Data & Analytics department transforms raw data into actionable insights to drive informed decision-making and optimize business operations. The Senior Azure Data Engineer will support these goals by designing, implementing, and managing scalable data solutions on the Azure platform, ensuring efficient data processing, storage, and retrieval. You will play a key role in modernizing our data More ❯

Tasty, Seasoned and HuffPost UK. The additional brands echo the existing business ethos and allow for increased audiences and a further strategic diversification of revenue streams. About You A data engineer with advanced knowledge of SQL and hands-on experience with both relational and non-relational databases, supporting data needs in fast-paced, content-driven environments. Experience in … designing and maintaining scalable data pipelines and architectures, ideally integrating data from web analytics, content management systems (CMS), subscription platforms, ad tech, and social media. Ability to automate and optimise data workflows, using modern ETL/ELT tools (e.g., Airflow, dbt, Apache Spark) to ensure timely and reliable delivery of data. Experience building robust data models … and reporting layers to support performance dashboards, user engagement analytics, ad revenue tracking, and A/B testing frameworks. Skilled in cloud-based data platforms and infrastructure (e.g., AWS, GCP), ensuring scalability and security for large volumes of streaming and batch data. Had exposure to data warehouses such as BigQuery or Snowflake. Adept in Python and/or More ❯

Tasty, Seasoned and HuffPost UK. The additional brands echo the existing business ethos and allow for increased audiences and a further strategic diversification of revenue streams. About You A data engineer with advanced knowledge of SQL and hands-on experience with both relational and non-relational databases, supporting data needs in fast-paced, content-driven environments. Experience in … designing and maintaining scalable data pipelines and architectures, ideally integrating data from web analytics, content management systems (CMS), subscription platforms, ad tech, and social media. Ability to automate and optimise data workflows, using modern ETL/ELT tools (e.g., Airflow, dbt, Apache Spark) to ensure timely and reliable delivery of data. Experience building robust data models … and reporting layers to support performance dashboards, user engagement analytics, ad revenue tracking, and A/B testing frameworks. Skilled in cloud-based data platforms and infrastructure (e.g., AWS, GCP), ensuring scalability and security for large volumes of streaming and batch data. Had exposure to data warehouses such as BigQuery or Snowflake. Adept in Python and/or More ❯

ten offices distributed across Europe and the US. In 2020, Pipedrive received a majority investment from Vista Equity Partners, a global investment firm that invests exclusively in enterprise software, data and technology-enabled businesses, making Pipedrive the fifth unicorn from Estonia. We're looking for an enterprise data architect to set the strategy for Pipedrive's data … the target state.In this role, you'll be an integral member of the enterprise architecture team and will be responsible for the design and implementation of the enterprise wide data strategy, ensuring the strategy supports the current and future business needs. You'll apply your knowledge of good architecture practice, architecture documentation and data technologies to comprehensively capture … Pipedrives current state holistic data architecture and oversee target state design and implementation. The role will involve collaborating with Business,Technology, engineering and internal and external IT stakeholders at all levels to ensure the enterprise data strategy and associated implementation is adding value to the business. If this sounds like something for you, get in touch, we'd More ❯

Big Data Scientist ?" Docklands London Our Client an international organisation is looking to recruit a Big Data Expert with 2 to 5 years expertise as a Big Data Scientist. You will have Natural Language Processing (NLP) knowledge and experience and understand and analyse large data sets to discover new insights. Working in a … multi-disciplinary team within a highly technical and complex environment. Well versed in scalable data mining and machine learning techniques (using computers to improve as well as develop algorithms)Kernel Methods, Deep Learning, Statistical Relational Learning, Ensemble Methods Model using advanced statistical/mathematical models, predict and segment data to hypothesize/evolve uses cases to monetize data and generate other business value. Translate business needs to technical requirements and implementation. Experience of Big Data technologies/Big Data Analytics. C++, Java, Python, Shell Script R, Matlab, SAS Enterprise Miner Elastic search and understanding of Hadoop ecosystem Experience working with large data sets, experience working with distributed computing tools like Map/ More ❯

Report to Associate Director/Director of Data The Aztec Group is seeking a highly skilled and experienced Data Platform Architect to join our team. This role is pivotal in designing and evolving our data platform to ensure it meets the strategic needs of our business and clients. The ideal candidate will possess extensive experience with Azure … Data Platform technologies and a solid understanding of our industry. As a Data Platform Architect at Aztec Group, you will play a crucial role in shaping the future of our data infrastructure. Your responsibilities will encompass a wide range of tasks, from strategic planning and architecture design to hands-on implementation and optimisation. You will collaborate closely … with the Director of Data to align our data platform initiatives with the overall business strategy, ensuring that our data solutions are robust, scalable, and capable of meeting the evolving needs of the organisation. In addition to technical expertise, this role requires strong leadership skills. You will provide guidance and mentorship to the data engineering team More ❯

Big Data Subject Manager Expert (SME) Northern, VA area Full-Time On-site Position Contingent Upon Award Join Synertex LLC and bring your expertise to a mission that matters. We're looking for a Big Data Subject Matter Expert (SME) with a background in advanced analytics, machine learning, and multi-cloud architectures to support critical government … and intelligence initiatives. If you're passionate about solving complex data challenges at scale and thrive in a high-impact, technically rigorous, and innovation-driven role-this opportunity is for you. RESPONSIBILITIES Design and optimize big data frameworks for use across multi-cloud environments Apply machine learning models to support mission-focused data analysis and automation … Build scalable analytics solutions for structured and unstructured data sets Provide strategic input on data architecture, governance, and security Collaborate with engineering, analytics, and mission teams to translate requirements into solutions Assess new technologies and tools to enhance enterprise data capabilities Support integration of data sources across cloud-native and on-premises systems REQUIREMENTS TS/ More ❯

and HuffPost UK. The additional brands echo the existing business ethos and allow for increased audiences and a further strategic diversification of revenue streams. About You An experienced Lead Data Architect & Engineer who is a positive, collaborative, proactive, self-driven professional with a passion for building scalable data solutions. Confident working across teams, and comfortable managing multiple stakeholders. … An innovative and systems-focused mindset, with a proven track record of designing infrastructure that supports both immediate business needs and long-term growth. An accomplished Lead Data Engineer with advanced knowledge of SQL and hands-on experience with both relational and non-relational databases, supporting data needs in fast-paced, content-driven environments. Strong expertise in designing … and maintaining scalable data pipelines and architectures—integrating data from web analytics, content management systems (CMS), subscription platforms, ad tech, and social media. Proven ability to automate and optimise data workflows, using modern ETL/ELT tools (e.g., Airflow, dbt, Apache Spark) to ensure timely and reliable delivery of data. Experience building robust data models and More ❯

and HuffPost UK. The additional brands echo the existing business ethos and allow for increased audiences and a further strategic diversification of revenue streams. About You An experienced Lead Data Architect & Engineer who is a positive, collaborative, proactive, self-driven professional with a passion for building scalable data solutions. Confident working across teams, and comfortable managing multiple stakeholders. … An innovative and systems-focused mindset, with a proven track record of designing infrastructure that supports both immediate business needs and long-term growth. An accomplished Lead Data Engineer with advanced knowledge of SQL and hands-on experience with both relational and non-relational databases, supporting data needs in fast-paced, content-driven environments. Strong expertise in designing … and maintaining scalable data pipelines and architectures—integrating data from web analytics, content management systems (CMS), subscription platforms, ad tech, and social media. Proven ability to automate and optimise data workflows, using modern ETL/ELT tools (e.g., Airflow, dbt, Apache Spark) to ensure timely and reliable delivery of data. Experience building robust data models and More ❯

benefits including a fresh perspective on workplace flexibility. Position Purpose: This role will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth … flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and Cleaning: Acquiring data More ❯

benefits including a fresh perspective on workplace flexibility. Position Purpose: This role will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth … flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and Cleaning: Acquiring data More ❯

benefits including a fresh perspective on workplace flexibility. Position Purpose: This role will support the Threat Infrastructure Security tools in the Centene environment. This role's focus will be Data engineering/science for a Security Data Lake and automation projects. This role includes: develop strategy, execute design and implement efficient data pipelines to ensure a smooth … flow of information into the Security Data Lake. Data Storage and Management: Store and manage the data the ingested data. This involves optimizing data schemas and ensuring data quality and integrity. ETL (Extract, Transform, Load) Processes: Design ETL pipelines to transform raw data into a format suitable for analysis. This involves data cleansing … aggregation, and enrichment, ensuring the data is usable for data scientists and analysts. Code Review and Mentorship: Spend time reviewing code submissions from team members, providing feedback, and mentoring junior developers or team members on best practices and design patterns. Operational support: Perform operational work including troubleshooting and On-call rotation. Data Collection and Cleaning: Acquiring data More ❯