26 to 50 of 501 Permanent Big Data Jobs

Location : London, Must have SC Clearance Certificate Mode: Hybrid Salary: Competitive Overview: We are seeking a talented Data Engineer with expertise in Azure to join our team. The ideal candidate will be responsible for developing data pipelines, building and maintaining data warehouses and data lakes, implementing … data integration and transformation solutions, ensuring data quality and integrity, and optimizing data performance. Responsibilities: Proven track record in the development and management of an Azure cloud-based data & analytics platform. • Comprehensive experience in the complete data pipeline development process, encompassing data warehousing, data analytics, and ETL processes. • Profound understanding of best practices in data governance, privacy, and quality. • Exceptional skills in communication, leadership, and team management. • Capability to handle multiple tasks, meet stringent deadlines, and deliver top-notch solutions. • Solid grasp of contemporary data architecture concepts and experience in data more »

Data Engineer | ETL | Python | ML | Insuretech | £80,000 | Barnet WeDo has recently partnered with a leading Insurtech company who are currently in the market for a Data Engineer to join the business. They are looking for someone who has worked very much in a Data Engineering capacity … however, they need to have showcased prior experience of working with Data Science teams on ML Pipelines and Data Platforms and have a good understanding of modelling/practices. This extends to productionising and having a good grasp on some of the CI/CD tooling. This position … will be sat within the Data Science function within the business. The Data Engineer will have the following experience and skillset. Proficient in Microsoft Azure, Python/PySpark, and SQL. Experienced in using ETL/ELT tools like SSIS and Azure Data Factory, and knowledgeable about Big more »

Data Engineer - Tech Lead Fintech London £110,000 As a Tech Lead, you will be leading and managing a greenfield implementation for a disruptive Fintech. The data platform will be used to facilitate the launch of a new product. THE COMPANY: This company has gone through a period … the credit card space and have launched multiple successful products and are now one of the most trusted brands out there. They have several big data teams looking after their client's data for the advanced analytics team to gather insights on. They have established a robust … AWS architecture that allows the business to store and stream big data coming in from all types of sources. THE ROLE: As a Tech Lead you will be expected to be hands-on with Spark/Python, Kafka. You will be part of the design team to enhance more »

in the cloud, Colibri Digital is one of the fastest-growing Cloud Consultancies in the UK and with deep expertise in areas such as big data, data science, machine learning, and cloud computing. We are Select partners with AWS and our recent attainment of Gold competency with … Microsoft proves our excellence in evolving cloud and data technologies. Led by industry recognised technologists we are a dynamic team with a proven track record of delivering masterclass cloud solutions across all industry verticals. Find out more at https://www.colibridigital.io Job Description: As we continue to expand … are seeking a highly skilled DevOps Consultant to join our team and play a crucial role in the development and implementation of our new data technology infrastructure. You will be responsible for designing, deploying, and maintaining our cloud-based data platform, ensuring its scalability, reliability, and security. You more »

growing team. In this role, you’ll design and implement machine learning models that revolutionise renewable energy systems. Collaborate with a passionate team of data scientists, software developers, and energy experts to drive sustainable energy solutions forward. > Key Responsibilities: Create, develop, and deploy advanced machine learning models for exciting … Engage in the full software development lifecycle: plan, code, test, and deploy. > Requirements: Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, or a related field. Proven experience in building and deploying machine learning models. Strong Python skills and familiarity with libraries like TensorFlow, PyTorch … or scikit-learn. Hands-on experience with data preprocessing, feature engineering, and model evaluation. Excellent problem-solving skills and a collaborative spirit. Top-notch communication skills, able to simplify complex concepts for non-technical audiences. A genuine passion for renewable energy and sustainability. > Desirable Skills: Experience with time series more »

with a focus on C# .Net backend development. There are a range of projects including warehouse automation, customer facing websites, AWS hosted microservices and Big Data. Location/WFH: You'll join a friendly team in Oxford three days a week with flexibility to work from home the other more »

We are a team of passionate engineers committed to building the best-in-class petabyte-scale data infrastructure optimization platform that combines hardware acceleration with performance metering to enable real-time actionable insights for reducing data center costs. So far, we have raised a total of $3.5M in … CPU Compiler Engineer, you will collaborate with the founding team to improve and expand the core engine that we are building that massively accelerates Big Data pipelines. Your contributions to our core solution will directly impact data infrastructure processing 10s of petabytes every day where Xonai is … being deployed. Join us in building a cutting edge solution for the cloud to realize cost-effective data infrastructure at scale and with unparalleled flexibility. What you will do: Optimize code generation for executing JIT-compiled code on CPUs (Arm and x86 architectures). Diversify compiler optimizations based on more »

Our client, a prestigious global law firm, is seeking a highly skilled Data Engineer to join their dynamic team. This firm is renowned for its commitment to delivering exceptional legal services across various sectors. With a strong emphasis on innovation and technology, they provide a stimulating and collaborative environment … for professionals to thrive. Role Overview: As a Data Engineer, you will play a crucial role in designing, developing, and maintaining the firm's data architecture. You will work closely with various departments to ensure seamless data integration and support data-driven decision-making processes. The … candidate will have substantial experience in a professional services environment, preferably within the legal, accounting, or audit sectors. Key Responsibilities: Develop and maintain scalable data pipelines and systems. Design and implement robust data architectures and models. Collaborate with data scientists, analysts, and other stakeholders to understand data more »

Are you a C# Software Engineer that would enjoy working with Big Data, Machine Learning and AI? Would you like the freedom to work from anywhere that suits you, globally? There's a company that utilises powerful AI, LLMs and ML to optimise customer experience for high-end … ll be given plenty of flexibility in their relaxed environment and as much support and guidance as you'd like. Small team (currently) with big plans, a comprehensive benefits package (including Share options) and you're being led by an experienced management team who have previously grown and sold … of ideally 3-5 years' experience Backend development of web apps Robust, scalable and quality code (TDD) Ideally some AI, LLM, Machine Learning and Big Data experience (not essential) Agile environment working Background It would be advantageous if you have a Computer Science Degree (1st Class or more »

quality metrics (coverage analysis, complexity analysis). Experience with automotive communication protocols e.g. CAN/CAN FD/UDS. Knowledge of machine learning and big data algorithms and implementations. Duties & Responsibilities Prepare Technical Roadmap & Lead New Function Development. Prepare technical roadmap for the subject area . Develop and … Provide ongoing assessment of software design processes and optimise changes as needed. Contribute to Advanced Research. Support advanced SW development including machine learning and big data features. Support development and validation of advanced energy management algorithms, Thermal management Strategy and 4WD Torque Split Strategy. Support software platform architectures more »

Our client, a leader in Data Governance, Big Data, IoT and Cloud Migration services and solutions are currently hiring for a Senior Account Manager to to focus on winning new and growing existing public sector opportunities. Responsibilities Create and execute a territory plan and account plans to … sector. Work alongside our Bid Manager to identify opportunities on public sector frameworks. Develop relationships with key decision makers such as CFO, Heads of Data/Analytics, Chief Data Officer and use your own network to reach key decision makers. Ability to generate qualified opportunities, using your own … news, industry competition and industry specific offerings. Requirements Extensive experience in a field sales role selling consulting services in the public sector. Experience selling Data focused solutions in public sector including data management, analytics, and cloud computing solutions. Demonstrable experience of independently leading strategic sales engagements and managing more »

Oho group is partnered with the UK’s leading FinTech’s that are a award winning historical data and analytics company that solve some of the most complex and challenging problems in big data and financial markets. They offer banks, brokers, asset managers, hedge funds and global … exchange groups immediate and flexible access to the most granular order book data and advanced analytics, allowing them to accelerate research, optimise trading strategies and generate alpha at unparalleled speed and scale. They have just received their Series B funding and are looking grow their exchange data team … Role As a Software Engineer you will build and maintain data parsers in C++ that ingest market data and reference data, improving processes and reliability for managing these large datasets using the newest AWS technologies. Skills and Experience · Demonstrable knowledge of C++ · Experience of working with market more »

Software-defined storage, and CSI. CKD/CKA Certification is a plus. Experience and thorough understanding of DBaaS, PaaS, IaaS. Exposure to Splunk, Elasticsearch, BigData, and AI/ML is a plus. Good knowledge of Linux/Unix Systems. Understanding of Networking, Storage, and Security Concepts. Exposure to Public clouds more »

of Division to lead a team passionate about creating innovative technology solutions. They’re a renowned solutions provider with expertise in hardware, SaaS, and Big Data. They specialise in cutting-edge hardware and embedded software, and they’re growing fast! Job Description: As Head of Division, you’ll lead … assembly, and embedded software development in ‘C’ Test and validate products to ensure they meet high standards Create product test procedures and produce manufacturing data What We're Looking For: Experience with CAD tools for schematic capture and PCB layout Proficiency with industry-standard tools for embedded code development more »

Big Data Architect | Up to £90k Basic | London | Global Consultancy Join a global powerhouse consultancy as a Big Data Architect, leveraging your expertise in the Apache Hadoop ecosystem to drive transformative data initiatives. This role offers a platform to work on high-impact projects with … leveraging cutting-edge technology to deliver exceptional services. As part of this team, you will work on pioneering projects that shape the future of big data environments. 🔍 Role Requirements: Proven experience in architecting, designing, and deploying big data platforms and applications using the Apache Hadoop ecosystem … in hybrid and private cloud scenarios. Expertise in hybrid cloud big data platform designs and deployments, especially in AWS, Azure, or Google Cloud Platform. Extensive knowledge of Apache Hadoop ecosystem components such as HDFS, Hive, HBase, Spark, Ranger, Kafka, and Yarn. Proficiency in Kubernetes for container orchestration. Strong more »

the following office location: Cheltenham, Hereford, Poole Company Overview: Atreides helps organizations transform large and complex multi-modal datasets into information-rich, geo-spatial data subscriptions that can be used across a wide spectrum of use cases. Currently, Atreides focuses on providing defense intelligence professionals with high-fidelity data … that trust + autonomy = better results and more job satisfaction. Since we are building something new and helping unlock the power of massive-scale data to make the world safer, stronger, and more prosperous, a mission-driven mindset and entrepreneurial spirit are a must. Team Overview: We are a … passionate team of technologists, data scientists, and analysts with backgrounds in operational intelligence, law enforcement, large multinationals, and cybersecurity operations. We obsess about designing products that will change the way global companies, governments and nonprofits protect themselves from external threats and global adversaries. Position Overview: We're looking for more »

candidate will have a deep understanding of Palantir Foundry's platform and be adept at developing applications and solutions that harness the power of big data analytics. As a Palantir Foundry App Developer, you will collaborate with cross-functional teams to design, build, and deploy innovative applications that … drive business insights and operational efficiencies. Key Responsibilities: - **Application Development:** - Design, develop, and maintain applications within the Palantir Foundry platform. - Implement data-driven solutions and applications that support business needs and enhance decision-making processes. - Develop custom workflows, data pipelines, and integrations using Palantir Foundry’s tools and … APIs. - **Data Integration and Management:** - Ingest, clean, transform, and manage large datasets from various sources to support application development. - Ensure data quality, integrity, and security throughout the development lifecycle. - **User Interface and Experience:** - Create intuitive and user-friendly interfaces and visualizations for applications using Palantir Foundry. - Ensure that more »

Job Title: Data Scientist Industry: Real Estate Location: London Job Description: Our client are seeking a talented Data Scientist who is passionate about real estate and leveraging data to drive business decisions. You will play a crucial role in analysing complex data sets, designing scalable prediction … algorithms, and generating actionable insights to enhance our business operations. Responsibilities: Analyse raw real estate data: assess quality, cleanse, and structure for downstream processing. Design accurate and scalable prediction algorithms to forecast market trends and property values. Collaborate closely with the engineering team to bring analytical prototypes to production. … Generate actionable insights for business improvements based on data analysis and modelling. Qualifications: Bachelor's degree or equivalent experience in a quantitative field (Statistics, Mathematics, Computer Science, Engineering, etc.). At least 1-2 years of experience in quantitative analytics or data modelling, preferably in the real estate more »

UK Remote Budget - £120k basic, 20% bonus & benefits Ingenio is delighted to be working with a technology consultancy company specialised in supporting clients in Big Data, Data Science, Machine Learning, and Cloud Computing. Our client is looking for a Solutions Architect who will be responsible for helping … Consultant, or other similar positions focused on Databricks for a min of 2 years Must have certifications specifically with Databricks Deep technical understanding of data architectures, generative AI technologies, DevOps practices, and software development methodologies. Can demonstrate creating & designing new solutions that are tied to professional services and/ more »

toolset and enables the rapid deployment of innovation and standard methodologies across the global business About the Role We are looking for an experienced Data & Reporting Technical Lead to join the team working on our Global Business Systems (GBS) platform. You will lead data and reporting architecture and … initiatives across the GBS program, including the RX Data Lake. You will manage the engineering team throughout the development life cycle to implement functionality to cost, quality and schedule. Responsibilities Designing and developing RX's data and reporting systems which form part of our Global Business Systems platform … Producing artefacts for development teams, including technical designs, and data models, to facilitate the development of solutions to meet requirements Conveying architectural and technical information to a variety of audiences both within the IT department and in the broader business Dealing with solutions at the code level, and spending more »

SOA architecture design. * Experience with RDS like MySQL or PostgreSQL or others, and experienced with NoSQL like Redis or MongoDB or others; * Experience with BigData technologies like Hadoop eco-system is a plus. * Excellent writing, proof-reading and editing skills. Able to create documentation that can express cloud architectures using more »

Head of Data Engineering London Hybrid 6-12 month contract Day rate 700-800 inside IR35 Role Description: Head of Data Engineering Overview The Senior Head of Data Engineering is a strategic and leadership position responsible for overseeing the data engineering function across the organization. This … role requires a visionary leader with a deep understanding of data architecture , engineering best practices, and emerging technologies. The Head of Data Engineering will drive the development, implementation, and management of data infrastructure and ensure data accessibility, reliability, and security for the company's diverse needs. … Key Responsibilities Leadership and Strategy - Develop and execute the data engineering strategy aligned with the company's business objectives. - Lead, mentor, and grow a high-performing data engineering team. - Collaborate with senior management to define data needs and ensure alignment with organizational goals. Data Architecture and more »

Role: Azure Data Architect Location: Bristol, UK Type of hire: FTE Extensive experience working with large data sets with hands on technology skills to design and build robust Big Data solutions using Spark PySpark framework and Industry standard frameworks like Databricks Azure DevOps and other tools … technologies on Azure Cloud Platform Key Roles and Responsibilities Understand the requirement and analyze the source system data to come up with a high-performance Data Architecture Good to have the Retail functional Knowledge Must have Good Knowledge and Hands on experience in Python PySpark ADF and ADB … Good to have Knowledge in ADF CI CD Experience in designing architecting and implementing large scale data processing data storage data distribution systems Ability to produce high quality work products under pressure and within deadlines Strong understanding of Big Data Analytics platforms and ETL in more »

on Databricks process architect and engineering leader to drive our Databricks transformation, pipelines architecture, governance and engineering patterns. Our CDP delivers a unified Customer data model across our global CRM operations. In this role, you will be responsible for driving our Databricks migration, designing and executing a comprehensive pipeline … architecture strategy that aligns with CDP team's skillsets, business objectives and drives compliant, efficient and effective data management. RESPONSIBILITIES Drive our AWS Databricks transformation from current relational DB setup. Collaborate with our diverse teams, SQL developers/data engineers/CRM analysts, to develop, implement and maintain … sustainable, high-performance, growth-ready data-processing and data integration systems Provide best practice on CI/CD techniques with Git and Databricks Provide best practice on Databricks cluster management. Reviews and evaluates designs and project activities for compliance with privacy, architecture, security and quality guidelines and standards more »

are working with a leading Blockchain analytics platform, with a stellar leadership team and excellent backing. Seeking to hire an experienced senior level Backend & Data Engineer, with strong Python skills and backend architecture ability. The Role Working alongside a strong technical and engineering team, you will take ownership of … redeveloping the architecture of their entire backend systems, focusing on growth. Working with Python and extrapolating high volumes of data from the blockchain, you will be responsible for the overall vision, strategy and execution of the company’s Software products. You will take ownership of: Technical Leadership: Team support … r eporting to the CTO Software Development: Python focussed Data Warehousing: Kafka , SnowFlake or Clickhouse as well as PostgreSQL Architecture : Developing robust backend systems The Candidate Experienced in building out complex Backend services, along with high-throughput Data warehousing. Min 7yrs with Python Big Data & Data more »