13 of 13 Big Data Jobs in Cardiff

Senior Java Engineer's - Spark Belfast (Hybrid) Were looking for experienced Senior Java Engineer's to join an exciting data-driven project! This role involves active development (no support work) on a batch data processing platform, working across both greenfield and existing project streams. Some elements of the … work will also involve moving from Oracle to big data technologies. Key Requirements: Extensive Java Development Experience Strong knowledge of Java 11+ and modern Java frameworks Experience writing efficient, scalable, and high-performance Java applications Familiarity with multithreading, concurrency, and distributed computing Big Data & Distributed Systems … Knowledge: Strong understanding of how distributed systems function, particularly in large-scale data environments Hands-on experience with Hadoop, Apache Hive, or similar big data technologies Apache Spark Expertise (Mandatory): Experience in batch data processing using Apache Spark Writing and optimizing Spark jobs for large datasets More ❯

of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis More ❯

work with some of the biggest names across a range of thriving industries and offer fantastic growth opportunities. They are heavily investing in their data team here in Belfast - hiring from Junior right up to Lead positions, working on a hybrid basis from some of city's newest and … pension scheme Cutting-edge projects using AWS and other modern technologies What are we looking for? Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Experience performing tasks such as writing … scripts, extracting data using APIs, writing SQL queries etc. Ability to closely with other engineering teams to integrate data engineering component into production systems. Knowledge of data cleaning, wrangling, visualization and reporting, with an understanding of the best, most efficient use of associated tools and applications to More ❯

Staff Software Engineer - Data Department: Engineering Employment Type: Full Time Location: Cardiff Description is the UK's first comparison platform for car insurance. We've been helping customers since 2002 by empowering them to make better decisions around insurance and financial services. Our mission is simple: take away the … peers. Autonomy: Authority over technical strategy, decisions and implementation approach, so you can deliver using practices that align with your preferred ways of working. Data Driven: Utilise rich logs, metrics, and data to monitor and improve system performance & reliability. Culture: Enhancing a diverse engineering culture by taking part … Rotate around the business to build relationships and act as a multiplier. What we look for in you Understand, assess and effectively apply modern data architectures (dimensional model, data mesh, data lake). Experience in applying and using data observability methods effectively. Experience in modern software More ❯

Position Title: SeniorDataEngineer Department: EnterpriseSystems ReportsTo: Director, Data Analytics Supervises: N/A Classification: Full Time, Permanent JOB SUMMARY: The Senior Data Engineer is responsible for managing, expanding, and optimizing our business data platforms, supporting and working with project teams, business stakeholders and product owners to ensure … optimal data delivery, consistent data architecture and effective performance of data solutions is delivered. ESSENTIAL FUNCTIONS: Createandmaintainoptimaldata pipelinearchitecture,andmanageanEnterpriseDatawarehouse Assemblelarge,complexdatasetsthatmeetfunctional/non-functional businessrequirements. Identify, design, andimplementinternalprocessimprovements:automatingmanualprocesses, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Buildtheinfrastructurerequiredforoptimalextraction, transformation, andloadingofdatafromawide variety of data sources using SQL and Microsoft Azure big data technologies. Buildanalyticstoolsthatutilizethedatapipelinetoprovideactionableinsightsintocustomeracquisition, operational efficiency, and other key business performance metrics. WorkwithstakeholdersincludingtheIToperations,automationanddevelopmentteamstoassistwith data-related technical issues and support their data infrastructure needs. WorkaspartofaDataandBIteamtostriveforgreaterfunctionalityinourdatasystems. Participateincodereviews,proactivelyidentifyingandmitigatingpotentialissuesanddefects Managingcompetingresourcesandpriorities. Otherdutiesasassigned. NON-ESSENTIAL FUNCTIONS: Liftingandcarryinglargeequipment/boxesover5lbs Bendingandstoopingtoutilizenecessaryofficeequipment Participationinteambuildingandotheractivities QUALIFICATIONS AND More ❯

combine strategic thinking, customer-centric service design, and agile engineering practices to accelerate innovation in a tech-driven world. Why consider joining our Digital & Data community? ?? Join our Digital & Data team working alongside product, design and a wide range of other experts and cross-disciplinary teams to bring … as we are often hiring for similar roles which your background might be better suited to. Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Pythn, Scala, Spark, SQL. Perform tasks such as writing scripts … extracting data using APIs, writing SQL queries etc. Knowledge of data cleaning, wrangling, visualization and reporting, with an understanding of the best, most efficient use of associated tools and applications to complete these tasks. You'll be comfortable designing and building for the AWS cloud and will have More ❯

live race events during weekends, this role will require the ability to work a flexible schedule. The Role We are seeking a Motorsports Sportscar Data Analyst to apply data science and modeling techniques to develop and refine race strategy tools, facilitating insightful pre-race planning, split-second identification … Motorsports and GM sponsored motorsports teams to develop and support race strategy tools and provide analytic guidance. Co-develop production race strategy software with data science and IT software development. Work with teammates supporting other racing series to apply analysis techniques and modeling approaches to other series to validate … Motorsports teams compete. #LI-LP2 Additional Job Description What You’ll Need (Required Qualifications) Bachelor’s Degree in Engineering, Physics, Mathematics, Statistics, Computer Science, Data Science, or related field. 5 or more years of experience in a top-level motorsports series including NASCAR, IMSA, F1, IndyCar, WEC, or similar More ❯

10+ years of experience building large scale and low latency distributed systems Command of Java, C++ or Go/Golang Solid understanding of algorithms, data structures, performance optimization techniques, object-oriented programming, multi-threading, and real-time programming Experience with distributed caching, SQL/NO SQL, and other databases … is a plus Experience with Big Data and cloud services such as AWS/GCP is a plus Experience in advertising domain a big plus B.S. or M.S. degree in Computer Science, Engineering, or equivalent Self-motivated individual with a high level of accountability and ownership Critical … number of very talented folks can do more for less cost than a larger number of less talented teams. We're independent thinkers with big ideas who act boldly, move fast and accomplish extraordinary things through collaboration and trust. In short, at Roku you'll be part of a More ❯

Head of Performance leads the performance team and, more broadly, a community of practice, acting as the key point of contact for organisational performance data insight and coordination across DHCW and externally with key stakeholders such as Welsh Government. The role will lead on addressing complex performance issues by … of a range of enterprise performance management tools and methods across the organisation Oversee the design and development of interactive dashboards for key performance data Lead the design, development and delivery of the Performance Management Framework for the organisation, in line with agreed national and local standards. The ability … sustainability reporting frameworks and standards (e.g. Integrated Reporting, SASB Standards, IFRS Sustainability, GRI) Theoretical and specialist knowledge gained via relevant certification such as: oEnterprise Big Data Analyst (EBDA) oCertified Business Intelligence Professional (CBIP) oChartered Institute of Management Accountants (CIMA) oAgile Management Comprehensive knowledge and understanding of the NHS More ❯

platforms. Strong understanding of Microsoft Server Technology and Hyper-V clustering. Experience in one or more of the following areas: - Database Architecture - Business Intelligence - Big Data - Machine Learning - Advanced Analytics Benefits: Public Sector Pension 36 Days Annuel Leave Professional Development support If you're looking for a role … CPS Group UK. Email: (url removed) By applying to this advert you are giving CPS Group (UK) Ltd authority to hold and process your data for this specific role and any other roles we may deem suitable to you over time. We will not pass your data to More ❯

platforms. * Strong understanding of Microsoft Server Technology and Hyper-V clustering. * Experience in one or more of the following areas: - Database Architecture - Business Intelligence - Big Data - Machine Learning - Advanced Analytics Benefits: * Public Sector Pension * 36 Days Annuel Leave * Professional Development support If you're looking for a role … CPS Group UK. Email: (url removed) By applying to this advert you are giving CPS Group (UK) Ltd authority to hold and process your data for this specific role and any other roles we may deem suitable to you over time. We will not pass your data to More ❯

platforms. Strong understanding of Microsoft Server Technology and Hyper-V clustering. Experience in one or more of the following areas: Database Architecture, Business Intelligence, Big Data, Machine Learning, and Advanced Analytics. Benefits: Public Sector Pension 36 Days Annuel Leave Professional Development support If you’re looking for a More ❯

together -Top-tier clients Youll be working on high-impact projects with some of the biggest names in finance & tech If you love Java, Big Data, and solving real-world challenges, then this is your chance to make an impact while working with a fantastic, high-performance team. More ❯