176 to 197 of 197 Apache Spark Jobs in the UK excluding London

or Python development. Experience with tools like Terraform for provisioning AWS cloud services. Knowledge of AWS Glue, AWS Athena, and AWS S3. Understanding of Apache Parquet and open table formats such as Delta, Iceberg, and Hudi. Experience with Test Driven Development using JUnit, Mojito, or similar tools. Extensive knowledge More ❯

Job Specification: Machine Learning Engineer (NLP) (Pytorch) Location: Bristol, UK (Hybrid - 2 days per week in the office) About the Role I'm looking for an NLP Engineer to join a forward-thinking company that specialises in advanced risk analytics More ❯

You'll Use: Languages & Tools: SQL, Python, Power BI/Tableau, XML, JavaScript Platforms & Frameworks: Azure Data Services, Microsoft Fabric (nice to have), Hadoop, Spark Reporting & Visualization: Power BI, Tableau, Business Objects Methodologies: Agile/Scrum, CI/CD pipelines What You'll Be Doing: Designing and building robust … Python, and BI platforms like Tableau or Power BI Strong background in data warehousing, data modelling, and statistical analysis Experience with distributed computing (Hadoop, Spark) and data profiling Skilled at explaining complex technical concepts to non-technical audiences Hands-on experience with Azure Data Services (or similar cloud platforms More ❯

and implementation experience with Microsoft Fabric (preferred), along with familiarity with Azure Synapse and Databricks. Experience in core data platform technologies and methods including Spark, Delta Lake, Medallion Architecture, pipelines, etc. Experience leading medium to large-scale cloud data platform implementations, guiding teams through technical challenges and ensuring alignment … Strong knowledge of CI/CD practices for data pipelines, ensuring automated, repeatable, and scalable deployments. Familiarity with open-source data tools such as Spark, and an understanding of how they complement cloud data platforms. Experience creating and maintaining structured technical roadmaps, ensuring successful delivery and future scalability of More ❯

years in software engineering, with 3+ years in API-backed ML deployment. Strong programming language skills in Python. Significant experience with SQL (e.g., RDBMS, Spark, Presto, or BigQuery). Experience with machine learning, optimization, and data manipulation tools (e.g., scikit-learn, XGBoost, cvxpy, Pandas, Spark, or PyTorch). More ❯

Principal Data Engineer, Consulting Bristol Based You must be eligible for SC Clearance Role Overview The Principal Data Engineer will be responsible for designing and implementing cloud-based data solutions using a range of AWS services. This role involves working More ❯

Principal Data Engineer, Consulting Leeds Based You must be eligible for SC Clearance Role Overview The Principal Data Engineer will be responsible for designing and implementing cloud-based data solutions using a range of AWS services. This role involves working More ❯

Data Architect Location: Leeds/Halifax( Hybrid) Job Type: Contract Job description: GCP, Data Products, Data Mesh, ETL, EDW Composer, Big Query, DataProc, DBT Spark, Hive, Kafka, Pub-Sub, Jira, GCP Dataflow, BigTable, Python, Kafka, Cloud DataProc, Cloud Data Flow, Cloud Data Fusion, GCS, Cloud Pub/Sub, Cloud … functions, BigTable, Python, Scala, Java, .NET, ANSI SQL, Spark, Airflow, ShellScripts, Control-M, Git, CI & CD, HDFS, Unix File System, RDBMS, Azure Devops, Harness More about the role: Able to define Data Product Definition, Architecture and Roadmap. Define Target Model backlog in collaboration with client stakeholders. Lead deliver a More ❯

in Terraform, Kubernetes, Shell/Powershell scripting, CI/CD pipelines (GitLab, Jenkins), Azure DevOps, IaC, and experience with big data platforms like Cloudera, Spark, and Azure Data Factory/DataBricks. Key Responsibilities: Implement and maintain Infrastructure as Code (IaC) using Terraform, Shell/Powershell scripting, and CI/… teams to design the overall solution architecture for end-to-end data flows. Utilize big data technologies such as Cloudera, Hue, Hive, HDFS, and Spark for data processing and storage. Ensure smooth data management for marketing consent and master data management (MDM) systems. Key Skills and Technologies: Terraform : Essential … streamlined development workflows. Azure Data Factory/DataBricks : Experience with these services is a plus for handling complex data processes. Cloudera (Hue, Hive, HDFS, Spark) : Experience with these big data tools is highly desirable for data processing. Azure DevOps, Vault : Core skills for working in Azure cloud environments. Strong More ❯

to join its innovative team. This role requires hands-on experience with machine learning techniques and proficiency in data manipulation libraries such as Pandas, Spark, and SQL. As a Data Scientist at PwC, you will work on cutting-edge projects, using data to drive strategic insights and business decisions. … e.g. Sklearn) and (Deep learning frameworks such as Pytorch and Tensorflow). Understanding of machine learning techniques. Experience with data manipulation libraries (e.g. Pandas, Spark, SQL). Git for version control. Cloud experience (we use Azure/GCP/AWS). Skills we'd also like to hear about More ❯

to join its innovative team. This role requires hands-on experience with machine learning techniques and proficiency in data manipulation libraries such as Pandas, Spark, and SQL. As a Data Scientist at PwC, you will work on cutting-edge projects, using data to drive strategic insights and business decisions. … e.g. Sklearn) and (Deep learning frameworks such as Pytorch and Tensorflow). Understanding of machine learning techniques. Experience with data manipulation libraries (e.g. Pandas, Spark, SQL). Git for version control. Cloud experience (we use Azure/GCP/AWS). Skills we'd also like to hear about More ❯

to join its innovative team. This role requires hands-on experience with machine learning techniques and proficiency in data manipulation libraries such as Pandas, Spark, and SQL. As a Data Scientist at PwC, you will work on cutting-edge projects, using data to drive strategic insights and business decisions. … e.g. Sklearn) and (Deep learning frameworks such as Pytorch and Tensorflow). Understanding of machine learning techniques. Experience with data manipulation libraries (e.g. Pandas, Spark, SQL). Git for version control. Cloud experience (we use Azure/GCP/AWS). Skills we'd also like to hear about More ❯

Summary Yelp engineering culture is driven by our values : we're a cooperative team that values individual authenticity and encourages creative solutions to problems. All new engineers deploy working code their first week, and we strive to broaden individual impact More ❯

technical processes in areas like cloud, AI, machine learning, or mobile platforms. Ability to solve data-oriented problems using technologies like SQL, Relational DB, Spark, NoSQL, with performance optimization. Preferred qualifications, capabilities, and skills Experience with Spark performance tuning on large datasets. Experience delivering production changes using Scala More ❯

Experience in patents or publications at top-tier peer-reviewed conferences or journals. PREFERRED QUALIFICATIONS Experience with modeling tools such as R, scikit-learn, Spark MLLib, MxNet, Tensorflow, numpy, scipy etc. Experience with large scale distributed systems such as Hadoop, Spark etc. Amazon is an equal opportunities employer. More ❯

neural deep learning methods and machine learning - Experience with prompting techniques for LLMs PREFERRED QUALIFICATIONS - Experience with modeling tools such as R, scikit-learn, Spark MLLib, MxNet, Tensorflow, numpy, scipy etc. - Experience with large scale distributed systems such as Hadoop, Spark etc. - PhD in math/statistics/ More ❯

Python or related language - Experience with neural deep learning methods and machine learning PREFERRED QUALIFICATIONS - Experience with modeling tools such as R, scikit-learn, Spark MLLib, MxNet, Tensorflow, numpy, scipy etc. - Experience with large scale distributed systems such as Hadoop, Spark etc. - Master's degree in math/ More ❯

Responsibilities: Analyze, design, develop, and test software solutions. Utilize Spring Boot, Spark (Big Data), and Message Bus Architecture. Work with containerization technologies like Kubernetes. Manage cloud infrastructure on AWS. Implement and maintain CI/CD pipelines using Jenkins. Qualifications: Bachelor's degree in Computer Science, Information Technology, or related … field. Proficiency in software engineering with Java and Spring, or other major programming languages. Preferred experience with Spring Boot, Spark (Big Data), containerization, AWS, and CI/CD pipelines. More ❯

AI design, build, deployment or management • Proficiency or certification in Microsoft Office tools, as well as relevant technologies such as Python, TensorFlow, Jupiter Notebook, Spark, Azure Cloud, Git, Docker and/or any other relevant technologies • Strong analytical and problem-solving skills, with the ability to work on complex … AI design, build, deployment or management • Proficiency or certification in Microsoft Office tools, as well as relevant technologies such as Python, TensorFlow, Jupiter Notebook, Spark, Azure Cloud, Git, Docker and/or any other relevant technologies • Strong analytical and problem-solving skills, with the ability to work on complex More ❯

every one of our accomplishments —no matter how big or small —can be traced back to an idea’s single spark. It’s that spark —that inner drive —that sets our people apart from our competitors. It enables us not just to pull off game-changing feat after game … want you to find your spark. Because that’s what drives you to be better, be more and ultimately, be more fulfilled. Job title: Apache Hadoop Engineer Work model: Hybrid Location: London, UK Mode of Job: Fulltime/contract Job description: The Apache Hadoop project requires up to … designing and building platforms and supporting applications both in cloud environments and on-premises. These resources are expected to be open-source contributors to Apache projects, have an in-depth understanding of the code behind the Apache ecosystem, and be capable of identifying and fixing complex issues during More ❯

every one of our accomplishments —no matter how big or small —can be traced back to an idea’s single spark. It’s that spark —that inner drive —that sets our people apart from our competitors. It enables us not just to pull off game-changing feat after game … want you to find your spark. Because that’s what drives you to be better, be more and ultimately, be more fulfilled. Job title: Apache Hadoop Administrator Work model: Hybrid Location: London, UK Mode of Job: Fulltime/contract Job description: The Apache Hadoop project requires up to … designing and building platforms and supporting applications both in cloud environments and on-premises. These resources are expected to be open-source contributors to Apache projects, have an in-depth understanding of the code behind the Apache ecosystem, and be capable of identifying and fixing complex issues during More ❯

My leading Global Consultancy client are looking for a Lead Data Architect to help shape their strategic data architecture, ensuring alignment with business goals, and driving innovation in investment data infrastructure. You'll work in the Investment Management space on More ❯