101 to 125 of 125 Apache Spark Jobs in the North of England

Data Science. These are some technologies that our Data Scientists use (we don't expect applicants to have experience with all of these): Python and Databricks for Data Science, Spark, MLFlow and Airflow for ML Workflows, Google Cloud Platform for our analytics infrastructure, dbt and BigQuery for data modelling and warehousing. We are looking to grow our diverse team More ❯

Principal Data Engineer, Consulting Leeds Based You must be eligible for SC Clearance Role Overview The Principal Data Engineer will be responsible for designing and implementing cloud-based data solutions using a range of AWS services. This role involves working More ❯

Principal Data Engineer, Consulting Leeds Based You must be eligible for SC Clearance Role Overview The Principal Data Engineer will be responsible for designing and implementing cloud-based data solutions using a range of AWS services. This role involves working More ❯

on experience working on Azure Databricks. Exposure to, or certifications on MS Fabric. Strong communication skills, with the ability to translate technical terminology to non-technical stakeholders. Hands-on Apache Spark experience. What next? There are interview spots booked across the next couple of weeks, so please contact Adam Townsend on 07478213563 or adam@sr2rec.co.uk to find out More ❯

pipelines, and implementing scalable solutions that meet the evolving needs of the business. Utilise your strong background in data engineering, combined with your existing experience using SQL, Python and Apache Spark in production environments. The role will entail strong problem-solving skills, attention to detail, and the ability to work independently while collaborating closely with internal and external More ❯

pipelines, and implementing scalable solutions that meet the evolving needs of the business. Utilise your strong background in data engineering, combined with your existing experience using SQL, Python and Apache Spark in production environments. The role will entail strong problem-solving skills, attention to detail, and the ability to work independently while collaborating closely with internal and external More ❯

pipelines, and implementing scalable solutions that meet the evolving needs of the business. Utilise your strong background in data engineering, combined with your existing experience using SQL, Python and Apache Spark in production environments. The role will entail strong problem-solving skills, attention to detail, and the ability to work independently while collaborating closely with internal and external More ❯

looking for a Data Scientist to join its innovative team. This role requires hands-on experience with machine learning techniques and proficiency in data manipulation libraries such as Pandas, Spark, and SQL. As a Data Scientist at PwC, you will work on cutting-edge projects, using data to drive strategic insights and business decisions. If you have strong analytical … Machine learning frameworks and tooling e.g. Sklearn) and (Deep learning frameworks such as Pytorch and Tensorflow). Understanding of machine learning techniques. Experience with data manipulation libraries (e.g. Pandas, Spark, SQL). Git for version control. Cloud experience (we use Azure/GCP/AWS). Skills we'd also like to hear about: Evidence of modelling experience applied More ❯

looking for a Data Scientist to join its innovative team. This role requires hands-on experience with machine learning techniques and proficiency in data manipulation libraries such as Pandas, Spark, and SQL. As a Data Scientist at PwC, you will work on cutting-edge projects, using data to drive strategic insights and business decisions. If you have strong analytical … Machine learning frameworks and tooling e.g. Sklearn) and (Deep learning frameworks such as Pytorch and Tensorflow). Understanding of machine learning techniques. Experience with data manipulation libraries (e.g. Pandas, Spark, SQL). Git for version control. Cloud experience (we use Azure/GCP/AWS). Skills we'd also like to hear about: Evidence of modelling experience applied More ❯

Disaster recovery process/tools Experience in troubleshooting and problem resolution Experience in System Integration Knowledge of the following: Hadoop, Flume, Sqoop, Map Reduce, Hive/Impala, Hbase, Kafka, Spark Streaming Experience of ETL tools incorporating Big Data Shell Scripting, Python Beneficial Skills: Understanding of: LAN, WAN, VPN and SD Networks Hardware and Cabling set-up experience Experience of More ❯

Architect Location: Leeds/Halifax (Hybrid) Job Type: Contract Job Description: The ideal candidate should have experience with GCP, Data Products, Data Mesh, ETL, EDW Composer, BigQuery, DataProc, DBT, Spark, Hive, Kafka, Pub-Sub, Jira, GCP Dataflow, BigTable, Python, Scala, Java, .NET, ANSI SQL, Airflow, Shell Scripts, Control-M, Git, CI & CD, HDFS, Unix File System, RDBMS, Azure DevOps More ❯

complex software with end-to-end ownership • Python or similar (Ruby or Node) or another Functional Language • JavaScript and associated frameworks, preferably Vue, or similar • Cloud technologies • SQL (advantageous) • Spark (advantageous) • Docker/Kubernetes – advantageous ) • MongoDB, SQL, Postgres & Snowflake (advantageous) • Developing online, cloud based SaaS products. • Leading and building scalable architectures and distributed systems • Working in an agile, lean More ❯

Job Description Role: Data Architect Location: Leeds/Halifax (Hybrid) Job Type: Contract Job description: Proficiency in GCP, Data Products, Data Mesh, ETL, EDW Composer, BigQuery, DataProc, DBT, Spark, Hive, Kafka, Pub-Sub, Jira, GCP Dataflow, BigTable, Python, Scala, Java, .NET, ANSI SQL, Airflow, Shell Scripts, Control-M, Git, CI & CD, HDFS, Unix File System, RDBMS, Azure DevOps, Harness. More ❯

of market data structures and exchange connectivity Scripting abilities in Python, Bash, or similar languages Knowledge of monitoring tools and alerting frameworks Exposure to data technologies such as Kafka, Spark or Delta Lake is useful but not mandat Bachelor's degree in Computer Science, Engineering, or related technical field This role offers competitive compensation and the opportunity to work More ❯

of market data structures and exchange connectivity Scripting abilities in Python, Bash, or similar languages Knowledge of monitoring tools and alerting frameworks Exposure to data technologies such as Kafka, Spark or Delta Lake is useful but not mandat Bachelor's degree in Computer Science, Engineering, or related technical field This role offers competitive compensation and the opportunity to work More ❯

we expect from you Master's degree/PhD in Computer Science, Machine Learning, Applied Statistics, Physics, Engineering or related field Strong mathematical and statistical skills Experience with Python, Spark and SQL Experience implementing and validating a range of machine learning and optimization techniques Effective scientific communication for varied audiences Autonomy and ownership of projects Good understanding of software More ❯

or Go Kubernetes network & security policies GCP or other cloud infrastructure providers Infrastructure as code (e.g. Terraform, Ansible, Puppet) Git CI/CD experience Network security Monitoring Database administration Spark Airflow Big Data ecosystem administration and tooling FinOps What you can expect from us We won’t just meet your expectations. We’ll defy them. So you’ll enjoy More ❯

Supports Industry-leading Data Science. These Are Some Technologies That Our Data Scientists Use (we Don’t Expect You To Have Experience With All Of These) Python and Databricks Spark, MLFlow, and Airflow for ML Workflows Google Cloud Platform for our analytics infrastructure dbt and BigQuery for data modelling and warehousing Some examples of our data science work can More ❯

that help us achieve our objectives. So each team leverages the technology that fits their needs best. You'll see us working with data processing/streaming like Kinesis, Spark and Flink; application technologies like PostgreSQL, Redis & DynamoDB; and breaking things using in-house chaos principles and tools such as Gatling to drive load all deployed and hosted on More ❯

Supports Industry-leading Data Science. These Are Some Technologies That Our Data Scientists Use (we Don't Expect You To Have Experience With All Of These) Python and Databricks Spark, MLFlow, and Airflow for ML Workflows Google Cloud Platform for our analytics infrastructure dbt and BigQuery for data modelling and warehousing Some examples of our data science work can More ❯

quantitative skills. Excellent communicator, able to present data insights to diverse audiences. Passionate about sports, bookmaking, and betting, with experience in pricing/optimization and Big Data technologies (e.g. Apache Spark, AWS). What we offer Financial: Competitive salary and bonus schemes. Hybrid working: Our employees can work from home up to 80% of the time with More ❯

this link . Technologies Used Our data platform supports industry-leading Data Science tools. While experience with all these technologies is not expected, familiarity is beneficial: Python and Databricks Spark, MLFlow, Airflow Google Cloud Platform dbt and BigQuery Examples of our data science work can be found on our engineering blog . What We’re Looking For Experience delivering More ❯

to ensure high availability, resiliency, and scalability, including understanding and explaining features like KRAFT. Integrating Kafka with other data processing tools and platforms such as Kafka Streams, Kafka Connect, Spark Streaming, Schema Registry, Flink, and Beam. Collaborating with cross-functional teams to understand data requirements and design solutions that meet business needs. Implementing security measures to protect Kafka clusters … with on-premise/cloudera open source Kafka Focus on disaster recovery aspects Knowledge of Kafka resiliency and new features like KRAFT Experience with real-time technologies such as Spark Required Skills & Experience Extensive experience with Apache Kafka and real-time architecture including event-driven frameworks. Strong knowledge of Kafka Streams, Kafka Connect, Spark Streaming, Schema Registry More ❯

Our mission is to improve society's experience with software. Come join one of the fastest-growing startups, supported by best-in-class institutions like Battery Ventures, Salesforce Ventures, Spark Capital and Meritech. You will gain experience in a diverse and exciting set of technologies and clients and have a real impact on Pendo's future. Our culture is More ❯

Our mission is to improve society's experience with software. Come join one of the fastest-growing startups, supported by best-in-class institutions like Battery Ventures, Salesforce Ventures, Spark Capital and Meritech. You will gain experience in a diverse and exciting set of technologies and clients and have a real impact on Pendo's future. Our culture is More ❯