51 to 75 of 124 Apache Spark Jobs in the North of England

work as part of a client delivery team, working to the highest technical standards. What will you need to do it? Experience in prominent languages such as Python, Scala, Spark, SQL. Experience working with any database technologies from an application programming perspective - Oracle, MySQL, Mongo DB etc. Experience with the design, build and maintenance of data pipelines and infrastructure More ❯

learn, pandas, R, Weka; excellence in more than one of these is highly desirable Good understanding of SQL and NoSQL (plus) database technologies; understanding of big data technologies: Hadoop, Spark (plus) Good knowledge of statistics: hypothesis testing, confidence intervals and A/B tests Ability to demonstrate good understanding of statistical models/machine learning algorithms Why Join Us More ❯

learn, pandas, R, Weka; excellence in more than one of these is highly desirable Good understanding of SQL and NoSQL (plus) database technologies; understanding of big data technologies: Hadoop, Spark (plus) Good knowledge of statistics: hypothesis testing, confidence intervals and A/B tests Ability to demonstrate good understanding of statistical models/machine learning algorithms Why Join Us More ❯

Senior Data Engineer/Data Analytics Engineer - Full Remote Working from anywhere in the UK SQL+Python+ETL+ Apache Airflow Our client is a global leading and fast growing high tech company: -Over 6,500 employees across 20+ offices; -300 Million+ active users on some of the platforms they developed; -Cutting edge AR and VR technologies, 3D printing, etc. They are … FinTech team! You will develop scalable data pipelines, ensure data quality, and support business decision-making with high-quality datasets. -Work across technology stack: SQL, Python, ETL, Big Query, Spark, Hadoop, Git, Apache Airflow, Data Architecture, Data Warehousing -Design and develop scalable ETL pipelines to automate data processes and optimize delivery -Implement and manage data warehousing solutions, ensuring … data integrity through rigorous testing and validation -Lead, plan and execute workflow migration and data orchestration using Apache Airflow -Focus on data engineering and data analytics Requirements: -5+ years of experience in SQL -5+ years of development in Python -MUST have strong experience in Apache Airflow -Experience with ETL tools, data architecture, and data warehousing solutions More ❯

Senior Data Engineer/Data Analytics Engineer - Full Remote Working from anywhere in the UK SQL+Python+ETL+ Apache Airflow Our client is a global leading and fast growing high tech company: -Over 6,500 employees across 20+ offices; -300 Million+ active users on some of the platforms they developed; -Cutting edge AR and VR technologies, 3D printing, etc. They are … FinTech team! You will develop scalable data pipelines, ensure data quality, and support business decision-making with high-quality datasets. -Work across technology stack: SQL, Python, ETL, Big Query, Spark, Hadoop, Git, Apache Airflow, Data Architecture, Data Warehousing -Design and develop scalable ETL pipelines to automate data processes and optimize delivery -Implement and manage data warehousing solutions, ensuring … data integrity through rigorous testing and validation -Lead, plan and execute workflow migration and data orchestration using Apache Airflow -Focus on data engineering and data analytics Requirements: -5+ years of experience in SQL -5+ years of development in Python -MUST have strong experience in Apache Airflow -Experience with ETL tools, data architecture, and data warehousing solutions More ❯

Senior Data Engineer/Data Analytics Engineer - Full Remote Working from anywhere in the UK SQL+Python+ETL+ Apache Airflow Our client is a global leading and fast growing high tech company: -Over 6,500 employees across 20+ offices; -300 Million+ active users on some of the platforms they developed; -Cutting edge AR and VR technologies, 3D printing, etc. They are … FinTech team! You will develop scalable data pipelines, ensure data quality, and support business decision-making with high-quality datasets. -Work across technology stack: SQL, Python, ETL, Big Query, Spark, Hadoop, Git, Apache Airflow, Data Architecture, Data Warehousing -Design and develop scalable ETL pipelines to automate data processes and optimize delivery -Implement and manage data warehousing solutions, ensuring … data integrity through rigorous testing and validation -Lead, plan and execute workflow migration and data orchestration using Apache Airflow -Focus on data engineering and data analytics Requirements: -5+ years of experience in SQL -5+ years of development in Python -MUST have strong experience in Apache Airflow -Experience with ETL tools, data architecture, and data warehousing solutions More ❯

Platform. You're really awesome at: Object oriented programming (Java) Data modelling using any database technologies ETL processes (ETLs are oldschool, we transfer in memory now) and experience with Apache Spark or Apache NiFi Applied understanding of CI\CD in change management Dockerised applications Used distributed version control systems Excellent team player Meticulous and passionate about your More ❯

Proven desire to expand your cloud/platform engineering capabilities Experience working with Big Data Experience of data storage technologies: Delta Lake, Iceberg, Hudi Proven knowledge and understanding of Apache Spark, Databricks or Hadoop Ability to take business requirements and translate these into tech specifications Competence in evaluating and selecting development tools and technologies Sound like the role More ❯

computer science, Engineering, Mathematics, or related field. - Proven experience (5+ years) in developing and deploying data engineering pipelines and products - Strong proficiency in Python - Experienced in Hadoop, Kafka or Spark - Experience leading/mentoring junior team members - Strong communication and interpersonal skills, with the ability to effectively communicate complex technical concepts to both technical and non-technical stakeholders. Operating More ❯

and emphasis on work-life balance Responsibilities: Lead client delivery, ensuring high standards Bring experience in cloud data engineering and contribute to team solutions Requirements: Experience with Python, Scala, Spark, SQL Knowledge of database technologies (Oracle, MySQL, MongoDB, etc.) Design, build, and maintain data pipelines and infrastructure Understanding of data security and system architecture Experience with code review standards More ❯

performance databases, including PostgreSQL, ClickHouse, Cassandra, and Redis. In-depth knowledge of ETL/ELT pipelines, data transformation, and storage optimization. Skilled in working with big data frameworks like Spark, Flink, and Druid. Hands-on experience with both bare metal and AWS environments. Strong programming skills in Python, Java, and other relevant languages. Proficiency in containerization technologies (Docker, Kubernetes More ❯

ideas or examples of coding challenges or competitions. Highly desirable skills: Familiarity with Agile practices in a collaborative team environment. Exposure to big data tools, such as Hadoop and Spark for handling large-scale datasets. Experience with cloud platforms like Microsoft Azure. Benefits Comprehensive, payments industry training by in-house and industry experts. Excellent performance-based earning opportunity, including More ❯

learn, pandas, R, Weka; excellence in more than one of these is highly desirable Good understanding of SQL and NoSQL (plus) database technologies; understanding of big data technologies: Hadoop, Spark (plus) Good knowledge of statistics: hypothesis testing, confidence intervals and A/B tests Ability to demonstrate good understanding of statistical models/machine learning algorithms Why Join Us More ❯

learn, pandas, R, Weka; excellence in more than one of these is highly desirable Good understanding of SQL and NoSQL (plus) database technologies; understanding of big data technologies: Hadoop, Spark (plus) Good knowledge of statistics: hypothesis testing, confidence intervals and A/B tests Ability to demonstrate good understanding of statistical models/machine learning algorithms Why Join Us More ❯

unfamiliar environment. Meeting business requirements to agreed timetables while leading multiple work streams with limited oversight. Expert knowledge in R and/or Python, and how they work with Spark, to deliver critical data science and analytical capabilities in big data platforms. High proficiency in analysing big data with cloud services (e.g. Microsoft Azure Services, Databricks). Expertise in More ❯

You're really awesome at: Object-oriented programming (Java) Data modeling using various database technologies ETL processes (transferring data in-memory, moving away from traditional ETLs) and experience with Apache Spark or Apache NiFi Applied understanding of CI/CD in change management Dockerized applications Using distributed version control systems Being an excellent team player Meticulous and More ❯

OpenShift, MicroK8s; • Infrastructure as Code (IaC), automation & configuration management; • Ansible (plus Puppet, Saltstack), Terraform, CloudFormation; • NodeJS, REACT/MaterialUI (plus Angular), Python, JavaScript; • Big data processing and analysis, e.g. Apache Hadoop (CDH), Apache Spark; • RedHat Enterprise Linux, CentOS, Debian or Ubuntu. • Java 8, Spring framework (preferably Spring boot), AMQP - RabbitMQ, • Open source technologies; • Experience of Agile software More ❯

with a focus on delivering and operating large scale data processing systems. Has successfully led data platform initiatives. A good understanding of data processing technologies and tools such as Apache Spark, Data Lake, Data Warehousing and SQL Databases. Proficiency in programming languages such as Python and CICD techniques to efficiently deliver change in a consistent, controlled, and high More ❯

They’re Looking For: Experience in a data-focused role, with a strong passion for working with data and delivering value to stakeholders. Strong proficiency in SQL, Python, and Apache Spark , with hands-on experience using these technologies in a production environment. Experience with Databricks and Microsoft Azure is highly desirable. Financial Services experience is a plus but More ❯

background and relevant certifications. Skills: Strong foundation in statistics and programming (R/Python). Experience with data preparation, visualisation, and model building. Knowledge of big data platforms (Hadoop, Spark) and SQL/NoSQL databases. Experience: 3+ years of experience as a Data Scientist or in a related role. Typical Responsibilities: Develop and maintain data products. Data Engineering teams … of how big data is used, the big data ecosystem, and its major components. The data scientist must also demonstrate expertise with big data platforms, such as Hadoop and Spark, and master SQL and NoSQL. Leadership and professional development: Data scientists must be good problem solvers. They must understand the opportunity before implementing the solution, work in a rigorous More ❯

standards and contribute to solution development. Requirements Expertise in data engineering, analytics, architecture, or security using at least one cloud platform (AWS, Azure, GCP). Proficiency in Python, Scala, Spark, SQL. Experience with database technologies like Oracle, MySQL, MongoDB from an application development perspective. Leadership in designing, building, and maintaining data pipelines and infrastructure. Strong problem-solving skills with More ❯

your ability to solve problems with innovative ideas or coding challenges. Familiarity with Agile practices in a collaborative team setting. Exposure to big data tools, such as Hadoop and Spark, for managing large-scale datasets. Experience with cloud platforms like Microsoft Azure. Why Join? They have created a super collaborative culture offering a great balance of impact, ownership, support More ❯

Lambda) . Strong background in data architecture , including data modeling, warehousing, real-time and batch processing, and big data frameworks. Proficiency with modern data tools and technologies such as Spark, Databricks, Kafka, or Snowflake (bonus). Knowledge of cloud security, networking, and cost optimization as it relates to data platforms. Experience in total cost of ownership estimation and managing More ❯

Lambda) . Strong background in data architecture , including data modeling, warehousing, real-time and batch processing, and big data frameworks. Proficiency with modern data tools and technologies such as Spark, Databricks, Kafka, or Snowflake (bonus). Knowledge of cloud security, networking, and cost optimization as it relates to data platforms. Experience in total cost of ownership estimation and managing More ❯

Lambda) . Strong background in data architecture , including data modeling, warehousing, real-time and batch processing, and big data frameworks. Proficiency with modern data tools and technologies such as Spark, Databricks, Kafka, or Snowflake (bonus). Knowledge of cloud security, networking, and cost optimization as it relates to data platforms. Experience in total cost of ownership estimation and managing More ❯