401 to 425 of 469 Apache Spark Jobs in England

in Scala, Python and/or Java. Strong experience with SQL, including querying, optimizing, and managing databases. Experience with data processing platforms such as Spark, Hadoop. Demonstrated experience with GCP services such as DataProc, BigQuery, GCS, IAM, and others, and/or their AWS equivalents. Work well as an … implement elegant solutions for them. Are a data enthusiast who wants to be surrounded by brilliant teammates and huge challenges. Bonus Points: Experience with Apache Airflow, including designing, managing, and troubleshooting DAGs and data pipelines. Experience with CI/CD pipelines and tools like Jenkins, including automating the process More ❯

strongly preferred; other languages include Java, Scala, TypeScript, C++, C#). Experience using big data technologies in cloud environments to build data pipelines (e.g. Spark, EMR, Lambda, etc.). Excellent communication, organization, and prioritization skills, with a strong ability to deliver results within tight timelines. Passionate about working with … to ensure secure and efficient data operations that support business growth and strategic objectives. Writing code - lots of it! We use Python, Java, TypeScript, Spark, and SQL, welcoming engineers from diverse programming backgrounds who are passionate about building robust data solutions. Design, architect, and implement scalable, maintainable data pipelines More ❯

to ensure secure and efficient data operations that support business growth and strategic objectives. Writing code - lots of it! We use Python, Java, TypeScript, Spark, and SQL, welcoming engineers from diverse programming backgrounds who are passionate about building robust data solutions. Design, architect, and implement scalable, maintainable data pipelines … preferred with other languages including Java, Scala, TypeScript, C++, C#). Experience using big data technologies in cloud environments to build data pipelines (e.g. Spark, EMR, Lambda etc.). Excellent communication, organisation and prioritisation skills, and have a strong ability to deliver results within tight timelines. Passionate to work More ❯

have experience architecting data pipelines and are self-sufficient in getting the data you need to build and evaluate models, using tools like Dataflow, Apache Beam, or Spark. You care about agile software processes, data-driven development, reliability, and disciplined experimentation You have experience and passion for fostering collaborative … Platform is a plus Experience with building data pipelines and getting the data you need to build and evaluate your models, using tools like Apache Beam/Spark is a plus Where You'll Be This role is based in London (UK). We offer you the flexibility More ❯

Learning Engineers, BI Developers, and Data Scientists in cross-functional teams with key impacts and visions. Using your skills with SQL, data modelling, and Spark to ingest and transform high volume complex raw event data into user-friendly high impact tables. As a department, we strive to give our … use. Your typical day will look like this: Connect with the team at standup to catch up on the latest. Build data pipelines with Spark or DBT on Starburst. Use SQL to transform data into meaningful insights. Build and deploy infrastructure with Terraform. Implement DDL, DML with Iceberg. Do … a Data Engineer using SQL and Python. Previous experience with data lakes in AWS, Glue Catalog, and Athena (or equivalent). Good understanding of Spark, optimisation, and performance tuning. Capable of using popular data modelling tools to create a diagram of proposed tables to enable discussion. Good communicator and More ❯

Informatics, Information Systems, or another quantitative field. They should also have experience using the following software/tools: Experience with big data tools: Hadoop, Spark, Kafka, etc. Experience with relational SQL and NoSQL databases, including Postgres and Cassandra. Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow … etc. Experience with AWS cloud services: EC2, EMR, RDS, Redshift. Experience with stream-processing systems: Storm, Spark-Streaming, etc. Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc. Salary: 30000 per annum + benefits Apply For This Job If you would like to apply More ❯

With us, you'll do meaningful work from Day 1. Our collaborative culture is built on three core behaviors: We Play to Win, We Get Better Every Day & We Succeed Together. And we mean it - we want you to grow More ❯

The Onyx Research Data Tech organization is GSK's Research data ecosystem which has the capability to bring together, analyze, and power the exploration of data at scale. We partner with scientists across GSK to define and understand their challenges More ❯

As a Senior BI Developer, you will be at the forefront of creating Analytical Solutions and insights into a wide range of business processes throughout the organisation and playing a core role in our strategic initiatives to enhance data-driven More ❯

areas of Data Mining, Classical Machine Learning, Deep Learning, NLP and Computer Vision. Experience with Large Scale/Big Data technology, such as Hadoop, Spark, Hive, Impala, PrestoDb. Hands-on capability developing ML models using open-source frameworks in Python and R and applying them on real client use … cases. Proficient in one of the deep learning stacks such as PyTorch or Tensorflow. Working knowledge of parallelisation and async paradigms in Python, Spark, Dask, Apache Ray. An awareness and interest in economic, financial and general business concepts and terminology. Excellent written and verbal command of English. Strong More ❯

Join our dynamic team at Baseten, where we're revolutionizing AI deployment with cutting-edge inference infrastructure. Backed by premier investors such as IVP , Spark Capital , Greylock , and Conviction , we're trusted by leading enterprises and AI-driven innovators-including Descript , Bland.ai , Patreon , Writer , and Robust Intelligence -to deliver More ❯

develop scalable solutions that enhance data accessibility and efficiency across the organisation. Key Responsibilities Design, build, and maintain data pipelines using SQL, Python, and Spark . Develop and manage data warehouse and lakehouse solutions for analytics, reporting, and machine learning. Implement ETL/ELT processes using tools such as … Apache Airflow, AWS Glue, and Amazon Athena . Work with cloud-native technologies to support scalable, serverless architectures. Collaborate with data science teams to streamline feature engineering and model deployment. Ensure data governance, lineage, and compliance best practices. Mentor and support team members in data engineering best practices . … Skills & Experience Required 6+ years of experience in data engineering within large-scale digital environments. Strong programming skills in Python, SQL, and Spark (SparkSQL) . Expertise in Snowflake and modern data architectures. Experience designing and managing data pipelines, ETL, and ELT workflows . Knowledge of AWS services such as More ❯

of this team, you will be working on a plethora of services such as Glue (ETL service), Athena (interactive query service), Managed Workflows of Apache Airflow, etc. Understanding of ETL (Extract, Transform, Load) Creation of ETL Pipelines to extract and ingest data into data lake/warehouse with simple … and managing large data sets from multiple sources. Ability to read and understand Python and Scala code. Understanding of distributed computing environments. Proficient in Spark, Hive, and Presto. Experience working with Docker. Python, and shell scripting. Customer service experience/strong customer focus. Prior working experience with AWS - any … environments and excellent Linux/Unix system administrator skills. PREFERRED QUALIFICATIONS - Proficient in Hadoop Map-Reduce and its Ecosystem (Zookeeper, HBASE, HDFS, Pig, Hive, Spark, etc). - Good understanding of ETL principles and how to apply them within Hadoop. - Prior working experience with AWS - any or all of EC2 More ❯

Job Specification: Machine Learning Engineer (NLP) (Pytorch) Location: Bristol, UK (Hybrid - 2 days per week in the office) About the Role I'm looking for an NLP Engineer to join a forward-thinking company that specialises in advanced risk analytics More ❯

as a Senior Data Scientist with Machine Learning expertise Strong understanding of ML models and observability tools Proficiency in Python and SQL Experience with Spark and Apache Airflow Knowledge of ML frameworks (PyTorch, TensorFlow, Scikit-Learn) Experience with cloud platforms, preferably AWS Experience with containerization technologies Useful information More ❯

Prior Senior Data Scientist with Machine Learning experience ** Strong understanding and experience with ML models and ML observability tools ** Strong Python and SQL experience ** Spark/Apache Airflow ** ML frame work experience (PyTorch/TensorFlow/Scikit-Learn) ** Experience with cloud platforms (preferably AWS) ** Experience with containerisation technologies More ❯

continue our growth, we are recruiting a Senior Software Engineer focusing on Python for our Software Team. Our Tech Stack: AWS, Athena SQL, Athena Spark, ECS, Azure, Azure Synapse SQL & Spark, Python, Flask, Fast API, Redis, Postgres, React, Plotly, Docker. We will potentially add GCP and on-premise … of seven years experience working in Software Engineering, with at least three of these in Python. You've got two years' experience working with Spark, preferably PySpark. You've had the opportunity to work on Cloud Infrastructure, whether it be AWS, Azure or GCP. You've got experience with More ❯

design, implementation, testing, and support of next-generation features related to Dremio's Query Planner and Reflections technologies Work with open source projects like Apache Calcite and Apache Iceberg Use modular design patterns to deliver an architecture that's elegant, simple, extensible and maintainable Solve complex technical problems … such as S3, ADLS, or HDFS Experience with AWS, Azure, and Google Cloud Platform and background in large scale data processing systems (e.g., Hadoop, Spark, etc.) is a plus Ability to scope and plan solutions for big problems and mentors others on the same Interested and motivated to be … distributed query engines. Hands on experience in query processing or optimization, distributed systems, concurrency control, data replication, code generation, networking, storage systems, heap management, Apache Arrow, SQL Operators, caching techniques, and disk spilling Hands on experience with multi-threaded and asynchronous programming models More ❯

discipline. Proven experience in software engineering and development, and a strong understanding of computer systems and how they operate. Hands on Experience in Java , Spark , Scala ( or Java) Production scale hands-on Experience to write Data pipelines using Spark/any other distributed real time/batch processing. More ❯

learning systems. Strong expertise in ML/DL/LLM algorithms, model architectures, and training techniques. Proficiency in programming languages such as Python, SQL, Spark, PySpark, TensorFlow, or equivalent analytical/model-building tools. Familiarity with tools and technologies related to LLMs. Ability to work independently while also thriving … in a collaborative team environment. Experience with GenAI/LLMs projects. Familiarity with distributed data/computing tools (e.g., Hadoop, Hive, Spark, MySQL). Background in financial services, including banking or risk management. Knowledge of capital markets and financial instruments, along with modelling expertise. If you are a forward More ❯

models using SQL, Python, and R. Build interactive dashboards and data visualisations with Power BI and Tableau. Process and analyse large-scale datasets using Spark and Hadoop. Work with cloud platforms such as AWS and Azure to enhance data capabilities. Translate complex data insights into actionable recommendations for stakeholders. … large datasets for business impact. Strong problem-solving skills and adaptability to client challenges. Nice-to-Have: Experience with big data technologies such as Spark and Hadoop. Background in public sector, National Security, or Defence projects. Familiarity with GDPR and data privacy regulations. Existing security clearance or eligibility to More ❯

You'll Use: Languages & Tools: SQL, Python, Power BI/Tableau, XML, JavaScript Platforms & Frameworks: Azure Data Services, Microsoft Fabric (nice to have), Hadoop, Spark Reporting & Visualization: Power BI, Tableau, Business Objects Methodologies: Agile/Scrum, CI/CD pipelines What You'll Be Doing: Designing and building robust … Python, and BI platforms like Tableau or Power BI Strong background in data warehousing, data modelling, and statistical analysis Experience with distributed computing (Hadoop, Spark) and data profiling Skilled at explaining complex technical concepts to non-technical audiences Hands-on experience with Azure Data Services (or similar cloud platforms More ❯

You'll Use: Languages & Tools: SQL, Python, Power BI/Tableau, XML, JavaScript Platforms & Frameworks: Azure Data Services, Microsoft Fabric (nice to have), Hadoop, Spark Reporting & Visualization: Power BI, Tableau, Business Objects Methodologies: Agile/Scrum, CI/CD pipelines What You'll Be Doing: Designing and building robust … Python, and BI platforms like Tableau or Power BI Strong background in data warehousing, data modelling, and statistical analysis Experience with distributed computing (Hadoop, Spark) and data profiling Skilled at explaining complex technical concepts to non-technical audiences Hands-on experience with Azure Data Services (or similar cloud platforms More ❯

and implementation experience with Microsoft Fabric (preferred), along with familiarity with Azure Synapse and Databricks. Experience in core data platform technologies and methods including Spark, Delta Lake, Medallion Architecture, pipelines, etc. Experience leading medium to large-scale cloud data platform implementations, guiding teams through technical challenges and ensuring alignment … Strong knowledge of CI/CD practices for data pipelines, ensuring automated, repeatable, and scalable deployments. Familiarity with open-source data tools such as Spark, and an understanding of how they complement cloud data platforms. Experience creating and maintaining structured technical roadmaps, ensuring successful delivery and future scalability of More ❯

and implementation experience with Microsoft Fabric (preferred), along with familiarity with Azure Synapse and Databricks. Experience in core data platform technologies and methods including Spark, Delta Lake, Medallion Architecture, pipelines, etc. Experience leading medium to large-scale cloud data platform implementations, guiding teams through technical challenges and ensuring alignment … Strong knowledge of CI/CD practices for data pipelines, ensuring automated, repeatable, and scalable deployments. Familiarity with open-source data tools such as Spark, and an understanding of how they complement cloud data platforms. Experience creating and maintaining structured technical roadmaps, ensuring successful delivery and future scalability of More ❯