226 to 250 of 297 Apache Spark Jobs in England

build and enhance our Databricks platform, ensuring it remains secure, scalable and reliable. Develop and maintain batch and real-time data pipelines using Databricks, Spark and Delta Lake. Contribute to platform architecture, engineering standards and best practices across the data estate. Collaborate with Product, Analytics and Data Science teams … improvement across the engineering team. Our ideal candidate Proven experience building and supporting scalable, production-grade data platforms. Strong hands-on expertise with Databricks, Spark, Delta Lake, Python and SQL. Good understanding of cloud-based data engineering, ideally within Azure environments. Experience working with Infrastructure as Code tools such ...

sportsbook domain data (bets, offers, rewards, digital data) into well-structured datasets for downstream consumption. Implement data transformation logic using modern tooling (e.g. dbt, Spark, SQL-based frameworks) with a focus on clarity and reliability. Contribute to streaming data pipelines (Kafka/Flink or equivalent) to support near real … data engineering or a related field. Strong SQL skills and a good understanding of data modelling principles. Experience with data transformation tools (e.g. dbt, Spark) and workflow orchestration (e.g. Airflow or similar). Familiarity with cloud-based data platforms, ideally AWS. Understanding of data pipeline design and ETL/ ...

changed how you work, not just how fast. We expect you to enjoy leveraging AI and agentic systems to operate more effectively. Tech environmentScala | Spark | Databricks | AWS | Claude | Airflow | Kubernetes | Terraform | Functional ProgrammingYou will thrive here if youEnjoy end-to-end ownership, from writing the code to architecture design … Python. Ability to design, build, and maintain distributed data systems in a cloud-based environment. Hands-on experience with big data frameworks such as Spark or Databricks. Knowledge of cloud infrastructure (AWS, GCP, or Azure).Judgement to balance scalability, performance, and maintainability. Experience with data modelling and workflow orchestration. ...

Python is required . Proficiency in at least one object-oriented language. Experience with big data technologies such as HDFS, YARN, MapReduce, Hive, Kafka, Spark, Airflow, or Presto. Experience with AWS, GCP, or Looker (advantageous but not essential). Solid background in data modelling, including the design, implementation ...

Python is required . Proficiency in at least one object-oriented language. Experience with big data technologies such as HDFS, YARN, MapReduce, Hive, Kafka, Spark, Airflow, or Presto. Experience with AWS, GCP, or Looker (advantageous but not essential). Solid background in data modelling, including the design, implementation ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn, and Facebook. Benefits At Databricks, we strive to provide comprehensive ...

will lead requirements for the Treasury Analytics Group, support FIS Quantum & TBSM, and work on a new risk/analytics platform using Hadoop, Spark, and NoSQL tools. The role reqs 5+ years of experience, Linux/Oracle/MS SQL, ITIL, and scripting with Java/Python. Collaboration with ...

depth actually gets used. • AWS across the board, including S3, Glue, Redshift, Lake Formation and Kinesis • Databricks and Snowflake running on top of AWS • Spark and distributed processing frameworks for large-scale data • Streaming technologies such as Kinesis or Kafka You're expected to pick the right tools ...

Building streaming data pipelines and event-driven systems Kafka, Pulsar, NATS, RabbitMQ, or similar messaging platforms Designing distributed schedulers, queues, and asynchronous processing systems Spark, Flink, Beam, or MapReduce Ad tech, social networks, search engines, or other large-scale content platforms We conduct coding interviews as part ...

code reviews Contributing to, proposing and reviewing technical standards Improving operational processes Mentoring more junior colleagues Java Vert.x Spring Rest APIs MySQL Microservices Kafka Spark NodeJS React AWS Terraform AngularJS Benefits Competitive compensation, variable bonus and performance‐based reward opportunities, and retirement programs Medical, dental, and vision insurance Generous ...

conducted for several leading frontier model developers and national safety institutes, and has been featured in OpenAI's o1 system card and Meta Muse Spark's Safety & Preparedness Report. About the roleAs a Senior Research Scientist at Faculty, you will join our high-impact R&D team to lead ...

London --------------------------------------- JOB DETAILS Role Title: Data Engineer (Python Enterprise Developer) Must have skills: -Python, Postgres SQL, Azure Databricks, AWS(S3), Git, Azure DevOps CICD, Apache Airflow -Preferred Domain: Energy trading Minimum number of relevant years of experience: 8+ Detailed Job Description: JD: • 8+ years of experience in python scripting. … building native python ETL pipelines for scraping/processing. • Good to have experience in processing big data. • Proficient in SQL programming, Postgres SQL. Spark knowledge is a good to have • Knowledge on DevOps CI/CD like Azure Pipelines, Jenkins, Git. • Experience working with AWS services(S3, lambda ...

market data normalisation. Experience handling time-series challenges such as timestamp precision, sequence gaps, duplicate and out-of-order events. Experience with distributed processing (Spark, Polars, Dask, Ray or similar). Experience with Kafka or similar streaming technologies. Familiarity with PostgreSQL, ClickHouse, Snowflake, Databricks, kdb+ or similar. Docker, Linux … market data engineering with proven experience building reliable, scalable data platforms. Our non-negotiable requirements are: Expert Python Strong SQL Scalable data pipeline development Apache Parquet Market data normalisation Automated data quality controls Deep tick and market data expertise Experience in MLOps is advantageous but not essential. We welcome ...

experience designing and implementing data solutions on at least one public cloud platform (AWS, Azure, or GCP) Working knowledge of distributed data systems: Apache SparkTM, Delta Lake, or equivalent (Hadoop, Kafka, Flink) Experience leading technical customer conversations — discovery, whiteboarding, architecture reviews Familiarity with one or more: data engineering … Engineering, or a quantitative discipline (or equivalent experience) Nice to Have: Databricks certification or experience with the Databricks Platform Experience with Unity Catalog, Lakeflow Spark Declarative Pipelines, or MLflow Background at a data/AI company, cloud provider, or technical consulting firm Interview Process Recruiter Screen → Hiring Manager Screen ...

experience designing and implementing data solutions on at least one public cloud platform (AWS, Azure, or GCP) Working knowledge of distributed data systems: Apache SparkTM, Delta Lake, or equivalent (Hadoop, Kafka, Flink) Experience leading technical customer conversations — discovery, whiteboarding, architecture reviews Familiarity with one or more: data engineering … Engineering, or a quantitative discipline (or equivalent experience) Nice to Have: Databricks certification or experience with the Databricks Platform Experience with Unity Catalog, Lakeflow Spark Declarative Pipelines, or MLflow Background at a data/AI company, cloud provider, or technical consulting firm Interview Process: Recruiter Screen → Hiring Manager Screen ...

business value in collaboration with an Account Executive and a Senior Solutions Architect. Gain excitement from clients about Databricks through hands‐on evaluation and Spark programming, integrating with the wider cloud ecosystem and 3rd party applications. Contribute to building the Databricks technical community through engagement at workshops, seminars … data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. Our Commitment to Diversity and Inclusion At Databricks, we are committed to fostering a diverse and inclusive culture where ...

DescriptionRole –Senior Databricks ArchitectTechnology – Databricks (Spark, PySpark/SQL) and data lake architecturesLocation – London, UKCompensation – Competitive (including bonus)Job DescriptionWe are looking for a Data Architect to design, build, and operate scalable data pipelines and data products, enabling a modern data mesh architecture. The role focuses on integrating legacy … systems with cloud-native platforms to support analytics, reporting, and domain-owned data products. Primary Skills Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures. Hands-on experience with streaming technologies, especially Kafka/Confluent Kafka. Experience integrating legacy data sources such as DB2 (mainframe ...

Help shape the technical roadmap for data engineering across Elliptic. Leverage and deploy AI and agentic systems to operate more effectively. Tech environment Scala | Spark | Databricks | AWS | Airflow | Kubernetes | Terraform | Functional Programming You will thrive here if you Enjoy end‐to‐end ownership, from writing the code to architecture … programming. Ability to design, build, and maintain distributed data systems in a cloud‐based environment. Hands‐on experience with big data frameworks such as Spark or Databricks. Knowledge of cloud infrastructure (AWS, GCP, or Azure). Judgement to balance scalability, performance, and maintainability. Experience with data modelling and workflow ...

domain data (bets, offers, rewards, digital data) into reusable, well‐defined datasets for downstream consumption. Implement data transformation logic using modern tooling (e.g. dbt, Spark, SQL‐based frameworks), ensuring consistency and testability. Build and optimise streaming data pipelines (Kafka/Flink or equivalent) to enable near real‐time data … maintaining scalable data platforms. Strong SQL and data modelling skills, with experience designing analytical datasets. Experience with modern data stack tools (e.g. dbt, Spark, Airflow, or similar orchestration and transformation frameworks). Experience with cloud‐based data platforms, ideally AWS. Understanding of medallion architecture or similar data layering approaches. ...

platform capabilities for data ingestion, transformation, orchestration, and processing across batch and real-time workloads. Own the integration strategy across tools such as dbt, Spark and Beam Lead the implementation and adoption of data quality, observability, security, testing and deployment including creating and sharing standards Partner closely with Analytics … supporting others Hands on experience transitioning to an AI-native Data Engineering landscape A strong Python and SQL engineer with experience using dbt, Spark and Terraform Strong experience working with GCP (or a comparable cloud platform), Infrastructure as Code, and CI/CD practices. Deep understanding of data storage ...

shared platform capabilities for data ingestion, transformation, orchestration, and processing across batch and real-time workloads. Own the integration strategy across tools such asdbt, Spark and Beam Lead the implementation and adoption of data quality, observability, security, testing and deployment including creating and sharing standards Partner closely with Analytics … excellence, and supporting others Hands on experience transitioning to an AI-native Data Engineering landscape A strong Python and SQL engineer with experience usingdbt, Spark and Terraform Strong experience working with GCP (or a comparable cloud platform), Infrastructure as Code, and CI/CD practices. Deep understanding of data ...

appropriate technologies for scalable analytics, trading strategy development, tick or time-series data, workflow automation and AI/ML-enabled use cases. Prefer Databricks, Spark and modern lakehouse patterns for scalable analytics where suitable, while recognising transferable experience with Snowflake and other enterprise data platforms. Ensure delivery choices balance … define OKRs, shape roadmaps and deliver enterprise data or analytics products. Hands-on understanding of data technologies and modern analytics platforms, preferably Databricks/Spark and lakehouse patterns; Snowflake experience is relevant and transferable but Databricks experience is preferred. Experience with Python, SQL and production analytics workflows; familiarity with ...

Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one Deep experience with distributed computing with Apache SparkTM and knowledge of Spark runtime internals Familiarity with CI/CD for production deployments Working knowledge of MLOps, ML/AI models … data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

SaaS, cloud-native environment. You will build and guide a team, collaborate with partners and delivery leads, and drive innovative data pipelines using Hive, Spark, and Hadoop across multiple cloud platforms. #J-18808-Ljbffr ...

service capabilities, and supporting analytics across the business. You will drive the implementation of data lakes, warehouses, and real-time streams using Kafka, Flink, Spark, Iceberg and cloud-native practices with Kubernetes/OpenShift. #J-18808-Ljbffr ...