151 to 175 of 188 Apache Spark Jobs in England

society’s experience with software. Come join one of the fastest‐growing startups, supported by best‐in‐class institutions like Battery Ventures, Salesforce Ventures, Spark Capital and Meritech. Pendo Core Values: Bias to Act, Hone Your Craft, The Team is Pendo, and Maniacal Focus. Location: Pendo is a hybrid ...

gambling industry. Your work will involve shaping lakehouse and data-lake paradigms, leveraging Parquet and Iceberg for high-performance data storage, and adopting scalable Spark frameworks for large-scale processing. Ultimately, you will enable self-service analytics, personalised user experiences, and an AI-first approach to data-driven decision … DevOps practices, ensuring compliance with FDJ United’s security and regulatory standards. Modernising Data Pipelines & Workflows Implement Scalable Frameworks : Orchestrate large-scale pipelines using Spark, Docker, Kubernetes, and other DevOps tools. Accelerate Delivery : Apply standardised processes and automated testing to streamline development and reduce time-to-market while managing ...

Help shape the technical roadmap for data engineering across Elliptic. Leverage and deploy AI and agentic systems to operate more effectively. Tech environment Scala | Spark | Databricks | AWS | Airflow | Kubernetes | Terraform | Functional Programming You will thrive here if you Enjoy end‐to‐end ownership, from writing the code to architecture … programming. Ability to design, build, and maintain distributed data systems in a cloud‐based environment. Hands‐on experience with big data frameworks such as Spark or Databricks. Knowledge of cloud infrastructure (AWS, GCP, or Azure). Judgement to balance scalability, performance, and maintainability. Experience with data modelling and workflow ...

Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one Deep experience with distributed computing with Apache SparkTM and knowledge of Spark runtime internals Familiarity with CI/CD for production deployments Working knowledge of MLOps, ML/AI models … data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. Benefits At Databricks, we strive to provide comprehensive benefits and perks that meet the needs ...

Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one Deep experience with distributed computing with Apache SparkTM and knowledge of Spark runtime internals Familiarity with CI/CD for production deployments Working knowledge of MLOps, ML/AI models ...

APIs used by researchers and engineers across the firm. Ideal candidates have deep Python expertise, hands-on experience with modern cluster compute technologies (Kubernetes, Spark, Hadoop/Yarn, Ray, Airflow) and a track record of delivering scalable infrastructure in a multi-user #J-18808-Ljbffr ...

infrastructure projects , is highly desirable What we can offer you At Nscale, you'll find a collaborative, supportive, and innovative environment where your contributions spark real impact. We're building something extraordinary, and we want you at the core. Highly competitive US compensation package (base + bonus + equity ...

from ingestion and streaming through to warehousing, serving, and cost optimisation You have deep experience with streaming architectures – Kinesis, Kafka/MSK, Flink, or Spark Streaming – and know when each is the right choice You can model the cost implications of architecture decisions and advise clients on trade‐offs … between throughput, latency, durability, and spend AWS certification at professional or specialty level is strongly preferred Mastery of Python, SQL, and Spark – and strong opinions on how they should be used in production data pipelines Deep experience with dbt, Airflow, or equivalent orchestration – including how to build pipelines that ...

from ingestion and streaming through to warehousing, serving, and cost optimisation You have deep experience with streaming architectures – Kinesis, Kafka/MSK, Flink, or Spark Streaming – and know when each is the right choice You can model the cost implications of architecture decisions and advise clients on trade‐offs … between throughput, latency, durability, and spend AWS certification at professional or specialty level is strongly preferred Mastery of Python, SQL, and Spark – and strong opinions on how they should be used in production data pipelines Deep experience with dbt, Airflow, or equivalent orchestration – including how to build pipelines that ...

Senior Databricks Architect Technology: Databricks (Spark, PySpark/SQL) and data lake architectures. Location: London, UK. Compensation: Competitive (including bonus). Job Description We are looking for a Data Architect to design, build, and operate scalable data pipelines and data products, enabling a modern data mesh architecture. The role … focuses on integrating legacy systems with cloud-native platforms to support analytics, reporting, and domain-owned data products. Primary Skills Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures. Hands‐on experience with streaming technologies, especially Kafka/Confluent Kafka. Experience integrating legacy data sources such ...

model lifecycle: data prep, experimentation, deployment, and monitoring. Build and optimize feature pipelines and scoring jobs using Python, Databricks, Spark, Delta Lake, and AWS. Use AWS services (S3, Redshift, Lambda) for data automation, orchestration, and scalable processing. Ensure data quality, observability, lineage, and documentation across data and ML pipelines. … Direct experience with OpenAI APIs, LLM workflows, and prompt engineering. Solid machine learning fundamentals, including supervised learning, NLP, and feature engineering. Experience with Databricks, Spark, and Delta Lake. Strong SQL skills with experience working on large datasets. Experience with AWS, including S3 and Lambda. Familiarity with Redshift, Snowflake ...

needs of the department. This is an exciting opportunity to work on cutting edge technologies including Big Data and NoSQL databases (Hadoop, HBase, Hive, Spark and MongoDB) to allow the business to gain advanced insight into their portfolios and valuation metrics. Key responsibilities include:* Lead business requirements elicitation, analysis … documentation efforts* Assist technology team in Azure cloud solution implementation; write Spark SQL queries to analyze and transform data; provide feedback to User Interface team; testing and documentation* Analyze solution requirements; understand project scope; determine project priorities; ensure efficient and on-time delivery of project tasks and milestones; follow ...

improvements in tooling and processes. Ideal candidates will have 5+ years in backend engineering for data systems, strong experience with MongoDB, Postgres, Kinesis, Flink, Spark, ElasticSearch, Redis, and query engines; plus #J-18808-Ljbffr ...

looking for Extensive experience using python, especially using libraries such as Pandas, scikit-learn and NumPy. Strong programming skills in SQL or Spark SQL Experience in Natural language processing and working and developing LLMs Full ML model lifecycle experience Relevant experience with Power BI or similar tools such … experienced data professional who will bring strong technical expertise in data science, machine learning and advanced analytics, with extensive experience using Python, SQL or Spark SQL, statistical modelling, natural language processing and large language models. You will have experience across the full machine learning lifecycle, including data cleaning, quality ...

Overview At Aztec, we are committed to building a diverse and inclusive workforce where everyone is valued, respected, and able to grow. We welcome applications from all individuals and encourage candidates who are excited about ...

must have demonstrable experience designing, deploying, and operating big data platforms at scale. You will have hands-on experience with OSS data ecosystems (e.g., Spark, Trino, Airflow, Apache Superset, and similar technologies). You will have knowledge of cloud platforms and traditional on-premise hosting; hands-on experience ...

Applying advanced techniques in LLMs, agentic systems, vector databases, fine‐tuning, and deployment tools (e.g., HuggingFace, Langchain). Hands‐on experience working with Distributed Spark based systems. Experience with data engineering concepts or a good understanding of data engineering concepts. Pre‐sales or post‐sales experience working with external … clients across a variety of industry markets. Minimum of 5+ years of customer‐facing experience would be preferred. [Preferred] Experience working with Apache SparkTM to process large‐scale distributed datasets. Communication: Proven ability to communicate and teach complex technical concepts to both technical and non‐technical audiences. Core Traits ...

processing, including vector databases, fine-tuning LLMs, and deploying LLMs with tools such as HuggingFace, Langchain, and OpenAI Hands-on experience working with Distributed Spark based systems. Graduate degree in a quantitative discipline (Computer Science, Engineering, Statistics, Operations Research, etc.) or equivalent practical experience Experience communicating and teaching technical … driving our values through ML [Preferred] 2+ years customer-facing experience in a pre-sales or post-sales role [Preferred] Experience working with Apache SparkTM to process large-scale distributed datasets Can meet expectations for technical training and role-specific outcomes within 3 months of hire Can travel ...

Applying advanced techniques in LLMs, agentic systems, vector databases, fine‐tuning, and deployment tools (e.g., HuggingFace, Langchain). Hands‐on experience working with Distributed Spark based systems Experience with data engineering concepts or a good understanding of data engineering concepts Pre‐sales or post‐sales experience working with external … clients across a variety of industry markets. Minimum of 5+ years of customer‐facing experience would be preferred [Preferred] Experience working with Apache SparkTM to process large‐scale distributed datasets Communication: Proven ability to communicate and teach complex technical concepts to both technical and non‐technical audiences. Core Traits ...

strategy and promote best practices amongst engineers and data scientists. How to make an Impact Architect and Implement : Own the technical roadmap for our Spark‐based data processes to ensure our Airflow pipelines are performant, cost‐effective, and scalable. You will enhance our existing services through hands‐on development … deployment. Expert‐level Python and its data ecosystem (Numpy, Pandas), including designing frameworks for data tasks. Deep understanding of distributed data processing engines like Apache Spark. Ability to reason about the full data lifecycle from ingestion through to real‐time serving - your system designs will need to meet downstream ...

adoption of modern data mesh principles across complex enterprise environments. What You'll Be Doing Architect and deliver modern data solutions using Databricks, Spark, PySpark and SQL Design scalable batch and real-time data pipelines that ingest data from legacy and modern platforms Lead the development of cloud-based … decision making Provide technical leadership and architectural direction on large-scale transformation programmes Essential Experience Strong hands-on expertise with Databricks Extensive experience using Spark, PySpark and SQL Proven track record designing and implementing data lake architectures Experience building both batch and streaming data pipelines Strong knowledge of Kafka ...

JOB ID: FEQ427R333 Location: London, United Kingdom Industry: Retail/CPG (UKI Enterprise) Recruiter: Dina Hussain At the company, our core values are at the heart of everything we do. A culture of proactiveness and ...

At Databricks, our core values are at the heart of everything we do; creating a culture of proactiveness and a customer‐centric mindset guides us to create a unified platform that makes data science and ...

At the company, our core values are at the heart of everything we do. A culture of proactiveness and a customer‐centric mindset guides us in creating a unified platform that makes data science and ...

Applying advanced techniques in LLMs, agentic systems, vector databases, fine‐tuning, and deployment tools (e.g., HuggingFace, Langchain). Hands‐on experience working with Distributed Spark based systems. Experience with data engineering concepts or a good understanding of data engineering concepts. Pre‐sales or post‐sales experience working with external … clients across a variety of industry markets. Minimum of 5+ years of customer‐facing experience would be preferred. Experience working with Apache SparkTM to process large‐scale distributed datasets. Communication: Proven ability to communicate and teach complex technical concepts to both technical and non‐technical audiences. Core Traits: Passion ...