251 to 275 of 372 Apache Spark Jobs in England

with product stakeholders to align technical strategy with business goals and resolve blockers across the team. Apply efficient data transformations using distributed computing (e.g., Spark, Dask) and ensure robust test coverage for production systems. Mentor junior team members and utilise model explainability methods to drive feature performance improvements. About ...

Experience supporting the Intelligence Community or Department of Defense environments Experience with Python and working with databases Experience with big data frameworks such as Spark, PySpark, or Elastic Search Experience with data visualization platforms such as Kibana, Foundry Workshop, or Palantir Knowledge of secure coding practices and development ...

experience Term structure modelling, stochastic calculus or Monte Carlo methods Interest rate curve bootstrapping Algorithmic execution experience Data lake or warehouse experience (Snowflake, Iceberg, Spark etc.) A product mindset - you think about who uses your systems and why. Clear communicator who can work cross-functionally with other quants, analysts ...

release. Strong programming and engineering fundamentals: Expertise in Python with and the ability to write performant production-quality code, familiarity with SQL, knowledge of Spark and cloud data environments (e.g. AWS, Databricks) Relevant technical depth: You have practical experience in one or more of information retrieval, semantic search, natural ...

investors Databricks Ventures, ServiceNow Ventures, and Workday Ventures participating alongside returning investors Altimeter Capital, Avenir Growth Capital, D1 Capital Partners, K5 Global, NewView Capital, Spark Capital, Sutter Hill Ventures, and XN. This milestone follows Sigma reaching $200M in annual recurring revenue in April 2026, with more than 100% year ...

client estates. Orchestration & Data Pipelines : Batch and streaming ingestion using Azure Data Factory (pipelines, wrangling flows, integration runtimes), Event Hubs, Kafka, and performance optimization (Spark/Synapse SQL). AI Solution Design & Build : Designing and building AI solutions on the data platform: Agentic AI workflows, RAG (Retrieval-Augmented Generation … lineage as reusable modules, so security ships with the platform rather than being applied afterwards. Optimize Performance & Cost (FinOps) : Optimize compute and storage across Spark clusters, autoscaling, partitioning, and serverless options; track, report, and drive cloud cost savings. Observability & Reliability : Build monitoring into pipelines and platforms using Azure Monitor ...

platforms for Agentic AI, Generative AI, Machine Learning, or Business Intelligence, covering data preparation, embeddings generation, vector search, and system integration using modern frameworks (Spark, dbt, LangChain) A strong foundation in system design, data storage, and reliability with commonly used data platforms (Databricks, Snowflake, BigQuery, PSQL, etc.) and data … engineering tools (e.g., Pandas, Spark, dbt, etc.) Hands-on experience with MLOps/LLMOps principles, including CI/CD for data workflows, automated agent evaluation (LangSmith, Opik, Langfuse), and infrastructure as code (Terraform) Experience building systems with different data formats (structured vs unstructured) and data processing methods (streaming ...

Envitia is seeking a Senior Data Engineer to design and deliver cutting-edge data solutions for customers in the UK. Using Databricks, Apache Spark and cloud-native technologies, you’ll build scalable Lakehouse architectures and production-grade pipelines that enable organisations to trust and share data. ...

ensure data availability, quality, and efficiency across markets. This role is onsite in London and requires strong SQL and programming skills, plus experience with Spark, Hadoop, and cloud platforms. #J-18808-Ljbffr ...

collaborating with data teams to deliver robust data solutions. The role requires strong SQL, Python and experience with distributed data tools like Presto/Spark/Hive, plus workflow scheduling with Airflow. Excellent communication and teamwork are essential. #J-18808-Ljbffr ...

data pipelines. The ideal candidate has 3+ years in data platform or infrastructure roles, strong AWS and Terraform skills, and experience with Kafka, Flink, Spark, and related lakehouse #J-18808-Ljbffr ...

software engineering skills (Python, Go, or similar) Extensive experience designing, building, and maintaining large-scale data pipelines (8+ years) Deep understanding of distributed systems (Spark, Kafka, or similar) Extensive experience with data storage technologies (data lakes, warehouses, object stores like S3) Experience running and maintaining production-grade infrastructure (Kubernetes ...

data mining, information retrieval, and statistics Understanding of machine learning frameworks: Tensorflow, Pytorch, pyG, Keras, MXNet, Scikit-Learn Strong programming knowledge of Python and Spark; proficiency in vector operations using numpy, scipy; experience with distributed computation using multithreading, multi GPUs, Dask, Ray, Polars Familiarity with AWS Cloud services such ...

both your technical and non-technical skills through continuous learning, professional development support, and knowledge sharing and insights from experienced colleagues. If our designs spark your curiosity and you would like to contribute to solving complex challenges with local and global impact, we invite you to join our team. ...

solution designs and code to architects and developers Excellent communication skills and a desire to impart knowledge Added bonus if you have Experience with Spark Experience with EMR Experience as a Solution Architect AWS Solution Architect Associate Certification What we offer you A multifaceted job with a high degree ...

Security, Collaboration, and Observability portfolios. Your Impact As a Software Engineer you will: Design, build, test, and operate near real time data streaming-based (Spark/Flink) solutions for some of the largest Networking customers in the world. Develop agentic workflows, reusable skills, tool integrations, and orchestration capabilities. Integrate ...

business domains. What would Be Useful: Experience engineering systems for the cloud-based storage and processing of large datasets or using frameworks such as Spark and open standards like Parquet and Arrow. Experience working with other cloud and related technologies, such as Docker and Kubernetes. Experience working ...

networking, storage, to applications Work in Python to design and deliver open source code Architect cloud infrastructure solutions like OpenStack, Kubernetes, Ceph, Hadoop and Spark either On-Premises or in Public Cloud (AWS, Azure, Google Cloud) Coach and develop your colleagues where you have insights Grow a healthy, collaborative ...

startup, or equivalent experience navigating fast-paced startup lifecycles. Strong understanding of modern data warehouse architectures, real-time analytics, and data governance (e.g., BigQuery, Spark, Kafka). Deep technical expertise in Generative AI development (e.g., prompt engineering, model tuning, vector databases like Vertex AI Vector Search, and AI frameworks ...

engineering practices to multi-disciplinary teams. Desirable Skills, Qualifications & Experience: Experience leveraging Kubernetes for application deployment, and familiarity with distributed computing frameworks (e.g., Ray, Spark), or specialised batch schedulers/resource managers (e.g., Slurm, Volcano, Kueue). Demonstratedexpertisewith specialised serving engines (e.g.,vLLM,SGLang) or techniques for deploying models ...

results is a great plus Ability to clearly communicate research findings to technical and nontechnical stakeholders Full‐stack experience with Python (preferred) or C++, Spark/Scala, SQL or other distributed data processing technologies as well as experience working comfortably building and deploying services and models in containerized environments ...

investors Databricks Ventures, ServiceNow Ventures, and Workday Ventures participating alongside returning investors Altimeter Capital, Avenir Growth Capital, D1 Capital Partners, K5 Global, NewView Capital, Spark Capital, Sutter Hill Ventures, and XN. This milestone follows Sigma reaching $200M in annual recurring revenue in April 2026, with more than 100% year ...

investors Databricks Ventures, ServiceNow Ventures, and Workday Ventures participating alongside returning investors Altimeter Capital, Avenir Growth Capital, D1 Capital Partners, K5 Global, NewView Capital, Spark Capital, Sutter Hill Ventures, and XN. This milestone follows Sigma reaching $200M in annual recurring revenue in April 2026, with more than 100% year ...

large generative models. AV/robotics/simulation; multi-sensor driving data (video, telemetry; LiDAR a plus). Productionising research: Flyte/Ray/Spark-style jobs, dataset lineage, training mix configuration. Reward models, offline RL, or closed-loop evaluation of driving policies. Cloud GPU fleets (Azure/ ...

decisions across multiple engineering disciplines. What we can offer you At Nscale, you'll find a collaborative, supportive, and innovative environment where your contributions spark real impact. We're building something extraordinary, and we want you at the core. Highly competitive package (base + equity) with reviews every ...