251 to 275 of 295 Apache Spark Jobs in England

related to building large-scale data storage, streaming, and warehousing systems. Experience in various database technologies (MongoDB, Postgres), streaming/processing solutions (Kinesis, Flink, Spark), indexing/caching (ElasticSearch, Redis), and various data query engines (Trino, Presto, Snowflake, etc.). Show a track record of mentoring and leading teams ...

years of experience in business intelligence or data analytics. Experience with explaining technical analysis to stakeholders. Experience with big data technologies (e.g., Hadoop, Spark, Python, or R). About the job YouTube’s Intelligence and Scaled Insights team analyzes content risks across social media to inform critical decision-making ...

related to building large-scale data storage, streaming, and warehousing systems. Experience in various database technologies (MongoDB, Postgres), streaming/processing solutions (Kinesis, Flink, Spark), indexing/caching (ElasticSearch, Redis), and various data query engines (Trino, Presto, Snowflake, etc.).Show a track record of mentoring and leading teams ...

endpoint Code Data aggregation/Malware data aggregation Requirements for the Graduate C # Software Developer Proficient in C# coding and testing AWS: S3, Spark, Glue Elasticsearch Python programming: Flask, Pandas, JSON HTML, CSS, JS A great Graduate Software Developer may also have personal passion projects using the above ...

society's experience with software. Come join one of the fastest‐growing startups, supported by best‐in‐class institutions like Battery Ventures, Salesforce Ventures, Spark Capital and Meritech. Pendo Core Values: Bias to Act, Hone Your Craft, The Team is Pendo, and Maniacal Focus. Location: Pendo is a hybrid ...

society's experience with software. Come join one of the fastest-growing startups, supported by best-in-class institutions like Battery Ventures, Salesforce Ventures, Spark Capital and Meritech. Pendo Core Values: Bias to Act, Hone Your Craft, The Team is Pendo, and Maniacal Focus. Location: Pendo is a hybrid ...

degree, or experience in a professional field or military- Experience as technical specialist in design and architecture- Experience in database (eg. SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis)- Experience in consulting, design and implementation of serverless distributed solutions- Experience in cloud based solution (AWS or equivalent), system, network and operating … military settings- Bachelor's degree, or experience as technical specialist in design and architecture- Experience in Database like NoSQL, or experience in Hive/Spark/Hbase/Yarn and experience in any Bigdata architecture- Bachelor's degree in business administration, finance, economics, computer science, data science, engineering ...

Senior Data Engineer 6 Month contract with extension Full-time Inside IR35 Hybrid 1 day every two weeks in the office Nottingham - NG1 4BX Join our client in embarking on an ambitious data transformation journey ...

Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one Deep experience with distributed computing with Apache SparkTM and knowledge of Spark runtime internals Familiarity with CI/CD for production deployments Working knowledge of MLOps, ML/AI models ...

home affairs is highly desirable. Technical expertise in data storage, processing, and containerization technologies such as Cloud or On-prem Distributed File Systems, Spark, Kubernetes, and Elasticsearch. Our perks and quirks. What makes you Q will help you to realize your full potential, flourish and enjoy what ...

Senior Databricks Architect Technology: Databricks (Spark, PySpark/SQL) and data lake architectures. Location: London, UK. Compensation: Competitive (including bonus). Job Description We are looking for a Data Architect to design, build, and operate scalable data pipelines and data products, enabling a modern data mesh architecture. The role … focuses on integrating legacy systems with cloud-native platforms to support analytics, reporting, and domain-owned data products. Primary Skills Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures. Hands‐on experience with streaming technologies, especially Kafka/Confluent Kafka. Experience integrating legacy data sources such ...

rapidly evolving world of AI. You will have the opportunity to: Design and implement robust data pipelines and ML workflows using Python, SQL, Spark and Databricks. Develop and deploy machine learning models, including NLP, deep learning and agentic AI, into production environments. Integrate data from diverse sources through both … years experience with large-scale data challenges Hands-on with Infrastructure-as-Code (Terraform, Ansible) Agile and Waterfall project experience Experience withPython, SQL, Spark, Scala What you will gain from working here: Competitive salary 25 days annual leave Private medical Career progression Extensive Training If youre passionate about data ...

gambling industry. Your work will involve shaping lakehouse and data-lake paradigms, leveraging Parquet and Iceberg for high-performance data storage, and adopting scalable Spark frameworks for large-scale processing. Ultimately, you will enable self-service analytics, personalised user experiences, and an AI-first approach to data-driven decision … DevOps practices, ensuring compliance with FDJ United’s security and regulatory standards. Modernising Data Pipelines & Workflows: Implement Scalable Frameworks, orchestrate large-scale pipelines using Spark, Docker, Kubernetes, and other DevOps tools. Accelerate Delivery: Apply standardised processes and automated testing to streamline development and reduce time-to-market while managing ...

programs. This is a hands-on leadership role for a builder who can equally command a whiteboard in front of a CTO and a Spark UI when a pipeline misbehaves. You will also shape the practice itself — mentoring engineers, creating accelerators and reusable assets, and converting delivery success into … heart — 12+ years in data engineering/architecture, 3+ on Databricks at enterprise scale, and still happiest when hands are on the keyboard. Deep Spark expertise — architecture, performance tuning, streaming, debugging, the advanced stuff that separates architects from diagram-drawers. Lakehouse fluency — Medallion architecture, Delta Lake, Unity Catalog, governance ...

customers. The role requires 5+ years of production-grade software experience, proficiency in Kotlin/Java/Go, and hands-on work with Kafka, Spark/Beam, and cloud warehouses. #J-18808-Ljbffr ...

improvements in tooling and processes. Ideal candidates will have 5+ years in backend engineering for data systems, strong experience with MongoDB, Postgres, Kinesis, Flink, Spark, ElasticSearch, Redis, and query engines; plus #J-18808-Ljbffr ...

spans a wide range of technologies, including Java and Python-based MicroServices, AWS/GCP cloud backend systems, Big Data technologies like Hive and Spark, and modern Web applications. With a globally distributed presence across the US, India and Europe, the team thrives on collaboration, bringing together diverse perspectives … needs, entrepreneurial spiritExcellent verbal and written communication skillsBS or MS degree in Computer Science or equivalentExperience in distributed computing frameworks like - Hive/Hadoop, Apache SparkExperience in developing Finance or HR related applicationsExperience with following cloud services: AWS Elastic Beanstalk, EC2, S3, CloudFront, RDS, DynamoDB, VPC, Elastic Cache, LambdaWorking ...

spans a wide range of technologies, including Java and Python-based MicroServices, AWS/GCP cloud backend systems, Big Data technologies like Hive and Spark, and modern Web applications. With a globally distributed presence across the US, India and Europe, the team thrives on collaboration, bringing together diverse perspectives … needs, entrepreneurial spiritExcellent verbal and written communication skillsBS or MS degree in Computer Science or equivalentExperience in distributed computing frameworks like - Hive/Hadoop, Apache SparkExperience in developing Finance or HR related applicationsExperience with following cloud services: AWS Elastic Beanstalk, EC2, S3, CloudFront, RDS, DynamoDB, VPC, Elastic Cache, LambdaWorking ...

equivalent platforms, with the ability to partner with technology teams to shape architecture and drive enterprise adoption. Proficiency across Python, q/KDB, SQL, Spark, C#, and related engineering toolsets, with sufficient depth to guide technical decisions, challenge design options, and work effectively with engineering teams to deliver scalable … Science, or related discipline. Nice to Have Experience integrating real‐time market data into Align, Endur, and Front Office trading platforms. Familiarity with Flink, Spark Streaming, and modern stream‐processing technologies. Knowledge of execution algorithms, quantitative trading strategies, and best execution frameworks. Experience with MDSL, TRG Screen, DACS ...

Location: London, UK At Databricks, our core values are at the heart of everything we do; creating a culture of proactiveness and a customer-centric mindset guides us to create a unified platform that makes ...

needs of the department. This is an exciting opportunity to work on cutting edge technologies including Big Data and NoSQL databases (Hadoop, HBase, Hive, Spark and MongoDB) to allow the business to gain advanced insight into their portfolios and valuation metrics. Key responsibilities include:* Lead business requirements elicitation, analysis … documentation efforts* Assist technology team in Azure cloud solution implementation; write Spark SQL queries to analyze and transform data; provide feedback to User Interface team; testing and documentation* Analyze solution requirements; understand project scope; determine project priorities; ensure efficient and on-time delivery of project tasks and milestones; follow ...

Applying advanced techniques in LLMs, agentic systems, vector databases, fine-tuning, and deployment tools (e.g., HuggingFace, Langchain). Hands-on experience working with Distributed Spark based systems Experience with data engineering concepts or a good understanding of data engineering concepts Pre-sales or post-sales experience working with external … clients across a variety of industry markets. Minimum of 5+ years of customer-facing experience would be preferred [Preferred] Experience working with Apache SparkTM to process large-scale distributed datasets Communication: Proven ability to communicate and teach complex technical concepts to both technical and non-technical audiences. Core Traits ...

Applying advanced techniques in LLMs, agentic systems, vector databases, fine‐tuning, and deployment tools (e.g., HuggingFace, Langchain). Hands‐on experience working with Distributed Spark based systems. Experience with data engineering concepts or a good understanding of data engineering concepts. Pre‐sales or post‐sales experience working with external … clients across a variety of industry markets. Minimum of 5+ years of customer‐facing experience would be preferred. [Preferred] Experience working with Apache SparkTM to process large‐scale distributed datasets. Communication: Proven ability to communicate and teach complex technical concepts to both technical and non‐technical audiences. Core Traits ...

strategy and promote best practices amongst engineers and data scientists. How to make an Impact Architect and Implement : Own the technical roadmap for our Spark-based data processes to ensure our Airflow pipelines are performant, cost-effective, and scalable. You will enhance our existing services through hands-on development … deployment. Expert-level Python and its data ecosystem (Numpy, Pandas), including designing frameworks for data tasks. Deep understanding of distributed data processing engines like Apache Spark. Ability to reason about the full data lifecycle from ingestion through to real-time serving - your system designs will need to meet downstream ...

retraining, and optimise models for reliability and cost efficiency in AWS.Collaboration & Enablement: Partner with data engineers to integrate ML workflows into wider platforms (Spark, Databricks), and share best practice and mentor other technical professionals. What You'll Love About This RoleThink Big: Build ML and AI solutions that shape … models underperform across data, features and architecture, and make reasoned trade-offs. Real-time & distributed ML: A strong grasp of production inference patterns, plus Spark and distributed data processing. Reproducibility & tooling: Reproducible environments (UV/Docker) and MLflow or equivalent, on AWS with Spark, Databricks and Snowflake. Engineering ...