76 to 100 of 367 Apache Spark Jobs in England

/CD, and environment management to support consistent, reproducible workloads across dev/test/prod Build and maintain components using Python and Spark for data processing, shared datasets, and platform services Contribute to shared services for data and ML lifecycle management (data pipelines, experiment tracking, versioning, lineage, permissions … QualificationsExperience in Data Platforms, Data Engineering, Cloud Engineering, or ML Platform Engineering roles, with exposure to Azure Strong hands-on experience with Python and Apache Spark Experience with Azure data platform technologies such as Azure Databricks, ADLS Gen2, and Unity Catalog Working knowledge of security and access management ...

PostgreSQL (or similar relational databases) and NoSQL databases. Experience with vector databases such as Qdrant, Milvus or pgvector . Familiarity with technologies such as Apache Spark, Airflow, Kafka, Elasticsearch/OpenSearch, Pandas and Polars . Strong understanding of data modelling, storage architecture and performance optimisation. Desirable Experience working ...

pipelines.Excellent knowledge of PostgreSQL (or similar relational databases) and NoSQL databases.Experience with vector databases such as Qdrant, Milvus or pgvector.Familiarity with technologies such as Apache Spark, Airflow, Kafka, Elasticsearch/OpenSearch, Pandas and Polars.Strong understanding of data modelling, storage architecture and performance optimisation.DesirableExperience working on AI or Machine ...

stakeholders, and business leaders.Strong presentation, demo, and storytelling skills, with the ability to explain complex technical concepts clearly and credibly.Familiarity with SQL, Python, R, Apache Spark, or similar technologies is a plus.Experience with Alteryx or similar analytics platforms is highly desirable.Ability to work independently in a fast-paced ...

workflows. Key Requirements Passion for building scalable, resilient cloud data platforms. Strong experience with Databricks or Snowflake on AWS. Proven Python skills, including Spark and Airflow expertise. Advanced SQL skills and end-to-end data modelling experience. Experience building batch and real-time data integrations. Hands-on CICD skills ...

work closely with stakeholders and translate business requirements into effective AI solutions Desirable Generative AI experience Large Language Models (LLMs) LangChain or similar frameworks Spark, Hadoop or other big data technologies Experience with distributed computing, streaming platforms or workflow orchestration tools Experience monitoring and optimising model performance in production ...

grade code Distributed Data Processing Experience building and operating: batch processing systems distributed data systems near real-time streaming pipelines Familiarity with: Kafka Flink Spark Databricks experience is a strong plus Databases & Data Warehousing Comfortable working with: RDBMS data warehousing solutions Strong understanding of data modelling aligned with business ...

translate analytical needs into scalable Databricks-based solutions.Your expertiseYou have:• proven experience with Azure and Databricks in large-scale data environments• strong understanding of Spark, Hadoop ecosystems and big data engineering concepts• hands-on data engineering experience• experience delivering at least one end-to-end Databricks project• strong knowledge ...

nature of your request and your contact information. Please include the job requisition number in your message.Salary Range$176,400.00 - $327,600.00Skills DesiredApache Spark, Artificial Intelligence (AI), Big Data, Data Governance, Data Literacy, Data Management, Data Quality, Data Science, Data Strategy, Data Visualization, Machine Learning (Ml), Master Data Management ...

Experience working for a software vendor, SaaS provider, or professional services organisation. Familiarity with Ataccama or similar enterprise data platforms. Exposure to Hadoop/Spark, NoSQL, XSLT, Hive, Kafka, Snowflake, or Databricks. Python or other programming languages. Familiarity with SDLC, code management and upgrades, and Unix/Linux. Perks ...

experience designing and implementing multi‐agent architectures Enterprise AI Integration & Data API‐ and event‐driven integration of AI into enterprise workflows Data platforms: Databricks, Spark, Snowflake; streaming via Kafka Backend & Distributed Systems Languages: Python (expert), Java/Spring Boot (enterprise standard), Go (plus) Architecture: Microservices, domain‐driven design, event ...

control, and Responsible AI/MRM compliance Enterprise AI Integration & Data API- and event‐driven integration of AI into enterprise workflows Data platforms: Databricks, Spark, Snowflake; streaming via Kafka Backend & Distributed Systems Languages: Python (expert), Java/Spring Boot (enterprise standard), Go (plus) Architecture: Microservices, domain‐driven design, event ...

with the ability to work fluently across scientific and technical domains.Essential skills and experience:Proven data engineering experience with Databricks (Delta Lake, Unity Catalog, Apache Spark) in cloud-based data platforms and environments (AWS).Strong programming skills in Python and SQL, with experience in software version control ...

data scientists and product teams to deliver high-impact solutionsWhat we're looking for:Strong experience building cloud-based data platformsExpertise with Python, SQL, Spark/PySpark and DatabricksExperience designing scalable data architectures and modern data pipelinesPrevious technical leadership or mentoring experienceAzure, AWS or GCP experienceWhat ...

Architecture.- Strong programming skills in Python and SQL.- Familiarity with cloud platforms such as AWS, Azure, or GCP.- Knowledge of Snowflake and experience with Spark/PySpark.- Experience in designing and implementing modern data platform engineering solutions.If you are ready to make an impact within a dynamic team ...

Work with container technologies Core Data Engineering Strong programming proficiency in Java or Python. Hands-on experience with at least one of: Kafka, Flink, Spark Solid understanding of stream processing concepts Understanding of software engineering best practices: testing, design patterns, CI/CD, Git. Experience building ETL/ ...

driven decision making. What youll be doing Building and optimising scalable data pipelines using Java (primary) and technologies like Kafka, Flink, or Spark Developing real-time streaming solutions and event-driven architectures using AWS services (Kinesis, MSK, Lambda, Glue) Contributing to data architecture, modelling, and best practices across modern ...

driven decision making. What you'll be doing Building and optimising scalable data pipelines using Java (primary) and technologies like Kafka, Flink, or Spark Developing real-time streaming solutions and event-driven architectures using AWS services (Kinesis, MSK, Lambda, Glue) Contributing to data architecture, modelling, and best practices across ...

multidisciplinary team to support and enhance over 70 active BI products. What You'll Bring Essential Skills & Experience: Core Technologies: Azure Databricks (or similar Spark-based platforms) and Azure Data Factory (ADF). Languages: SQL and Python. Data Platforms: Azure Data Lake and SQL Server RDBMS. ETL Tools ...

Work with container technologies Core Data Engineering Strong programming proficiency in Java or Python. Hands-on experience with at least one of: Kafka, Flink, Spark Solid understanding of stream processing concepts Understanding of software engineering best practices: testing, design patterns, CI/CD, Git. Experience building ETL/ ...

security Practical cloud‐native experience Preferred Qualifications, Capabilities, and Skills Experience with modern data technologies such as Databricks or Snowflake Hands‐on experience with Spark/PySpark and other big data processing technologies Demonstrated proficiency in software applications and technical processes within disciplines such as data engineering, cloud, artificial ...

security Practical cloud‐native experience Preferred Qualifications, Capabilities, and Skills: Experience with modern data technologies such as Databricks or Snowflake Hands‐on experience with Spark/PySpark and other big data processing technologies Demonstrated proficiency in software applications and technical processes within disciplines such as data engineering, cloud, artificial ...

projects from concept to production.Strong knowledge of Python and core ML libraries (e.g., spaCy, NumPy, SciPy, Transformers).Understanding of big data and cloud technologies (Spark, Hadoop, Azure, AWS, or GCP).Deep expertise in MLOps principles, scalable model deployment, model governance, and the practical application of responsible AI within enterprise ...

security Practical cloud‐native experience Preferred Qualifications, Capabilities, and Skills Experience with modern data technologies such as Databricks or Snowflake Hands‐on experience with Spark/PySpark and other big data processing technologies Demonstrated proficiency in software applications and technical processes within disciplines such as data engineering, cloud, artificial ...

application resiliency, and securityPractical cloud-native experiencePreferred Qualifications, Capabilities, and Skills:Experience with modern data technologies such as Databricks or SnowflakeHands-on experience with Spark/PySpark and other big data processing technologiesDemonstrated proficiency in software applications and technical processes within disciplines such as data engineering, cloud, artificial intelligence ...