176 to 200 of 372 Apache Spark Jobs in England

/Java/Scala skills, and familiarity with AWS/Azure/GCP, ERP/MES/SCADA, and big data tools such as Spark, Kafka or Hadoop. A CS/Engineering degree is expected. #J-18808-Ljbffr ...

data governance, ethics and responsible AI Eligibility for Enhanced DBS and BPSS clearance Desirable: Experience with PyTorch, TensorFlow, LangGraph, R or Java Experience with Spark, Databricks or similar distributed data platforms, and exposure to MLOps Experience of AWS, Azure or GCP AI/ML services, ideally with vendor certifications ...

data pipelines. Strong SQL, including performance tuning on large tables. Python for data transformation and pipeline orchestration. Experience with a distributed query engine (Presto, Spark, Hive or similar) and a workflowscheduler (Airflow or similar). Comfortable working in a code review based workflow with Git. Ability to work ...

time ML & reproducibility: A strong grasp of production inference patterns and reproducible environments (Docker, MLflow or equivalent). Cloud & tooling: AWS, plus SageMaker, Snowflake, Spark/Databricks and Kubernetes. Engineering mindset: A focus on reliability, maintainability and continuous improvement. ...

concepts. Proficiency in programming languages like Python (with libraries like TensorFlow, PyTorch, scikit-learn). Experience with data wrangling tools and technologies (e.g., SQL, Spark). Excellent communication and collaboration skills to work effectively with cross-functional teams. A passion for innovation and a strong desire to apply ...

architecture, distributed data systems, orchestration, governance, and scalable data product design - Experience with technologies and ecosystems such as GCP, AWS, Azure, Databricks, Snowflake, Kafka, Spark, dbt, Kubernetes, Airflow, ML/AI enablement, or similar modern platform tooling - Strong commercial acumen and ability to engage credibly with senior technical ...

scientists in the "PyData" ecosystem (Numpy, Pandas) is desirable. Familiarity with some of the other tools in our stack is desirable: Redis Postgres Airflow Spark This is a hybrid role based in London, UK. About Arrive Arrive, including brands like EasyPark, Flowbird, RingGo, ParkMobile and Parkopedia, is a leading ...

into robust approaches and measurable outcomes. Strong practical capability in Python and SQL across data exploration, feature engineering, modelling and validation, with experience of Spark and modern cloud data platforms. Expertise in statistical analysis, forecasting, predictive modelling, classification, clustering and optimisation, including developing and deploying production machine-learning solutions. ...

into robust approaches and measurable outcomes. Strong practical capability in Python and SQL across data exploration, feature engineering, modelling and validation, with experience of Spark and modern cloud data platforms. Expertise in statistical analysis, forecasting, predictive modelling, classification, clustering and optimisation, including developing and deploying production machine-learning solutions. ...

experience in software engineering, MLOps, and deploying machine learning models at scale.* Proficiency in SQL, Python, and familiarity with big data technologies (e.g., Kafka, Spark) and/or cloud platforms (e.g., GCP, AWS, or Azure).* Industry knowledge: Experience in gaming or digital entertainment is a strong plus. ...

read through code, especially Java. Demonstrable experience collaborating with engineering on services Experience working with large datasets and data processing technologies (e.g., Hadoop, Spark, SQL) Familiarity with anomaly detection, supervised and unsupervised learning methods, and real-time data analysis Experience with statistical analysis and good presentation skills to drive ...

series databases, columnar formats, or analytics engines (e.g., ClickHouse, TimescaleDB, Druid, InfluxDB, Parquet). Experience with streaming or data processing technologies such as Kafka, Apache Arrow, Flink, or Spark. Comfort reasoning about distributed systems tradeoffs: latency vs. throughput, consistency vs. availability, abstraction vs. control. Clear technical communication ...

such as Pandas, NumPy and Scikit-learn A solid grounding in statistical methodologies, along with data extraction, manipulation and feature engineering techniques Experience with Spark, agile delivery methods and CI/CD practices Familiarity with DevOps and MLOps tools and practices, such as Docker, Terraform and MLFlow Confidence influencing ...

ML### experienceExtensive hands-on### experienceshowcasing expertise and a strong track record in the engineering field. Technical knowledge: Extensive### experiencewith Python, distributed processing pipelines (Hadoop, Spark, Airflow, Dask), and very large datasets – statistical analysis, data quality control, optimizing storage. Cloud proficiency: Extensive### experiencewith cloud and infrastructure services, including, as well ...

designing and enforcing data contracts and quality SLAs in distributed data ecosystems. Proficiency in Python, Java, or Scala, and experience building pipelines with Databricks, Spark, or Kafka. Strong understanding of data governance principles, privacy regulations (GDPR, CCPA), and secure data handling practices. Familiarity with metadata management and data catalog ...

Feast, AWS Feature Store) Experience with containerisation (Docker) and orchestration (Kubernetes, ECS) Familiarity with Infrastructure as Code (Terraform, CloudFormation) Experience with data processing frameworks (Spark, Dask) for large-scale workloads Understanding of data governance and compliance frameworks Experience working in regulated industries (finance, healthcare, or similar) Security Clearance ...

Feast, AWS Feature Store) Experience with containerisation (Docker) and orchestration (Kubernetes, ECS) Familiarity with Infrastructure as Code (Terraform, CloudFormation) Experience with data processing frameworks (Spark, Dask) for large-scale workloads Understanding of data governance and compliance frameworks Experience working in regulated industries (finance, healthcare, or similar) Security Clearance ...

develop homogenous data repositories to deliver data led decision making. Ingest data from various sources, including on premise SQL databases, REST API’s, Apache Kafka streams, etc. Define and apply cleansing rules to the data to ensure meets quality expectations. Define and model data for its appropriate use including … etc.) Other languages, such as C#, PowerShell IaC, e.g. Terraform, ARM, Bicep, etc. Test driven development (TDD) Streaming technologies, such as Azure Stream Analytics, Spark Structured Streaming, etc. Power BI Engineering experience Certified SCRUM Developer (CSD) Data Governance tool experience e.g. Purview Machine learning and Artificial intelligence ...

software engineers and product managers to deliver robust data solutions. The role requires 7+ years in data engineering, including leadership, and strong expertise in Apache Spark and Azure Data Factory, with hands-on cloud experience across Azure/AWS/GCP. #J-18808-Ljbffr ...

process, including CI/CD, version control, testing, MLOps/LLMOps, and agile methodologies Experience in building and managing data pipelines using tools like Apache Spark Excellent communication skills and ability to collaborate with diverse teams Commitment to responsible AI practices, including fairness, accountability, and transparency Nice ...

data extraction, transformation, and pipeline development Experience with dashboarding and visualization tools (Tableau, Qlik, or similar) Familiarity with big data tools (Snowflake, Databricks, Spark) and ETL processes Experience with Python or R for advanced analytics, automation, or experimentation support preferred Knowledge of statistical methods and experimentation (A/ ...

data extraction, transformation, and pipeline development Experience with dashboarding and visualization tools (Tableau, Qlik, or similar) Familiarity with big data tools (Snowflake, Databricks, Spark) and ETL processes Experience with Python or R for advanced analytics, automation, or experimentation support preferred Knowledge of statistical methods and experimentation (A/ ...

Java, Scala or Go) Extensive experience working with operational data stores, data warehouse, large‐scale data technologies and data lakes Experience using distributed frameworks (Spark, Flink, Beam, Hadoop) Good knowledge of containers (Docker, Kubernetes etc) and experience with cloud platforms such as GCP, Azure or AWS Strong experience working ...

placements in pre-sales, technical consulting, or data engineering within technology companies Familiarity with data tools commonly used in FSI environments (dbt, Kafka, Spark, or equivalent) Coursework or foundational knowledge of financial services concepts such as risk management, regulatory reporting, or fraud analytics Exposure to customer-facing presentations, demos ...

maintain operational continuity and quality output Knowledge of data processing frameworks, including ETL pipelines, data integration, and data modeling (experience with Databricks or Spark preferred) Strong analytical and problem‐solving skills with the ability to communicate clearly to both technical and non‐technical stakeholders Basic understanding of artificial intelligence ...