326 to 350 of 569 Apache Spark Jobs in the UK

unstructured workloads at scale - Integrate multiple sources into modern cloud platforms - Collaborate across engineering and delivery on mission-critical programmes The environment Python, SQL, Spark, Java or Scala AWS, Azure or GCP modern distributed and cloud-native architectures What we need - Active DV clearance essential - Production-scale pipeline experience ...

unstructured workloads at scale - Integrate multiple sources into modern cloud platforms - Collaborate across engineering and delivery on mission-critical programmes **The environment** Python, SQL, Spark, Java or Scala · AWS, Azure or GCP · modern distributed and cloud-native architectures **What we need** - Active DV clearance essential - Production-scale pipeline experience ...

Databricks. Familiarity with cloud‐based application development (AWS & Azure). Familiarity with one or more ML frameworks and technologies: scikit‐learn, xgboost, TensorFlow, PyTorch, Spark, SageMaker, Vertex AI, Kubeflow, Seldon, Triton. Strong communication skills, able to express ideas clearly and collaborate across teams. #J-18808-Ljbffr ...

statistics, machine learning, and mathematical modelling. Experience designing evaluation frameworks for AI systems, including model performance and monitoring. Hands-on experience with Databricks, MLflow, Spark, or similar cloud-based data platforms. Knowledge of responsible AI, model governance, and explainability. Strong communication skills with the ability to explain complex technical ...

Python. Experience with Kubernetes and Docker. Understanding of CI/CD pipelines (e.g. GitLab). Exposure to data platforms, MLOps or machine learning environments. Spark or Scala. AWS services (e.g. S3). Elasticsearch or graph databases. OIDC/OAuth. Node.js or React. #J-18808-Ljbffr ...

understanding of data structures, algorithms, and software design principles Experience working with large-scale data processing, distributed computing, or cloud-based platforms (e.g., Hadoop, Spark, AWS) is highly desirable Familiarity with ESG investing principles and market trends is a plus Excellent problem-solving, analytical, and debugging skills Strong communication ...

Qlik). Knowledge of Python or R for advanced analytics and automation is highly desirable. Familiarity with cloud/big data platforms (Snowflake, Databricks, Spark) is preferred. Key Requirements Minimum 5+ years of hands-on experience in Data Analytics or Data Science (experience within Customer Success, Operations, or Digital ...

possibility of making serious money doing something you are passionate about. Follow me on Twitter for more roles and news @SebFintechSytems ENgineer – Security, Hadoop, SPark, debian, SELinux, Debian, puppet, ruby , python, kerberos ...

Data; prior experience with Tier-1 Cloud Service Providers (CSPs) is highly preferred. Expertise in the Hadoop ecosystem and deep understanding of components like Spark, Flink, Elasticsearch, Doris, ClickHouse, and Trino., Strong knowledge of big data architecture, including Data Lake (Iceberg, Hudi) and Serverless data concepts. Familiarity with mainstream ...

manage multiple priorities and respond calmly to issues. Self-motivated with a collaborative approach. Preferred: Familiarity with AWS data tooling such as S3, Athena, Spark or notebooks. Experience supporting data products or client-facing datasets. Understanding of release testing, UAT or production support processes. Exposure to Jira/Agile ...

model training, evaluation and monitoring Experience with hyperparameter tuning at scale and experimentation frameworks Strong technical experience with SQL and Python; significant experience with Spark for large-scale data processing Excellent interpersonal skills with demonstrable collaborative leadership capabilities (coaching, mentoring, guiding, delivery ownership and stakeholder engagement) and strong standards ...

solutions, and lead their implementation. Good written and verbal communication skills. Any Beneficial/Nice to have experience: Experience with Big Data technology (HDFS, Spark, Impala) Understanding of Cloud‐native development principles. Experience with Container Orchestration tools (Docker, Kubernetes, OpenShift, etc.). Proficiency in using Jira for tracking tasks ...

performance evaluation. Data & Solution Development Gather, preprocess, analyze, and model large volumes of structured and unstructured data from multiple sources. Use Python, SQL, Spark, and other relevant technologies to build scalable analytical and machine learning solutions. Develop features, datasets, and analytical approaches that support model development, experimentation, and evaluation. ...

implementing process improvements and automation Strong Python development skills (including Pandas and related data-processing libraries). Experience with big data technologies such as Spark, PySpark, Hadoop, and Hive Exposure to quantitative modelling or financial modelling is a plus but not required. Skills that will help: Global Risk Management ...

communicating and are able to translate technical content in commercial terms for non-technical stakeholders, such as customers, sales and product teams Experience with Spark SQL, PySpark, databricks Experience with CausalAI modelling frameworks (e.g. dowhy, econml) 26 days holiday (increasing with service) Most companies lose the detail. A large ...

with the technical workStrong software engineering practice: Python, version control, reproducible pipelines and production-ready codeExperience with large-scale data processing (we use Kafka, Spark and Flink)The ability to explain complex technical work clearly to senior leadership, commercial teams and partners, and a bias for connecting research ...

Python and at least one systems language (Go, Rust, or C++). Experience working with distributed compute or training systems (e.g., NCCL, PyTorch Distributed, Spark, Ray, Slurm). Familiarity with GPU telemetry systems such as NVML or DCGM and hardware‐level monitoring concepts. Demonstrated experience scaling systems from Proof ...

/BA in Computer Science, Data/Business Analytics, or a relevant field (or equivalent experience) Exposure to big data processing frameworks such as Spark or Databricks Experience implementing CI/CD pipelines for data or reporting workflows Familiarity with data governance, security, and compliance frameworks Retail industry experience … data engineering practices, including DevOps, CI/CD, and agile delivery methods Exposure to cloud‐based data platforms and distributed data processing (e.g. Databricks, Spark) We are committed to developing your career and nurturing your talent, regardless of age; disability; gender reassignment; marriage and civil partnership; pregnancy and maternity ...

enabled features in a fast-growing startup environment in central London. You'll own data architecture from ingestion to analytics, work with Python, Kafka, Spark, and cloud infrastructure (GCP), and collaborate with BackEnd and AI teams to deliver a robust data platform that scales with user demand. #J ...

bronze/silver/gold layers, and partner with analytics, ML, and trading teams to deliver trusted data assets. You will work with dbt, Spark, Airflow, Kafka, and streaming technologies to ensure data quality, governance, and efficient storage. #J-18808-Ljbffr ...

Candidates Must Have: 4 years commercial experience with Linux CentOS , bare metal and virtualisation Puppet configuration management or equivalent automation experience Big data (Hadoop, Spark, Kafka) Containers and scheduling experience (Docker, LXC, Kubernetes, Mesos) Strong scripting You will be joining a progressive and exciting company committed to excellence. They ...

broader internal/external ecosystem. On day one you we will expect you to have: Experience working with modern data technology (e.g. dbt, spark, containers, devops tooling, orchestration tools, git, etc.)Solution engineering/solution architect experience in a Saas environment or relevant industry experience (analytics, data science, data ...

diagnosing and fixing performance bottlenecks in live systems through profiling and measurement. Nice to Have: Experience with PostgreSQL/pgvector, OpenSearch (or Elasticsearch), Spark/Delta Lake, AWS, NoSQL databases, or Rust/C++ is useful. The Founders You'll partner with a founding team of AI PhDs ...

machine learning, data mining, information retrieval, and statisticsUnderstanding of machine learning frameworks: Tensorflow, Pytorch, pyG, Keras, MXNet, Scikit-LearnStrong programming knowledge of Python and Spark; proficiency in vector operations using numpy, scipy; experience with distributed computation using multithreading, multi GPUs, Dask, Ray, PolarsFamiliarity with AWS Cloud services such ...

data mining, information retrieval, and statistics Understanding of machine learning frameworks: Tensorflow, Pytorch, pyG, Keras, MXNet, Scikit-Learn Strong programming knowledge of Python and Spark; proficiency in vector operations using numpy, scipy; experience with distributed computation using multithreading, multi GPUs, Dask, Ray, Polars Familiarity with AWS Cloud services such ...