351 to 375 of 572 Apache Spark Jobs in the UK

broader internal/external ecosystem. On day one you we will expect you to have: Experience working with modern data technology (e.g. dbt, spark, containers, devops tooling, orchestration tools, git, etc.)Solution engineering/solution architect experience in a Saas environment or relevant industry experience (analytics, data science, data ...

diagnosing and fixing performance bottlenecks in live systems through profiling and measurement. Nice to Have: Experience with PostgreSQL/pgvector, OpenSearch (or Elasticsearch), Spark/Delta Lake, AWS, NoSQL databases, or Rust/C++ is useful. The Founders You'll partner with a founding team of AI PhDs ...

data mining, information retrieval, and statistics Understanding of machine learning frameworks: Tensorflow, Pytorch, pyG, Keras, MXNet, Scikit-Learn Strong programming knowledge of Python and Spark; proficiency in vector operations using numpy, scipy; experience with distributed computation using multithreading, multi GPUs, Dask, Ray, Polars Familiarity with AWS Cloud services such ...

DatabricksFamiliarity in Cloud-based application development (we use AWS & Azure)Familiarity with one or more ML frameworks and technologies: scikit-learn, xgboost, TensorFlow, PyTorch, Spark, SageMaker, Vertex AI, Kubeflow, Seldon, TritonStrong communication skills, able to express ideas clearly and collaborate across teamsAdditional InformationBring all of you to workWe create ...

powered services into production. Strong Python and Java, both of which are in active use across the team's production services. Experience with Snowflake, Spark, Databricks or similar technologies, CI/CD pipelines, and modern DevOps tooling. Solid understanding of SecOps practices and security-conscious system design. Demonstrable track ...

startup, or equivalent experience navigating fast-paced startup lifecycles. Strong understanding of modern data warehouse architectures, real-time analytics, and data governance (e.g., BigQuery, Spark, Kafka). Deep technical expertise in Generative AI development (e.g., prompt engineering, model tuning, vector databases like Vertex AI Vector Search, and AI frameworks ...

action and escalation proceduresExperience using analytical tools for data exploration, analysis, and visualizationSome other highly valued skills may include;Experience coding in SQL, Scala, Spark, Python, etcAppreciation of financial crime, AML, and transaction monitoring/detection systems and processes, including AML and terrorist financing trends and typologiesExcellent verbal ...

Experience supporting the Intelligence Community or Department of Defense environments Experience with Python and working with databases Experience with big data frameworks such as Spark, PySpark, or Elastic Search Experience with data visualization platforms such as Kibana, Foundry Workshop, or Palantir Knowledge of secure coding practices and development ...

leader, and/or technical program manager. Data Engineering Proficiency : Expertise in SQL, Python, Pandas, Matlab, or R. Bonus if familiarity with Influx, Grafana, Spark, Polars, Arrow, Kafka, Beam, and Flink. [Bonus] In-Field Hardware Mastery : Proficiency with hardware engineering tools such as DAQs, DDS, Nix, RTOS, MCAP ...

essential: Background in financial services or regulated environments. Exposure to financial crime domains such as fraud, AML or sanctions. Experience with Spark or PySpark. Familiarity with AWS cloud services and data platforms. You will be assessed on key capabilities relevant to the role, including risk and controls, change ...

their techniques * Experience with data science, big data analytics technology stack, analytic development for endpoint and network security, and streaming technologies (e.g., Kafka, Spark Streaming, and Kinesis). Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make ...

experience Term structure modelling, stochastic calculus or Monte Carlo methods Interest rate curve bootstrapping Algorithmic execution experience Data lake or warehouse experience (Snowflake, Iceberg, Spark etc.) A product mindset - you think about who uses your systems and why. Clear communicator who can work cross-functionally with other quants, analysts ...

investment and private bank, in the context of financial crime risk management Some other highly valued skills may include; Experience coding in SQL, Scala, Spark, Python, etc Appreciation of financial crime, AML, and transaction monitoring/detection systems and processes, including AML and terrorist financing trends and typologies Excellent ...

translate technical content in commercial terms for non-technical stakeholders, such as customers, sales and product teams Desirable B2B product experience Experience with Spark SQL, PySpark, databricks Experience with CausalAI modelling frameworks (e.g. dowhy, econml) Diversity & Inclusion Intent HQ is an equal opportunities employer with an ethos of commitment ...

core component of the role is applying, modifying and designing algorithms and mathematical models to solve business problems using big data architectures (Hadoop, Spark, Cloud). In this role, your primary modelling focus will be neural network‐based forecasting, with a strong emphasis on rigorous evaluation against robust baselines ...

fastest growing scale-upsExperience in the following would be beneficial but not essential: Working with big data technology, ideally Spark but others will also be useful such as Hadoop or ElasticsearchExperience with DevOps tooling and approaches (automation and tooling is something we are passionate about, we even have ...

cohesive user experience Technologies We Use Different backend languages, including Java, Rust, Python and Go Distributed systems technologies such as Kafka, Cassandra, Elasticsearch and Spark Docker and Kubernetes for containerisation and orchestration Industry-standard build tooling, including Gradle and GitHub What We Value A deep understanding of server-side ...

retrieval, and multi‐modal representation learning. Technical Stack: Mastery of Python and deep learning frameworks (TensorFlow, PyTorch) alongside hands‐on experience with distributed computing (Spark, Ray) and cloud infrastructure (AWS/GCP). Graph Neural Networks (GNNs): Strong experience applying GNNs, knowledge graphs, or graph embeddings to map complex ...

retrieval, and multi-modal representation learning. Technical Stack: Mastery of Python and deep learning frameworks (TensorFlow, PyTorch) alongside hands-on experience with distributed computing (Spark, Ray) and cloud infrastructure (AWS/GCP). Graph Neural Networks (GNNs): Strong experience applying GNNs, knowledge graphs, or graph embeddings to map complex ...

least 2 years in a customer-facing, embedded, or solutions engineering capacityStrong hands-on experience with streaming and event-driven architectures — Kafka, Flink, Kinesis, Spark Streaming, or equivalent (DynamoDB and MemoryDB/Redis)AWS Cloud Fluency - understand how to design scalable end-to-end architectures and pipelines on large ...

secure and scalable solutions Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Deep hands-on experience with Spark/PySpark and other big data processing technologies Expertise in open-source table formats and catalog services such as Apache Iceberg Experience with ...

Engineer, maintaining and further developing a well-established cloud and CI/CD setup to implement and evolve reliable, well-tested data pipelines in Spark/Scala and to extend the dimensional data models. You will be part of the technical team collaborating closely with platform engineering, data science … ingesting from various sources into Databricks Collaborate closely with software engineers to evolve our software platform and address technical challenges Design, develop, and optimize Spark/Scala jobs for ingestion and transformation, using the existing GitHub Actions and Terraform setup for deployments Implement, run and monitor dbt tests ...

maintain SC clearance AWS certification at Associate or Professional level is desirable Experience with streaming and event-driven data technologies is desirable Experience with Spark, Kafka or Databricks is desirable Experience in public sector, defence or other regulated environments is desirable Experience working within secure environments and understanding security … Defence Regulated Environments Security Assurance Machine Learning AI Workloads Tools & Technologies AWS S3 AWS Glue AWS Lambda AWS Athena AWS Redshift AWS EMR Terraform Spark Kafka Databricks #J-18808-Ljbffr ...

hybrid Data Engineer role based in Belfast, offering the opportunity to work with modern cloud technologies including Databricks, AWS Glue, Delta Lake and Spark, while contributing to a wider programme of data transformation and continuous improvement. Key requirements include 2+ years' Data Engineering experience, strong Python/PySpark … maintain data models for BI and analytics Work with Delta Lake and modern data warehousing technologies Maintain Databricks notebooks, jobs and workflows Optimise Spark jobs and data workflows for performance and scalability Monitor, troubleshoot and improve data pipeline performance Ensure data quality, integrity, security and compliance Support wider analytics ...

driven approach. Creating code that is open by default and easy for others to reuse. Required Skills Experience with Big Data technologies, such as Apache Hadoop, Spark or Pig AWS Apache NiFi Python or Java Built on over a 70 year heritage, Roke offers specialist knowledge ...