1 to 23 of 23 Permanent Apache Spark Jobs in England with Remote Work Options

Spark Scala Developer - Scala/Apache Spark - Hybrid/Leeds - £450-£550 Spark Scala Developer to join our client, one of the biggest financial services organizations in the world, with operations in more than 38 countries. It has an IT infrastructure of 200,000+ servers … 000+ database instances, and over 150 PB of data. As a Spark Scala Engineer, you will have the responsibility to refactor L... more »

Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Hands more »

DataBricks, Azure SQL (Indicative experience = 5yrs+) Build and test processes supporting data extraction, data transformation, data structures, metadata, dependency and workload management. Knowledge on Spark architecture and modern Datawarehouse/Data-Lake/Lakehouse techniques Build transformation tables using SQL. Moderate level knowledge of Python/PySpark or equivalent more »

ADF, SSIS) Data governance (Purview, Unity Catalogue) Databricks Delta Lake Storage Azure Dev OPS DESIRED SKILLS Advanced Analytics Data Technologies Databricks, Delta Lake, Synapse Spark SQL, Pyspark Azure Data Explorer Logic Apps, Key Vault Semi structured data processing Integration Runtime Coding experience: Python, C#, Java for Data analysis purpose more »

data from a wide variety of corporate structured and unstructured sources, 3rd party providers and publicly available data. Leverage cloud data processing frameworks like Apache Spark, Databricks, or similar for handling, processing and analysing complex, high-volume data both structured and unstructured. Ability to script repetitive data tasks more »

or similar, with 6+ years of professional experience. A good understanding of modern lakehouse architectures and corresponding technologies, such as Dremio, Snowflake, Iceberg, (Py)Spark/Glue/EMR, dbt and Airflow/Dagster. Experience with Cloud providers. Familiarity with AWS S3, ECS and EC2/Fargate would be more »

Solid experience with programming languages like Python and proficiency in SQL Experience working with cloud platforms (e.g., Azure, GCP) and big data technologies like Spark Working knowledge of ETL and ELT frameworks and tools like dbt Working knowledge of Version Control and CICD pipelines Hiring, developing, and retaining cyber more »

C++, Java, or similar. Experience using SQL, Python (Pandas, NumPy, Scikit-Learn, etc.)/R or equivalent. Experience with Data Storage, Ingestion, and Transformation (Spark, Kafka or similar tools). Experience developing cloud infrastructure services, preferably with Kubernetes. You are passionate about solving data problems at Scale. Expertise with more »

tools such as Informatica MDM, Informatica AXON, Informatica EDC, and Collibra MySQL, SQL Server, Oracle, Snowflake, PostgreSQL and NoSQL databases Programming languages such as Spark or Python Amazon Web Services, Microsoft Azure or Google Cloud and distributed processing technologies such as Hadoop Benefits : Base Salary more »

machine learning or more general statistical analysis Strong software development skills with proficiency in Python or C++ Experience with analytics frameworks such as Pandas, Apache Spark, Dask, or Flink Experience with machine learning frameworks such as TensorFlow, JAX, PyTorch, Spark MLlib, Keras, or scikit-learn Experience in … cloud-based infrastructures such as AWS or GCP Exposure to orchestration platforms such as Apache Airflow or Kubeflow Proven attention to detail, critical thinking, and the ability to work independently within a cross-functional team What benefits do we offer ? Cond Nast Learning Hub where you ll find you more »

C++, Java, or similar. Experience using SQL, Python (Pandas, NumPy, Scikit-Learn, etc.)/R or equivalent. Experience with Data Storage, Ingestion, and Transformation (Spark, Kafka or similar tools). Experience developing cloud infrastructure services, preferably with Kubernetes. You are passionate about solving data problems at Scale. Expertise with more »

Bachelor's degree in Computer Science or a related field (Master's degree preferred) Nice to have: experience with LLMs, Vector Databases, AWS EMR, Spark, and Python Our commitment: Equal opportunities are important to us. We believe that diversity and inclusion at The Stepstone Group are critical to our more »

with monitoring tools to track model performance, resource utilization, and system health. Proficiency in programming languages such as Python, and knowledge of PySpark and Spark pool clusters as well as ML libraries and frameworks. Proficiency with observability tools, such as: Prometheus and Grafana. Infrastructure-as-Code(IaC)Terraform and more »

tasks, both for oneself and others, ensuring progress aligns with project goals. Nice to have: Previous experience in startup environments. Proficiency or experience with Apache Spark. Familiarity or background in working with Azure. Experience orchestrating workflows, particularly within distributed system environments. Knowledge of MLOps principles and practices, especially in more »

and partners Preferred Requirements Experience or strong interest in blockchain and other Web 3.0 technologies Experience with OLAP technologies, such as, Presto/Trino, Spark, Hadoop, Athena, or BigQuery is a plus Experience in Golang or any other strongly-typed programming language Experience mentoring and supporting fellow engineers Our more »

Experience with a JVM language, Kotlin, Java, Scala, Clojure Knowledge of Typescript and React is beneficial Exposure to data pipelines using technologies such as Spark and Kafka Experience with cloud services (ideally AWS) Hybrid working 1-2 days per week in Central London. £110,000 depending on experience. Please more »

least 6 years professional software development experience using Java and Spring framework. Experience using workflow management systems and distributed data processing software (e.g., Hadoop, Spark). At least 6 years professional experience with large scale databases (e.g., Oracle, MongoDB). Excellent knowledge of the UNIX command line. Experience with more »

a fast-changing environment with rapid release cycles. Knowledge of Java, Cucumber DynamoDB, Redis and Redshift Cloud: AWS (S3, EC2, Lambda, AWS Glue/Spark, IAM, Cloudwatch, MSK, Managed Airflow, Athena, Kenesis) Experience of writing and taking responsibility for technical documentation. Knowledge and experience of working with Python and more »

first and collaborative development using Java, Kotlin, C++, JavaScript and Oracle and leverage cutting-edge technologies such as MongoDB, ClickHouse, Kafka, Redis, Ignite, gRPC, Spark, and Tableau. We build cloud-ready solutions and host them on-premises (Google Anthos) and on public cloud (Google GKE). You will be more »

s Office. There will be a particular emphasis in this role on developing within a Microsoft SQL Server development environment and/or an Apache Spark big data processing environment - creating algorithms and pipelines to ingest and transform data into information systems and solutions capable of answering clinical more »

improvements Key Skills 3+ years of Python experience Highly statistical and Analytical Exposure to Google Cloud Platform ( BigQuery, GCS, Datalab, Dataproc, Cloud ML (desirable) Spark & Hadoop experience Strong communication skills Good problem solving skills Qualifications Bachelor's degree or equivalent experience in a quantative field (Statistics, Mathematics, Computer Science … classification techniques, and algorithms Fluency in a programming language (Python, C,C++, Java, SQL) Familiarity with Big Data frameworks and visualization tools (Cassandra, Hadoop, Spark, Tableau) This is a permanent position, and offers flexibility with Hybrid working, 2-3 days per week in the office, depending on workload #J more »

wish to. How you will contribute in this role: Architecting, building and maintaining ML processing pipelines/workflows in Python via technologies such as Spark, serverless functions, Airflow, MLflow, or other. Implement MLOps and related DevOps focused on creating ML workflows for deploying models for large scale inference and … looking for: 6+ years of professional experience with ML operations used in large scale digital applications. Extensive experience with programming in Python, Jupyter notebooks, Spark, and Docker Professional experience of designing, building and managing bespoke MLOps in cloud environments, using tools such as SageMaker Processing, SageMaker Pipelines, Apache more »

(Senior) Data Scientist - Marketplace - London Location : We are flexible! Come and join us either in Hamburg, Berlin, London or Athens At FREE NOW, we are at an exciting point in our history we are building a world-class product used more »