26 to 48 of 48 Permanent Apache Spark Jobs in England with Remote Work Options

analysis. Your expertise will be instrumental in ensuring the security and efficiency of the data handling and reporting processes. Key Responsibilities: Data Processing: Utilize Apache Spark, AWS RDS, and Hadoop to process large datasets efficiently and securely. Reporting: Generate comprehensive and insightful reports using Tableau. Business Rules Management … adherence to best practices and maintaining high-security standards. Requirements: Security Clearance: Must hold a current and valid Security Clearance. Technical Skills: Proficient with Apache Spark, AWS RDS, and Hadoop. Experienced in using Tableau for data visualization and reporting. Familiarity with Red Hat Decision Manager for business rules more »

ADF, SSIS) Data governance (Purview, Unity Catalogue) Databricks Delta Lake Storage Azure Dev OPS DESIRED SKILLS Advanced Analytics Data Technologies Databricks, Delta Lake, Synapse Spark SQL, Pyspark Azure Data Explorer Logic Apps, Key Vault Semi structured data processing Integration Runtime Coding experience: Python, C#, Java for Data analysis purpose more »

or similar, with 6+ years of professional experience. A good understanding of modern lakehouse architectures and corresponding technologies, such as Dremio, Snowflake, Iceberg, (Py)Spark/Glue/EMR, dbt and Airflow/Dagster. Experience with Cloud providers. Familiarity with AWS S3, ECS and EC2/Fargate would be more »

Solid experience with programming languages like Python and proficiency in SQL Experience working with cloud platforms (e.g., Azure, GCP) and big data technologies like Spark Working knowledge of ETL and ELT frameworks and tools like dbt Working knowledge of Version Control and CICD pipelines Hiring, developing, and retaining cyber more »

C++, Java, or similar. Experience using SQL, Python (Pandas, NumPy, Scikit-Learn, etc.)/R or equivalent. Experience with Data Storage, Ingestion, and Transformation (Spark, Kafka or similar tools). Experience developing cloud infrastructure services, preferably with Kubernetes. You are passionate about solving data problems at Scale. Expertise with more »

machine learning or more general statistical analysis Strong software development skills with proficiency in Python or C++ Experience with analytics frameworks such as Pandas, Apache Spark, Dask, or Flink Experience with machine learning frameworks such as TensorFlow, JAX, PyTorch, Spark MLlib, Keras, or scikit-learn Experience in … cloud-based infrastructures such as AWS or GCP Exposure to orchestration platforms such as Apache Airflow or Kubeflow Proven attention to detail, critical thinking, and the ability to work independently within a cross-functional team What benefits do we offer ? Cond Nast Learning Hub where you ll find you more »

C++, Java, or similar. Experience using SQL, Python (Pandas, NumPy, Scikit-Learn, etc.)/R or equivalent. Experience with Data Storage, Ingestion, and Transformation (Spark, Kafka or similar tools). Experience developing cloud infrastructure services, preferably with Kubernetes. You are passionate about solving data problems at Scale. Expertise with more »

tasks, both for oneself and others, ensuring progress aligns with project goals. Nice to have: Previous experience in startup environments. Proficiency or experience with Apache Spark. Familiarity or background in working with Azure. Experience orchestrating workflows, particularly within distributed system environments. Knowledge of MLOps principles and practices, especially in more »

and partners Preferred Requirements Experience or strong interest in blockchain and other Web 3.0 technologies Experience with OLAP technologies, such as, Presto/Trino, Spark, Hadoop, Athena, or BigQuery is a plus Experience in Golang or any other strongly-typed programming language Experience mentoring and supporting fellow engineers Our more »

a fast-changing environment with rapid release cycles. Knowledge of Java, Cucumber DynamoDB, Redis and Redshift Cloud: AWS (S3, EC2, Lambda, AWS Glue/Spark, IAM, Cloudwatch, MSK, Managed Airflow, Athena, Kenesis) Experience of writing and taking responsibility for technical documentation. Knowledge and experience of working with Python and more »

first and collaborative development using Java, Kotlin, C++, JavaScript and Oracle and leverage cutting-edge technologies such as MongoDB, ClickHouse, Kafka, Redis, Ignite, gRPC, Spark, and Tableau. We build cloud-ready solutions and host them on-premises (Google Anthos) and on public cloud (Google GKE). You will be more »

wish to. How you will contribute in this role: Architecting, building and maintaining ML processing pipelines/workflows in Python via technologies such as Spark, serverless functions, Airflow, MLflow, or other. Implement MLOps and related DevOps focused on creating ML workflows for deploying models for large scale inference and … looking for: 6+ years of professional experience with ML operations used in large scale digital applications. Extensive experience with programming in Python, Jupyter notebooks, Spark, and Docker Professional experience of designing, building and managing bespoke MLOps in cloud environments, using tools such as SageMaker Processing, SageMaker Pipelines, Apache more »

(Senior) Data Scientist - Marketplace - London Location : We are flexible! Come and join us either in Hamburg, Berlin, London or Athens At FREE NOW, we are at an exciting point in our history we are building a world-class product used more »

data from a wide variety of corporate structured and unstructured sources, 3rd party providers and publicly available data. Leverage cloud data processing frameworks like Apache Spark, Databricks, or similar for handling, processing and analysing complex, high-volume data both structured and unstructured. Ability to script repetitive data tasks more »

DataBricks, Azure SQL (Indicative experience = 5yrs+) Build and test processes supporting data extraction, data transformation, data structures, metadata, dependency and workload management. Knowledge on Spark architecture and modern Datawarehouse/Data-Lake/Lakehouse techniques Build transformation tables using SQL. Moderate level knowledge of Python/PySpark or equivalent more »

Spark Scala Developer - Scala/Apache Spark - Hybrid/Leeds - £450-£550 Spark Scala Developer to join our client, one of the biggest financial services organizations in the world, with operations in more than 38 countries. It has an IT infrastructure of 200,000+ servers … 000+ database instances, and over 150 PB of data. As a Spark Scala Engineer, you will have the responsibility to refactor L... more »

encompassing experience in both stream and batch processing. Proficiency in the design and deployment of production data pipelines, involving languages like Java, Python, Scala, Spark, and SQL. You should also have some, if not all, of the following; Capability in scripting, data extraction via APIs, and the composition of more »

encompassing experience in both stream and batch processing. Proficiency in the design and deployment of production data pipelines, involving languages like Java, Python, Scala, Spark, and SQL. You should also have some, if not all, of the following; Capability in scripting, data extraction via APIs, and the composition of more »

Learn, TensorFlow, PyTorch). Solid understanding of ML and data pipeline architectures and best practices. Experience with big data technologies and distributed computing (e.g., Spark, Hadoop) is a plus. Proficient in SQL and experience with relational databases. Strong analytical and problem-solving skills, with a keen attention to detail. more »

Azure or AWS experience Data access methods (SQL, GraphQL, APIs) Beneficial Requirements Experience around data science tools and algorithms Manipulation technologies (e.g., WebSockets, Kafka, Spark) TensorFlow, Pandas, pySpark and scikit-learn would be great Salary up to £75K + 20% bonus and benefits package We have interview slots lined more »

of OO programming, software design, i.e., SOLID principles, and testing practices. Knowledge and working experience of AGILE methodologies. Proficient with SQL. Familiarity with Databricks, Spark, geospatial data/modelling and insurance are a plus. Exposure to MLOps, model monitoring principles, CI/CD and associated tech, e.g., Docker, MLflow more »

Experience with a JVM language, Kotlin, Java, Scala, Clojure Knowledge of Typescript and React is beneficial Exposure to data pipelines using technologies such as Spark and Kafka Experience with cloud services (ideally AWS) Hybrid working 1-2 days per week in Central London. £110,000 depending on experience. Please more »

Bachelor's degree in Computer Science or a related field (Master's degree preferred) Nice to have: experience with LLMs, Vector Databases, AWS EMR, Spark, and Python Our commitment: Equal opportunities are important to us. We believe that diversity and inclusion at The Stepstone Group are critical to our more »