26 to 39 of 39 Remote/Hybrid Apache Spark Jobs

monitoring Experience with cloud platforms (e.g. AWS, Azure, or GCP) and containerisation (Docker, Kubernetes) Experience building data pipelines and working with large datasets (SQL, Spark or similar) Strong understanding of machine learning algorithms and statistical modelling techniques Experience collaborating across data science and engineering teams Machine Learning Engineer, Python ...

teams to drive outcomes Core skills (indicative) Production pipeline design and deployment experience Strong engineering capability with Python, SQL, plus big data tooling (e.g., Spark, and Java/Scala where relevant AWS, Azure, GCP Working pattern Hybrid working, with the team on client site or in the office ...

Regulatory compliance automation Conversational AI/chatbots for banking use cases 2 . Data Engineering & Platform Development Build scalable data pipelines using tools like Spark, PySpark, Databricks, Snowflake, or BigQuery Design data lakes/lakehouse architectures on AWS/Azure/GCP Integrate structured and unstructured data (market feeds … data engineering/AI engineering Strong Python and SQL expertise Hands-on experience with: LLMs and GenAI frameworks (LangChain, LlamaIndex) Vector databases & embeddings Spark/Databricks/distributed computing Experience in REST APIs and microservices architecture Cloud & Tools Cloud: Azure (preferred), AWS, or GCP Data platforms: Snowflake, Databricks, Delta ...

loop, calibration, guardrails, auditability) Experience with hyperparameter tuning at scale and experimentation frameworks Strong technical experience with SQL and Python; significant experience with Spark for large-scale data processing Excellent interpersonal skills with demonstrable collaborative leadership capabilities (coaching, mentoring, guiding, delivery ownership and stakeholder engagement) and strong standards ...

using data mining techniques and with statistical rigor Strong technical skills regarding data analysis, statistics, machine learning and programming. Strong working knowledge of Hadoop, Spark, SQL, Python and/or R. Excellent communication skills Strong skills in translating business problems into data problems Strong data visualization skills Strong skills ...

work on a Big Data Project in the finance sector. Required Experience: Java Big Data experience On-premises cluster experience Databases Kubernetes Kafka Apache Spark Preffered Experience: Finance sector experience ...

insights that drive the AI product roadmap forward. Tech Stack Includes : AWS: EC2, Athena, S3, Kinesis, Lambda, Step Functions, RDS, QuickSight Languages & Frameworks: Python, Spark, TensorFlow, LLMs & LLM coding tools Databases & Search: MySQL, PostgreSQL, SOLR Requirements Experience: Minimum 3 years of post-degree commercial experience in a data science ...

data platforms (AWS, Azure, GCP). • Develop & Optimise robust data models, warehouses and 'big data' architectures. • Integrate & Transform data using tools such as Databricks, Spark, Kafka, Talend, Informatica, AWS Glue or Azure Data Factory. • Collaborate & Influence with cross-functional agile teams and client stakeholders. • Automate & Secure CI/… role. Essential qualifications: • You should have hands-on experience with cloud platforms such as AWS, Azure or GCP. • Strong proficiency in Python, SQL, Scala, Spark-SQL, JavaScript or PowerShell. • Proven ability to design and build data pipelines and workflow solutions. • Experience with data tools such as Databricks, Spark ...

Data Engineer Salary up to £70,000 + discretionary bonus Hybrid working model with collaborative office environment Work with Databricks, Spark Structured Streaming, Kafka (MSK), and AWS Apply online or contact Chelsea Hackett via ABOUT THE CLIENT Due to continued growth, we're seeking a skilled Data Engineer ...

best. Encouragement to be your authentic self at work by joining one of our vibrant employee networks-like Rise (Gender), Proud (LGBTQIA+), Culture, or Spark (Neurodiversity & Disability) - and connect with a community that celebrates and supports you. So, who are we? We're on a mission to make credit ...

platform role Strong hands-on experience with AWS (EC2, S3, RDS, Lambda, Redshift, Glue, Athena) Experience with real-time and batch data processing - Apache Flink, Kafka, Spark, or similar Proficiency in one or more of: Python, Java, Scala Experience with data modelling , ETL processes, and distributed systems Comfortable ...

Purpose of position Data sits at the heart of the company. This role ensures that Awin can fully leverage the data available across the group, enabling the development of robust reporting capabilities that support stronger ...

Senior Data Engineer 6 Month contract with extension Full-time Inside IR35 Hybrid 1 day every two weeks in the office Nottingham - NG1 4BX Join our client in embarking on an ambitious data transformation journey ...

solving complex challenges and improving data quality as the platform scales. ·The environment is modern and cloud based, with exposure to technologies such as Spark, Snowflake and BigQuery across AWS, GCP and Azure. ·You will have the opportunity to support and mentor other engineers, contribute to engineering standards … engineers What We Are Looking For ·Proven Python and SQL experience within production environments ·Experience delivering data transformation projects end to end ·Experience with Spark, Snowflake, BigQuery or similar technologies ·Solid experience working with AWS, GCP or Azure ·Comfortable working with complex, imperfect datasets ·Experience owning solutions from design ...