51 to 71 of 71 Apache Spark Jobs in Central London

A-Level grades are included on your CV). Basic scripting knowledge in Python or Bash Excellent customer-facing skills You have a sales spark - while this role isn't a focussed sales role, this is required due to the nature of the role A motivated self-starter with More ❯

of MMM modelling Solid experience with Probabilistic Programming and Bayesian Methods Be an expert in mining large & very complex data sets using SQL and Spark Have in depth understanding of statistical modelling techniques and their mathematical foundations, Have a good working knowledge of Pymc and cloud-based data science More ❯

availability architectures Background creating reporting and reconciliation applications Undertsanding of OTC products with CDS, Interest Rate Swaps, Variance Swaps etc. needed Expertise with C++, Spark, Kafka would be hugely beneficial The key skillset is Python, but your expertise should extend to managing large datasets with PostgreSQL, and you should More ❯

availability architectures Background creating reporting and reconciliation applications Undertsanding of OTC products with CDS, Interest Rate Swaps, Variance Swaps etc. needed Expertise with C++, Spark, Kafka would be hugely beneficial The key skillset is Python, but your expertise should extend to managing large datasets with PostgreSQL, and you should More ❯

Cassandra). • In-depth knowledge of data warehousing concepts and tools (e.g., Redshift, Snowflake, Google BigQuery). • Experience with big data platforms (e.g., Hadoop, Spark, Kafka). • Familiarity with cloud-based data platforms and services (e.g., AWS, Azure, Google Cloud). • Expertise in ETL tools and processes (e.g., Apache More ❯

operational efficiency and maximize business value by confidently utilizing trustworthy data. What are we looking for? Great experience as a Data Engineer Experience with Spark, Databricks, or similar data processing tools. Proficiency in working with the cloud environment and various software’s including SQL Server, Hadoop, and NoSQL databases. … data assets and reports for business insights. Assist in engineering and managing data models and pipelines within a cloud environment, utilizing technologies like Databricks, Spark, Delta Lake, and SQL. Contribute to the maintenance and enhancement of our progressive tech stack, which includes Python, PySpark, Logic Apps, Azure Functions, ADLS More ❯

Design: Lead the end-to-end design of the Databricks Lakehouse architecture (Medallion architecture), including data ingestion patterns, storage layers (Delta Lake), processing frameworks (Spark), and consumption mechanisms. Technology Selection: Evaluate and recommend optimal Databricks features and integrations (e.g., Unity Catalog, Photon, Delta Live Tables, MLflow) and complementary cloud … platform. Required Skills & Experience Proven Databricks Expertise: Deep, hands-on experience designing and implementing solutions on the Databricks Lakehouse Platform (Delta Lake, Unity Catalog, Spark, Databricks SQL Analytics). Cloud Data Architecture: Extensive experience with Azure data services (e.g., Azure Data Factory, Azure Data Lake Storage, Azure Synapse) and More ❯

TensorFlow, PyTorch, or Scikit-learn for ML, and Pandas, PySpark, or similar for data processing. Experience designing and orchestrating data pipelines with tools like Apache Airflow, Spark, or Kafka. Strong understanding of SQL, NoSQL, and data modeling. Familiarity with cloud platforms (AWS, Azure, GCP) for deploying ML and More ❯

fields. Possess offensive and defensive thinking with an understanding of mainstream security threats and defense strategies. Proficient in data analysis tools such as SQL, Spark, Python. Excellent project management skills with experience in large-scale internet operations, microservice architecture, big data analysis, and security compliance is a plus. More ❯

with cutting-edge cloud technologies. Key responsibilities and primary deliverables Design, develop, and optimize end-to-end data pipelines (batch & streaming) using Azure Databricks, Spark, and Delta Lake. Implement Medallion Architecture to structure raw, enriched, and curated data layers efficiently. Build scalable ETL/ELT processes with Azure Data … analysts to validate and refine datasets for reporting. Apply DevOps & CI/CD best practices (Git, Azure DevOps) for automated testing and deployment. Optimize Spark jobs, Delta Lake tables, and SQL queries for performance and cost efficiency. Troubleshoot and resolve data pipeline issues proactively. Partner with Data Architects, Analysts More ❯

Senior Data Engineer/Data Analytics Engineer - Full Remote Working from anywhere in the UK SQL+Python+ETL+ Apache Airflow Our client is a global leading and fast growing high tech company: -Over 6,500 employees across 20+ offices; -300 Million+ active users on some of the platforms they developed; -Cutting … scalable data pipelines, ensure data quality, and support business decision-making with high-quality datasets. -Work across technology stack: SQL, Python, ETL, Big Query, Spark, Hadoop, Git, Apache Airflow, Data Architecture, Data Warehousing -Design and develop scalable ETL pipelines to automate data processes and optimize delivery -Implement and … manage data warehousing solutions, ensuring data integrity through rigorous testing and validation -Lead, plan and execute workflow migration and data orchestration using Apache Airflow -Focus on data engineering and data analytics Requirements: -5+ years of experience in SQL -5+ years of development in Python -MUST have strong More ❯

of Data Science Lead the data science strategy and team to deliver data science solutions e.g. retention, acquisitions and customer management using Python and Spark Lead the hiring to build a great pool of Data Scientists and Engineers for the team and support the recruitment activities of other data More ❯

Highlights: Spearheading the evolution of the company's data platform as it scales beyond MVP Building and maintaining scalable data pipelines using Python, Java, Spark, SQL, and more Partnering with cross-functional teams (Product, Finance, Ops, Customer Success) to deliver actionable insights and reliable data solutions Designing data models … environments Proficiency in Python (preferred), with experience in other languages like Java, Scala, or TypeScript Strong knowledge of cloud-based big data tools (AWS, Spark, EMR, Lambda, etc.) Excellent communication and problem-solving skills, with a collaborative mindset A passion for supporting SMEs through innovative, data-led technology Background More ❯

Join a leading multi-strategy hedge fund in London, where we leverage cutting-edge technology and data to drive investment decisions across diverse asset classes. We're looking for a skilled Data Engineer to play a crucial role in building More ❯

Role: Backend Python & AI Engineer Location: London | Hybrid Working (2 days in Office) An ambitious and fast-growing financial technology company on a mission to transform how people understand and interact with their personal finances. By combining intelligent technology with More ❯

Social network you want to login/join with: Senior Data Engineer - DV Cleared, London (City of London) Client: Fortice Location: London (City of London), United Kingdom Job Category: Other EU work permit required: Yes Job Views: 3 Posted: 16.06.2025 More ❯

Senior Data Scientist x3 days a week in South-West London About the Company Xcede are delighted to be working with a market leader in the entertainment space with one of the strongest Data Science programmes in its sector. With More ❯

Computer Science, Data Science, Mathematics, or related field. 5+ years of experience in ML modeling, ranking, or recommendation systems . Proficiency in Python, SQL, Spark, PySpark, TensorFlow . Strong knowledge of LLM algorithms and training techniques . Experience deploying models in production environments. Nice to Have: Experience in GenAI …/LLMs Familiarity with distributed computing tools (Hadoop, Hive, Spark). Background in banking, risk management, or capital markets . Why Join? This is a unique opportunity to work at the forefront of AI innovation in financial services . If you're ready to apply cutting-edge ML & GenAI More ❯

Principal Data Engineer, Consulting London Based You must be eligible for SC Clearance Role Overview The Principal Data Engineer will be responsible for designing and implementing cloud-based data solutions using a range of AWS services. This role involves working More ❯

Bayesian Data Scientist Location: London (Hybrid Working) Contract Type: Initial 12 month contract + potential to extend long-term due to 3/4 year project scope. Start Date: ASAP We have an excellent opportunity for a Bayesian Data Scientist More ❯

Social network you want to login/join with: Marketing Mixed Modelling Data Scientist, London (City of London) Client: Lorien Location: London (City of London), United Kingdom Job Category: Other EU work permit required: Yes Job Views: 2 Posted: 16.06.2025 More ❯