101 to 125 of 317 Apache Spark Jobs in London

application resiliency, and securityPractical cloud-native experiencePreferred Qualifications, Capabilities, and Skills:Experience with modern data technologies such as Databricks or SnowflakeHands-on experience with Spark/PySpark and other big data processing technologiesDemonstrated proficiency in software applications and technical processes within disciplines such as data engineering, cloud, artificial intelligence ...

business value in collaboration with an Account Executive and a Senior Solutions Architect. Gain excitement from clients about Databricks through hands-on evaluation and Spark programming, integrating with the wider cloud ecosystem and 3rd party applications. Contribute to building the Databricks technical community through engagement at workshops, seminars ...

application resiliency, and securityPractical cloud-native experiencePreferred Qualifications, Capabilities, and Skills:Experience with modern data technologies such as Databricks or SnowflakeHands-on experience with Spark/PySpark and other big data processing technologiesDemonstrated proficiency in software applications and technical processes within disciplines such as data engineering, cloud, artificial intelligence ...

prompt/version control, and Responsible AI/MRM complianceEnterprise AI Integration & DataAPI- and event-driven integration of AI into enterprise workflowsData platforms: Databricks, Spark, Snowflake; streaming via KafkaBackend & Distributed SystemsLanguages: Python (expert), Java/Spring Boot (enterprise standard), Go (plus)Architecture: Microservices, domain-driven design, event-driven systemsAPIs ...

Data Engineer (Python SQL Spark Azure Databricks) London to 160kAre you a tech savvy Data Engineer with a first class education? You could be progressing your career working on complex and challenging systems at a Hedge Fund with over $17 billion under management. What … Python or C# and SQL, experience with version control and contributing to a shared codebasesYou have experience with modern data tools and technologies including Apache Spark and Azure Databricks preferredYou have a strong knowledge of data management principles and best practicesYou have experience with data analysis, visualisation tools ...

complex pipelines and data models in a cloud environment Strong proficiency in SQL; solid Python and/or PySpark capabilityDemonstrable experience with Databricks, Apache Spark, and Delta Lake architectureProven ability to design and own enterprise-grade canonical data models across multiple upstream source systemsExperience integrating data from APIs ...

systems Comfortable building from scratch in a fast-moving, product-led environment Experience with vector databases and vector search in modern AI systems Desirable: Spark, Airflow, Kafka, Elasticsearch/OpenSearch, event-driven architectures Cloud experience (AWS, GCP or Azure), GCP is a plus Why join High impact and ownership ...

systems Comfortable building from scratch in a fast-moving, product-led environment Experience with vector databases and vector search in modern AI systems Desirable: Spark, Airflow, Kafka, Elasticsearch/OpenSearch, event-driven architectures Cloud experience (AWS, GCP or Azure), GCP is a plus Why join High impact and ownership ...

model deployment using MLOps frameworks; Strong Python and SQL programming skills, with experience in PyTorch, TensorFlow, and Hugging Face; Experience with Databricks, Spark, and other data platforms and big data frameworks; Excellent communication skills for engaging C-level stakeholders and aligning technical outcomes with business value; Nice to have ...

large-scale datasetsPreferred QualificationsKnowledge or interest in investment banking or financial instrumentsExperience with big data concepts, such as Lakehouse, ETL data pipelines (e.g. Spark, AWS Glue)Experience with near real time and event-based systems like KafkaABOUT GOLDMAN SACHSAt Goldman Sachs, we commit our people, capital and ideas ...

machine learning, model development, and data engineering, with an appreciation of responsible AI principles.Experience with cloud environments (Azure, AWS, GCP) and tools such as Spark, Hive, and Redshift.Demonstrated ability to lead cross-functional teams and mentor junior practitioners.Ability to communicate complex technical concepts clearly to non-technical audiences ...

learning, model development, and data engineering, with an appreciation of responsible AI principles. Experience with cloud environments (Azure, AWS, GCP) and tools such as Spark, Hive, and Redshift. Demonstrated ability to lead cross-functional teams and mentor junior practitioners. Ability to communicate complex technical concepts clearly to non-technical ...

scale datasets Preferred Qualifications Knowledge or interestin investment banking or financial instruments Experience with big data concepts, such as Lakehouse, ETL data pipelines (e.g. Spark, AWS Glue) Experience with near real time and event-based systems like Kafka Goldman Sachs Highlights At Goldman Sachs, we commit our people, capital ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn, Facebook. At Databricks, we strive to provide comprehensive benefits and perks ...

Data Intelligence Platform working against their real data and workloads, not slideware. Meet technical buyers on their own ground across modern data engineering (Spark, Delta, streaming), machine learning, and Generative AI, and integrate cleanly with their existing cloud and open-source stack. Move at start-up speed: qualify quickly ...

monitoring, controls and auditability) and how to embed them pragmatically within client delivery.Familiarity with large-scale data processing and storage technologies (e.g., SQL, Spark).Excellent communication and stakeholder management skills, including the ability to translate complex technical concepts for diverse business and technical audiences.Connect to your business - Technology ...

efficiency, and cost-effectiveness. o Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: o Implement complex data transformations using Spark (PySpark or Scala) and other relevant technologies. o Develop and maintain data processing logic for cleaning, enriching, and aggregating data. o Ensure data consistency … accuracy throughout the data life cycle. Azure Databricks Implementation: o Work extensively with Azure Databricks Unity Catalog, including Delta Lake, Spark SQL, and other relevant services. o Implement best practices for Databricks development and deployment. o Optimise Databricks workloads for performance and cost. o Need to program using ...

security controls. Monitor, maintain and optimise data platforms to ensure performance and reliability. Skills and Experience Required: ETL development using Python or similar languages Apache Spark, NiFi, or Kafka Relational (PostgreSQL, MySQL) and NoSQL (MongoDB, Cassandra) databases AWS and cloud-based data services Palantir Foundry Stakeholder Engagement ...

project stakeholders; Strong problem-solving skills; Ability to refine problem statements and propose solutions considering effort, impact, and scalability trade-offs; Nice to have: Apache Spark, Iceberg, Kafka, dbt, Scikit-Learn, XGBoost, PyTorch, MLFlow, GraphFrames, Ray, AWS S3, EMR, SageMaker, Lakeformation, Terraform, Docker, GitHub CI/CD, Knowledge ...

internal knowledge Competencies and Behaviours: 3+ years experience in data platform engineering, cloud engineering, or similar roles Strong hands-on experience with Databricks, including Apache Spark, Delta Lake, Workflows Proven experience designing and deploying data platforms on AWS and/or Azure (e.g. ADLS, S3, VNet/ ...

tools, and emerging technologies. \* Develop reference architectures, solution blueprints, and best-practice playbooks for Databricks implementations. \* Architect scalable ETL/ELT pipelines using PySpark, Spark SQL, Delta Live Tables, and Databricks Workflows. \* Implement performance optimization strategies for notebooks, clusters, job orchestration, and data storage. \* Guide teams in building curated ...

Python skillsExperience with relational and NoSQL databasesHands-on experience with vector databasesGood understanding of data modelling, performance and storage architectureExperience with technologies such as Spark, Airflow, Kafka or Elasticsearch/OpenSearchExperience with AI/ML platforms, cloud infrastructure or event-driven architectures would be useful ...

data lake/warehouse/hub built in GCP. You are confident using the full suite of Google data products, IAC, CI/CD, Spark and Kafka. Our core toolbox includes Google Cloud Big Data technologies, Scala, Java & Python, Jenkins amongst others. We value first principles reasoning to select ...

preparation. Machine learning and statistical methods, including model validation. Data analytics and visualisation techniques. Processing large datasets using batch or streaming tools such as Apache Spark. Data acquisition and fusion approaches. Cloud platforms (ideally AWS) and cloud-based data science solutions. DataOps principles and practices. Structured and unstructured databases. ...

economics, or commercial analytics (e.g. willingness to pay, price elasticity, share of wallet) Stakeholder management and storytelling with data Snowflake or AWS Databricks or Spark SAP, Salesforce, or ERP systems Power BI What Qualification Do You Need? A Bachelor's degree in a technical or analytical subject such ...