76 to 100 of 119 Permanent PySpark Jobs

London-based programme focused on data platforms, analytics engineering and Lakehouse solutions. You will design, build and support enterprise-scale data platforms with Spark, PySpark, SparkSQL and Microsoft Fabric. The role requires hands-on coding, data governance, ingestion and API integration capabilities, plus a passion for modern analytics ...

qualifications include proficiency in site reliability culture, incident management, and tools like AWS and Databricks. Candidates should also demonstrate strong skills in Python or PySpark, as well as AI-assisted software development. #J-18808-Ljbffr ...

visible role where you'll combine strong technical skills with commercial thinking to drive meaningful product improvements. Your Skills & Experience Strong SQL skills Python (PySpark experience is beneficial) Experience in Product Analytics Strong knowledge of A/B testing and experimentation Excellent statistical analysis skills, with exposure to modelling ...

visible role where you'll combine strong technical skills with commercial thinking to drive meaningful product improvements. Your Skills & Experience Strong SQL skills Python (PySpark experience is beneficial) Experience in Product Analytics Strong knowledge of A/B testing and experimentation Excellent statistical analysis skills, with exposure to modelling ...

outputs, and adherence to resiliency and security expectations; ability to guide peers on safe and effective usage within team practices. Proficiency in Python or PySpark for AI/ML modeling. Must be able to reduce toil by building new tools to automate repeated tasks. Hands‐on experience in system ...

analytics capabilities. We welcome candidates from all backgrounds to apply, and we are committed to creating a diverse workforce.Key Responsibilities and Skills: - Proficiency in PySpark for effective data manipulation and transformation. - Experience with Microsoft B.I and DataBricks for advanced analytics solutions. - Strong problem-solving abilities to address complex challenges. ...

global organization through resourcing/location strategy. Experience and Qualifications Proven track record delivering solutions in complex organizations. Experience with AWS, Databricks, DBT, PySpark, React, JavaScript, Terraform, etc. Fast learner, thrives in ambiguity, translates vision into product scope. Passion for automation and user experience innovation. Builds high‐performing teams ...

structured and unstructured datasets Validate large-scale data ingestion, transformation, and processing workflows Ensure data integrity, transformation accuracy, reconciliation, and performance under load Oversee PySpark-based data validation and interrogation activities on AWS EMR Support testing and monitoring of workflows orchestrated through Apache Airflow Drive root cause analysis … DynamoDB, AWS CloudWatch, AWS IAM, Python, SQL, Java, Bash, GitLab CI/CD, Jupyter Notebooks, Apache Spark/PySpark, Terraform, Docker Key Skills Strong proficiency in Python, SQL, Java, and Scripting languages such as Bash Hands-on experience testing Big Data platforms and Data Lake solutions Strong experience with ...

play a key role in advancing our data capabilities and driving innovation. Job Responsibilities: Develop workflows and ELT data pipelines using Python, Spark/PySpark, and Databricks Onboard enterprise datasets into Palmos, including ingestion, transformation, and validation of data assets Build, test, and maintain scalable data pipelines and data … coding standards; contribute learnings and reusable patterns to improve broader team effectiveness Required Qualifications, Capabilities, and Skills: Hands-on experience with Databricks, Spark/PySpark, Python, and SQL Experience developing and maintaining data pipelines and data processing systems Understanding of the data lifecycle, including ingestion, transformation, storage, and consumption ...

accurate documentation, lineage and operational run books to support ongoing platform support Key Responsibilities Develop and maintain data pipelines using Azure Databricks (Python, PySpark and SQL) Implement ingestion and transformation across Bronze, Silver and Gold layers using Delta Lake Support and operate Azure Databricks and Azure Synapse platforms, including … pipelines and code reviews What you'll need to succeed Essential Proven experience as a Data Engineer Strong hands-on experience with AzureDatabricks, Python, PySpark and SQL Experience supporting Azure data platforms in production Understanding of medallion architecture and Delta Lake Desirable Experience with Azure Synapse Analytics Experience with ...

Data Engineer £54-59,000 + bonus Hybrid Working – 1 day on-site per week West Midlands based I'm recruiting for a Data Engineer to join an established data team, working on the development ...

JPMorgan Chase & Co. in the Corporate Sector’s agile data engineering team is seeking a Lead Software Engineer to promote the development of a trusted Global KYC and Risk Assessment Data Platform. You will lead ...

some of the following predictive modelling techniques preferred; GAMs, Neural Nets and Clustering Experience in statistical and data science programming languages (e.g. R, Python, PySpark, SAS, SQL) A good quantitative degree (Mathematics, Statistics, Engineering, Physics, Computer Science, Actuarial Science) Proficient in using WTWs Radar software Proficient at communicating results ...

Senior Data Scientist Welwyn Garden City, Hertfordshire or Slough, Berkshire | Hybrid (2 Days Office) | Python | SQL | PySpark | Azure | Databricks | Machine Learning | Statistics | Time Series Forecasting | Propensity Models Role: Senior Data Scientist, Lead Data Scientist, ML Scientist, AI Data Scientist, Statistical Data Scientist, Predictive Analytics Key Skills: Senior Data Scientist … Data Scientist, Machine Learning, Artificial Intelligence, Predictive Analytics, Statistical Modelling, Python, SQL, PySpark, Azure, Databricks, MLflow, GitHub Actions, CI/CD, Time Series Forecasting, Propensity Modelling, Feature Engineering, Data Engineering, Azure Machine Learning, Azure Data Platform, Experiment Design, A/B Testing, Hypothesis Testing, Predictive Modelling, Customer Analytics, Marketing ...

knowledge, with the ability to write stable, scalable and maintainable code. Experience with data science Python libraries such as Sckit-learn, Pandas, NumPy, PyTorch, PySpark, LightGBM. Have worked with a cloud service, such as AWS. Familiarity developing Infrastructure as code (e.g Terraform, cloudformation). Have some experience with data … engineering, building data pipelines with PySpark, SQL (E.g in Databricks, Glue) to power machine learning applications. Comfortable working with Docker and containerised applications. Experience leveraging AI native engineering tooling. Passion for building products that meet customer needs and business objectives. Strong sense of responsibility and a track record ...

Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer) Our client is a global innovator and world leader … with AWS services such as AWS Glue, AWS Lambda, AWS S3, AWS Redshift, and Amazon EMR. Proven expertise in Python, SQL, Pipeline Orchestration and PySpark is also expected, as is experience with data lakehouse architectures and data warehousing solutions. Agile experience is also key, as are excellent communication skills ...

Responsibilities Design, develop and maintain modern data platform solutions. Build, optimise and manage data ingestion pipelines. Develop data transformation and modelling solutions using Python, PySpark and SQL. Support the implementation of data lakes, data warehouses and modern analytics architectures. Ensure high standards of data quality, security and performance. Work … date with emerging technologies. Requirements Previous experience working as a Data Engineer or within a similar role. Strong experience with Python or PySpark . Experience with cloud data platforms such as Microsoft Fabric, Databricks or Snowflake . Knowledge of SQL and data transformation techniques. Experience building and maintaining data ...

existing pipelines. Working within a growing data team, you'll design scalable data models, build robust ELT pipelines in Databricks using SQL, Python and PySpark, and integrate data from multiple internal and third-party systems. You'll collaborate closely with Analytics Engineers to ensure data is reliable, well-governed … architecture and help define long-term data standards, rather than simply delivering against predefined requirements. You'll need experience with: Databricks, SQL, Python and PySpark Building and optimising ELT/data pipelines Data modelling, lakehouse architecture and modern data platforms Azure data services API and third-party system integration ...

Senior Databricks Architect Technology: Databricks (Spark, PySpark/SQL) and data lake architectures. Location: London, UK. Compensation: Competitive (including bonus). Job Description We are looking for a Data Architect to design, build, and operate scalable data pipelines and data products, enabling a modern data mesh architecture. The role … integrating legacy systems with cloud-native platforms to support analytics, reporting, and domain-owned data products. Primary Skills Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures. Hands‐on experience with streaming technologies, especially Kafka/Confluent Kafka. Experience integrating legacy data sources such ...

Senior Databricks Architect - London (Hybrid) - Databricks - Spark - PySpark - AWS - Up to £115,000 + Bonus Our client, a large-scale organisation undergoing significant investment in data and cloud technologies, is seeking an experienced Senior Databricks Architect to join its expanding Data & AI practice. This is an exciting opportunity … time data pipelines from legacy and modern source systems Implementing real-time and event-driven data processing solutions Developing data transformation frameworks using Spark, PySpark and SQL Designing Lakehouse architectures using Databricks and Medallion Architecture principles Creating scalable, reusable data products to support modern data operating models Integrating data ...

**Take the lead on meaningful, high-impact projects as a Senior Data Engineer.** We are seeking a Senior Data Engineer to join a growing organisation based in London, offering a hybrid work model. This role ...

New Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time ...

Principal Consultant - Lead Data Analyst/Data Modeller Company: Transform Together Contract: 6-month Fixed Term Contract, with option to extend or become a permanent member of the team Compensation: OTE £90,000 Location: Hybrid ...

adoption of modern data mesh principles across complex enterprise environments. What You'll Be Doing Architect and deliver modern data solutions using Databricks, Spark, PySpark and SQL Design scalable batch and real-time data pipelines that ingest data from legacy and modern platforms Lead the development of cloud-based … making Provide technical leadership and architectural direction on large-scale transformation programmes Essential Experience Strong hands-on expertise with Databricks Extensive experience using Spark, PySpark and SQL Proven track record designing and implementing data lake architectures Experience building both batch and streaming data pipelines Strong knowledge of Kafka Good ...

data processing solutions Work with modern data platforms such as Microsoft Fabric, Databricks, or similar technologies Build and optimise data solutions using Python, Spark, PySpark, and/or SQL Support data integration, transformation, and performance optimisation Collaborate with stakeholders to ensure high-quality, reliable data architecture Essential Skills & Experience … Hands-on experience with Microsoft Fabric, Databricks, or equivalent modern data platforms Strong coding experience in Python and/or Spark/PySpark Solid SQL skills and experience working with structured datasets Desirable Experience Knowledge of relational database design , normalisation , and data modelling Experience designing efficient, scalable data architectures ...