226 to 250 of 321 Permanent PySpark Jobs

Function Data Analytics/Warehousing & Business Intelligence Experience 5-10 years Location United Kingdom - Edinburgh, London, Manchester Skills Python & SQL: Advanced Python (PySpark GlobalLogic is seeking a Data & AI Architect working in our UK & Ireland Go to Market Team to drive pipeline growth and lead enterprise transformation pursuits across … mindset, with experience working across geographies including India, East Europe and North America. Proven track record of acceleration of Business growth Deep expertise in PySpark/Python, Advanced SQL, data modeling, batch/real-time streaming, and CI/CD pipelines (Git, Terraform, Databricks Asset Bundles). Deep knowledge ...

Data Engineer in the United Kingdom to design, build, and maintain data pipelines on a modern AWS-native stack. You will use Spark/PySpark for distributed processing, Airflow for orchestration, and Terraform for infrastructure as code in a hybrid work arrangement with weekly travel to Newcastle office. ...

supporting the Intelligence Community or Department of Defense environments Experience with Python and working with databases Experience with big data frameworks such as Spark, PySpark, or Elastic Search Experience with data visualization platforms such as Kibana, Foundry Workshop, or Palantir Knowledge of secure coding practices and development in classified ...

Pool codebase to Databricks, delivering parity or improved performance and ensuring data accuracy. You will refactor ~72 T-SQL procedures, optimise Spark/PySpark queries and validate datasets for downstream consumption, addressing architecture differences between Synapse and Databricks. #J-18808-Ljbffr ...

will work on production-grade pipelines, ensure idempotent processing, monitor systems, and implement automated deployment and handover practices. This role requires strong Databricks, PySpark, Python and SQL skills in a production environment. #J-18808-Ljbffr ...

team on an 18-month fixed-term contract. You will design, build, and maintain cloud-native data solutions, pipelines, and lakehouse components using Python, PySpark, and AWS services. The role is primarily remote with a monthly requirement to visit the Redditch office. Strong SQL, Linux, and version control experience ...

seeking a Data Scientist to shape data-driven decisions across customer experience, pricing and operations. You will build and deploy ML models using Python, PySpark, SQL and Azure Databricks, profile large datasets and translate insights into actions for stakeholders. You will collaborate with data engineers and ML engineers ...

/RFM segmentation, and value estimates, delivering production-ready insights and dashboards. The ideal candidate has strong SQL/Python, experience with Databricks/PySpark, data governance, and familiarity with Delta #J-18808-Ljbffr ...

balance of on-site and hybrid working arrangements. Ideal candidates have hands-on experience with Azure data services, strong SQL and Python/PySpark skills, and a passion for engineering best practices, governance, and performance tuning. #J-18808-Ljbffr ...

developed and sold analytical propositions Degree, MSc or PhD in data science, mathematics, OR, physics or statistics Hands-on credibility with Python, SQL, Databricks, PySpark, Palantir Foundry or R Security: British Citizenship or 5+ years' continuous UK residency required. The package: technical career progression, training budget, hybrid working, pension ...

ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark code repos - to building user-facing front-end applications and widgets in TypeScript or REACT Client Advisory & Translation: Sit directly alongside clients, distinguish their ...

ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark code repos - to building user-facing front-end applications and widgets in TypeScript or REACT Client Advisory & Translation: Sit directly alongside clients, distinguish their ...

ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark code repos - to building user-facing front-end applications and widgets in TypeScript or REACT Client Advisory & Translation: Sit directly alongside clients, distinguish their ...

e.g. Mathematics, Statistics, Computer Science). Nice to Have: Familiarity with production environments, MLOps, or data pipelines. Experience working with large-scale data using PySpark or equivalent distributed data processing tools. Experience in gaming, e-commerce, or subscription-based products. Benefits: Discretionary bonus opportunity Private Medical Insurance Dental Scheme ...

will need for success****Technical knowledge and experience:** * Proven experience using Databricks (essential)* Strong programming skills in Python (essential)* Experience working with: + PySpark + Large-scale data processing environments + Complex behavioural datasets* Experience cleaning, preparing and processing: + Large datasets + Real-world data containing inconsistencies ...

will need for success****Technical knowledge and experience:** * Proven experience using Databricks (essential)* Strong programming skills in Python (essential)* Experience working with: + PySpark + Large-scale data processing environments + Complex behavioural datasets* Experience cleaning, preparing and processing: + Large datasets + Real-world data containing inconsistencies ...

will need for success****Technical knowledge and experience:** * Proven experience using Databricks (essential)* Strong programming skills in Python (essential)* Experience working with: + PySpark + Large-scale data processing environments + Complex behavioural datasets* Experience cleaning, preparing and processing: + Large datasets + Real-world data containing inconsistencies ...

role focuses on migrating data pipelines to the cloud, stabilising environments, and implementing robust error handling and production support patterns. Strong Databricks, SQL and PySpark skills are essential, with experience in legacy ETL tools and cloud migrations. The engineer will repoint dependencies, ensure data integrity, and deliver reusable solutions ...

/Computing or equivalent, 5+ years in Data Engineering with 3 years in a technical lead role, and hands-on experience with Azure Databricks, PySpark, #J-18808-Ljbffr ...

hands-on data engineering role within a large-scale cloud data programme, responsible for building, maintaining, and troubleshooting data pipelines using Apache Spark, PySpark, Apache Airflow, and a broad suite of AWS services. You will apply strong analytical and engineering skills to deliver trusted, well-governed data assets … data programme - designing, building, and maintaining data pipelines that process large volumes of data across a modern AWS-native stack. Using Apache Spark and PySpark for distributed data processing, Apache Airflow for orchestration, and a range of AWS services for storage, compute, and analytics, you will help deliver reliable ...

driven patterns). Implement secure authentication, authorization, rate limiting, and multi-tenant access controls. Data Engineering & Pipeline Development Design and maintain data pipelines using PySpark and Databricks, following the medallion architecture (Bronze/Silver/Gold) for structured data transformation and quality. Build and optimize ETL/ELT workflows … architectures. Proficiency with SQL and NoSQL databases (PostgreSQL, DynamoDB, Redis, MongoDB) and familiarity with lakehouse platforms. Experience with or strong willingness to work in PySpark and Databricks, including the medallion architecture (Bronze/Silver/Gold). Hands-on experience with Docker, Kubernetes, CloudFormation, and cloud platforms ...

requirements into scalable data solutions. Key Responsibilities Design scalable enterprise data models and lakehouse architectures Build production-grade data pipelines using SQL, Python/PySpark and Databricks Implement data governance, security and access controls through Unity Catalog Work directly with business stakeholders to understand and prioritise requirements Establish data … data engineering and advanced data modelling Hands-on expertise in Databricks, Delta Lake, Unity Catalog and Databricks Workflows Production experience with SQL, Python/PySpark and dbt and/or Spark Declarative Pipelines Strong understanding of data governance, security and access-control design Excellent stakeholder-management and business-communication ...

bonus and an extensive benefits package. What you'll be doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape enterprise … help mature a growing data function. What you need to bring “Senior” level experience in data engineering, with strong hands-on Databricks skills (PySpark, Spark SQL, Delta Lake, etc) Advanced SQL and Python coding skills. A track record of building and optimising enterprise-scale data pipelines and ETL/ ...

bonus and an extensive benefits package. What you'll be doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape enterprise … help mature a growing data function. What you need to bring “Senior” level experience in data engineering, with strong hands-on Databricks skills (PySpark, Spark SQL, Delta Lake, etc) Advanced SQL and Python coding skills. A track record of building and optimising enterprise-scale data pipelines and ETL/ ...

bonus and an extensive benefits package. What you'll be doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape enterprise … help mature a growing data function. What you need to bring “Senior” level experience in data engineering, with strong hands-on Databricks skills (PySpark, Spark SQL, Delta Lake, etc) Advanced SQL and Python coding skills. A track record of building and optimising enterprise-scale data pipelines and ETL/ ...