101 to 125 of 160 Remote/Hybrid PySpark Jobs

Phoenix enables digital transformation across the UK public sector, empowering organisations to innovate with cloud and hybrid infrastructures, data, AI, security and collaboration technologies. We are now hiring a Technical Consultant - Data & AI to join ...

Data Engineer in the United Kingdom to design, build, and maintain data pipelines on a modern AWS-native stack. You will use Spark/PySpark for distributed processing, Airflow for orchestration, and Terraform for infrastructure as code in a hybrid work arrangement with weekly travel to Newcastle office. ...

delivering insights for senior stakeholders. The role requires 5+ years of UK-based analytical experience with DAX/Power BI, SQL and Python/PySpark, plus strong communication, initiative and attention to detail. Three days per week in Hungerford offices. #J-18808-Ljbffr ...

pipelines and collaborate with cross-functional squads to enable GenAI applications and analytics initiatives. You will work with modern cloud platforms, SQL, Python and PySpark to optimise data flows, ensure data quality and support data-driven decision making across the business. #J-18808-Ljbffr ...

technical content in commercial terms for non-technical stakeholders, such as customers, sales and product teams Desirable B2B product experience Experience with Spark SQL, PySpark, databricks Experience with CausalAI modelling frameworks (e.g. dowhy, econml) Diversity & Inclusion Intent HQ is an equal opportunities employer with an ethos of commitment ...

growing Data & Analytics team in Belfast. This is a fantastic opportunity for a Data Engineer with experience in Databricks, AWS, Python and/or PySpark to join an organisation investing heavily in its data engineering, analytics and AI capabilities. The successful Data Engineer will play a key role … Spark, while contributing to a wider programme of data transformation and continuous improvement. Key requirements include 2+ years' Data Engineering experience, strong Python/PySpark and/or Databricks experience, and a good understanding of data warehousing and big data concepts. Right to Work Applicants must have the existing ...

hands-on data engineering role within a large-scale cloud data programme, responsible for building, maintaining, and troubleshooting data pipelines using Apache Spark, PySpark, Apache Airflow, and a broad suite of AWS services. You will apply strong analytical and engineering skills to deliver trusted, well-governed data assets … data programme - designing, building, and maintaining data pipelines that process large volumes of data across a modern AWS-native stack. Using Apache Spark and PySpark for distributed data processing, Apache Airflow for orchestration, and a range of AWS services for storage, compute, and analytics, you will help deliver reliable ...

Arbuthnot Latham is seeking a Senior Data Engineer to develop and maintain complex data systems that support the Bank's operations and reporting needs. You will work with the Technical Lead for Data Engineering to ...

with 8+ years of experience, focusing on scalable data pipelines, governance, and analytics platforms. The role requires deep AWS data services expertise, Python/PySpark coding, and collaboration with globally distributed teams to deliver impact for Fortune 1000 clients. #J-18808-Ljbffr ...

well as familiarity with software engineering best practices (such as version control, unit testing, CI/CD) and big data and cloud technologies (PySpark preferred). Experience training and deploying deep learning models in cloud environments (including GPU‐enabled workflows) is a strong advantage. What ...

work. The contract is initially 6 months with remote working. You will own ingestion, model deployment, evaluation, and CI/CD across environments, leveraging PySpark, Unity Catalog, and batch inference on Claude. #J-18808-Ljbffr ...

IR35 . Rate: £650 - £750 Location: Hybrid – 2/3 days per week on-site Contract: 6 months | Outside IR35 Key Skills: Data Lakehouse PySpark DBT Iceberg AWS Strong data engineering and pipeline development experience You’ll be responsible for designing, building and optimising scalable data pipelines and lakehouse ...

data modelling, semantic layers and Power BI delivery. You'll have the opportunity to: ·Design and build production-grade pipelines using Azure Databricks, Python, PySpark and SQL ·Develop scalable Lakehouse architecture using Delta Lake and Unity Catalog ·Build data and BI products from scratch and own them through … Claude and OpenRouter to support development, code review and documentation To succeed, you'll need: ·Strong production experience with Azure Databricks ·Advanced Python, PySpark and SQL skills ·Advanced Power BI, DAX and data-modelling experience ·Experience building and owning complex data or BI solutions end to end ·Confidence translating ...

query, validate and optimise data across cloud-based analytical platforms such as Athena, Redshift and Azure Synapse Build scalable data processing solutions using PySpark, Python and cloud-native orchestration services Implement data quality checks, validation processes, monitoring and logging to ensure trusted and reliable data delivery Support the performance … engineering, integration and analytics challenges Collaborate with experienced engineers, architects and data specialists in supportive, multidisciplinary teams Develop expertise across cloud-native data services, PySpark, SQL and modern engineering practices Access mentoring, knowledge sharing and development opportunities to help you grow your career Contribute to solutions that deliver measurable ...

using both Microsoft Fabric tools and the Databricks Lakehouse Platform to deliver clean, production-ready data for enterprise analytics. Job Requirements Strong proficiency in PySpark, Databricks SQL, T-SQL, and handling Delta Lake formats Hands‐on experience building production pipelines inside Databricks workspaces and Fabric capacities Practical knowledge … data processing. Build and maintain the Medallion Architecture silver & gold layer across shared storage. Write optimized transformations in Fabric Notebooks and Databricks clusters using PySpark and SQL. Configure data access, masking, and governance policies within Databricks Unity Catalog. Optimize Lakehouse table performance using Z-Order indexing, liquid clustering ...

strategy. At the heart of this is our Databricks data platform, and you will take ownership of building, optimising, and maintaining data pipelines using PySpark - orchestrating feeds from source systems through to our group data platform and taking technical ownership of all parts of the process.You will work closely … experience building and managing workloads on the Databricks platform, including Delta Lake, Unity Catalog, and Declarative Automation BundlesPySpark - proficiency in writing and optimising PySpark code for data transformation and processingAzure - solid experience working within the Azure ecosystem, including services such as Azure Data Factory, Azure Data Lake Storage ...

Vantage Data Centers is looking for a Mid‐Level Data Engineer in London to help build and scale the enterprise data platform. You'll design and maintain data pipelines using Python and Azure services, ensuring ...

prestigious UK client. The role centers on designing and building data platforms and guiding the transition to Microsoft Fabric, with SQL, Python/PySpark and Data Factory as core technologies. The position offers a flexible base with the role primarily home-based across the UK, with offices for collaboration ...

pipelines and multimodal models. You will collaborate with Applied Scientists, Data Engineers, PMs and business stakeholders to productionise solutions. Role requires strong Python, PySpark/Databricks experience, hands-on DL with PyTorch or TensorFlow, and a pragmatic, business-focused #J-18808-Ljbffr ...

visible role where you'll combine strong technical skills with commercial thinking to drive meaningful product improvements. Your Skills & Experience Strong SQL skills Python (PySpark experience is beneficial) Experience in Product Analytics Strong knowledge of A/B testing and experimentation Excellent statistical analysis skills, with exposure to modelling ...

visible role where you'll combine strong technical skills with commercial thinking to drive meaningful product improvements. Your Skills & Experience Strong SQL skills Python (PySpark experience is beneficial) Experience in Product Analytics Strong knowledge of A/B testing and experimentation Excellent statistical analysis skills, with exposure to modelling ...

high-performing engineering squad, owning technical challenges and driving best practices across the team. You’ll build scalable pipelines using Azure, Databricks and PySpark, collaborating with Product and Delivery to deliver reliable data platforms and business value. London-based with hybrid working conditions. #J-18808-Ljbffr ...

Northampton, UK. This hybrid role involves working 2 days a week in the office. The ideal candidate will have expertise in Bigdata technologies, including PySpark and AWS services, as well as strong communication and problem-solving skills. You will be expected to collaborate effectively within a diverse team while ...

month fixed-term contract with hybrid work (onsite 2 days per week). The role requires strong Snowflake experience, including Snowflake ML, plus PySpark and SQL skills. DBT experience is advantageous as you build and migrate data pipelines for programme use cases from Pre-Prod to Prod. You will ...

Hybrid, 3 days onsite). This 12-month fixed-term contract role focuses on building and supporting modern cloud-based data platforms using AWS, PySpark, and IaC. You will work with Terraform, GitLab CI/CD, and collaborate with engineers to deliver secure, scalable cloud solutions. You’ll join ...