126 to 150 of 222 PySpark Jobs

data platforms. Responsibilities Design, develop and maintain scalable data pipelines using Microsoft Fabric, Azure Databricks and Azure Synapse. Develop ETL/ELT solutions using PySpark and SQL. Build and optimise data integration solutions using Azure Data Factory and Microsoft Fabric. Design scalable lakehouse and data warehouse solutions. Optimise data … engineering standards. Troubleshoot production issues and continuously improve platform performance. Requirements Strong commercial experience as a Data Engineer (5+ years). Strong experience with PySpark . Advanced SQL skills. Experience with Microsoft Fabric , Azure Databricks and/or Azure Synapse Analytics . Experience building data pipelines using Azure Data ...

teams to deliver trusted datasets, performant ETL/ELT pipelines, and well-governed data products. The role emphasizes batch/streaming pipelines, Spark/PySpark, Delta Lake, governance and security, with CI/CD and collaboration across environments. #J-18808-Ljbffr ...

junior engineers while translating Vision and Data Strategy into IT solutions and driving delivery across programs. The role requires hands-on work with Databricks, PySpark, Python and SQL, with a focus on data modeling, integration and cloud data services. #J-18808-Ljbffr ...

architecture experience. Dimensional data modelling experience. Kimball/Inmon Azure Data engineering with exposure to Synapse, Databricks, Data Factory Azure SQL. Python Scripting for Pyspark C# Experience Experience with TDD and Unit Testing. Desirables - Experience working on Multi Cloud Solutions Azure Integration experience with Azure Function Apps/Logic ...

architecture experience. Dimensional data modelling experience. Kimball/Inmon Azure Data engineering with exposure to Synapse, Databricks, Data Factory Azure SQL. Python Scripting for Pyspark C# Experience Experience with TDD and Unit Testing. Desirables - Experience working on Multi Cloud Solutions Azure Integration experience with Azure Function Apps/Logic ...

ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark code repos - to building user-facing front-end applications and widgets in TypeScript or REACTClient Advisory & Translation: Sit directly alongside clients, distinguish their goals ...

ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark ark code repos - to building user-facing front-end applications and widgets in TypeScript or REACTClient Advisory & Translation: Sit directly alongside clients, distinguish their ...

ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark ark code repos - to building user-facing front-end applications and widgets in TypeScript or REACTClient Advisory & Translation: Sit directly alongside clients, distinguish their ...

promote best practice across the analytics function. Independently own projects from discovery through to delivery. Skills & Experience Strong SQL skills. Python and/or PySpark experience. Experience within Product Analytics or Digital Analytics. Strong understanding of experimentation and A/B testing. Good grounding in statistics and analytical methodologies. ...

harness data.What we expect from you Degree in Statistics, Mathematics, Physics, Economics, or a related quantitative fieldStrong programming skills — Python and SQL are essential; PySpark experience is highly advantageousExperience with version control tools (e.g. GIT)Solid understanding of analytical technologies, tools, and techniquesExcellent logical thinking and problem‐solving abilitiesStrong ...

What we expect from you Degree in Statistics, Mathematics, Physics, Economics, or a related quantitative field Strong programming skills - Python and SQL are essential; PySpark experience is highly advantageous Experience with version control tools (e.g. GIT) Solid understanding of analytical technologies, tools, and techniques Excellent logical thinking and problem ...

unlock business value. You will collaborate with data scientists, analysts and software engineers, implement governance and security, and contribute to engineering standards. Strong PySpark and SQL skills, plus experience with cloud platforms are essential for success. #J-18808-Ljbffr ...

engineering is done across the organisation. Skills & Experience Strong hands‐on experience with Azure data platforms Advanced SQL skills Commercial experience using Databricks and PySpark Proven background building and maintaining scalable data pipelines #J-18808-Ljbffr ...

understand the 15/60 PM counter granularity and able to write codes for aggregation Build and optimize distributed data processing jobs using PySpark on AWS EMR with deployment of these jobs on Data warehouse platforms like Amazon Redshift & ClickHouse Work with Amazon MSK (Kafka) for real‐time data ...

clientsFull SDLC process experienceExcellent communications skills, both written and verbalBonus Points:Experience with the Go Lang eco-system tools and librariesExperience with Pandas and PySpark libraries would be a plusTechnical experience with Databricks or any similar Delta Lake platforms.Experience working with large datasetsExperience with AWS cloud deployments and APIExperience ...

Cloud Data Engineer About the Job you are considering: We are seeking an experienced Cloud Data Engineer with expertise in AWS, Snowflake, dbt, PySpark, and SQL to design, build, and maintain scalable cloud-based data platforms and analytics solutions. The ideal candidate should have strong experience in cloud data … data ingestion, transformation, validation, and reporting. Develop and maintain dbt models, tests, snapshots, macros, and documentation. Create high-performance data transformation solutions using PySpark and SQL. Design and optimize Snowflake data warehouse solutions. Integrate data from multiple sources including databases, APIs, cloud storage, and third‐party systems. Implement data ...

troubleshooting, with the ability to think beyond routine approaches to solve technical problems.Design, develop, and maintain scalable data pipelines and processing workflows using Python, PySpark, SQL, and Databricks on AWS, processing and transforming large-scale financial datasets for analytics and reporting.Develop fact and dimension data models for reporting … Code).Required qualifications, capabilities, and skillsProven experience in data management, ETL/ELT pipeline development, and large-scale data processing.Proficiency in SQL, Python, and PySpark, with experience in query optimization and performance tuning.Hands-on experience with data lake platforms (Databricks, Apache Spark, or similar).Experience with AWS cloud services ...

code backing our platform Qualifications: BS in Computer Science/Engineering (or related career field) preferred Strong Data Engineering background Experience with Spark, Pyspark, and/or Pandas Extensive experience coding/programming in: Python SQL, R or Similar Strong understanding of algorithms and data structures as they pertain ...

experience with joining, analysing, manipulating commercial and regulatory data for visualisation (Tableau) and apps Demonstrable experience in utilising data analytics tools and libraries (Pandas, PySpark, etc) Understanding of financial markets Experience in applying machine learning techniques to market data Experienced in developing user-friendly analytical products, e.g self-service ...

solutions Technical modelling: Experience building models on both static and time series data, including propensity and forecasting models Coding skills: Advanced SQL, Python and PySpark skills, built on solid software development principles Stakeholder management: Ability to work with both technical and non-technical stakeholders, with strong communication skills ...

e.g. Mathematics, Statistics, Computer Science). Nice to Have: Familiarity with production environments, MLOps, or data pipelines. Experience working with large-scale data using PySpark or equivalent distributed data processing tools. Experience in gaming, e-commerce, or subscription-based products.Benefits: Discretionary bonus opportunityPrivate Medical InsuranceDental Scheme25 days holiday ...

business acts on.Fluency with large, complex behavioural datasets and the craft to work with them at scale: Python, SQL, and distributed processing (e.g. PySpark), plus standard ML tooling as the work requires.Excellent stakeholder communication: you can make a rigorous causal argument land with a non-technical commercial audience ...

data platforms, analytics engineering, and modern Lakehouse solutions. The client is looking for a hands‐on engineering professional with strong Microsoft Fabric, Spark, PySpark and SparkSQL expertise, capable of designing, building and supporting enterprise‐scale data platforms. Start Date: ASAP Duration: 3 Months Initially Pay Rate: Competitive IR35 Status … Outside IR35 Location: London (1 day per week onsite, remainder remote) The Role: The core requirement is strong Lakehouse expertise, particularly Spark, PySpark, and SparkSQL. Hands‐on experience in low‐code is essential. Data & Analytics Expertise: Data architecture (Lakehouse, Medallion, Kimball, 3NF). Data ingestion and processing. Data quality ...

with architects, engineers, and analysts to deliver secure, scalable, and high-performing migration solutions, leveraging technologies such as AWS Glue, Apache Iceberg, Python/PySpark, SQL, and YAML-based configurations.You will thrive in a collaborative, client-facing environment, with a passion for solving complex data challenges, ensuring delivery excellence … including AWS Glue and Apache IcebergValidate data feed pipeline migrations transitioning to new AWS Data Lakehouse architecturesTest pipelines underpinned by:AI ETL acceleratorsPython/PySpark transformationsSQL-based logicYAML configuration-driven orchestrationExecute and validate:Initial bulk data loadsSubsequent incremental/delta migrationsDevelop and run SQL-based validation and reconciliation queries ...

designing, developing and maintaining cutting-edge data solutions within Microsoft Fabric. You'll build and optimise data pipelines, lakehouses and data warehouses, using PySpark, Python, T-SQL and DAX to deliver scalable, high-performing solutions that drive business intelligence and analytics. Working closely with stakeholders across the business … years' experience in Data Engineering and hands-on experience with Microsoft Fabric, Databricks, Snowflake or similar cloud platforms. You'll have strong Python/PySpark skills, experience integrating with APIs, and a background in Agile development. If you're a detail-oriented problem solver with excellent analytical skills ...