PySpark Jobs

76 to 100 of 161 PySpark Jobs

Expert IT Solution Architect - ML/AI

Upper Marlboro, Maryland, United States
IT
in Azure Cloud technologies e.g., ML/OPS, ML Flow, Azure Data Factory, Azure Function, Data Bricks, Event Hub, Microservices/API, Python/PYSPARK/R, or SQL 2+ years of experience designing, developing, and implementing Big Data platforms using Azure Cloud architecture with structured and unstructured data more »
Employment Type: Permanent
Salary: USD Annual
Posted:

Expert IT Solution Architect - ML/AI

Fort Washington, Maryland, United States
IT
in Azure Cloud technologies e.g., ML/OPS, ML Flow, Azure Data Factory, Azure Function, Data Bricks, Event Hub, Microservices/API, Python/PYSPARK/R, or SQL 2+ years of experience designing, developing, and implementing Big Data platforms using Azure Cloud architecture with structured and unstructured data more »
Employment Type: Permanent
Salary: USD Annual
Posted:

Expert IT Solution Architect - ML/AI

Mc Lean, Virginia, United States
IT
in Azure Cloud technologies e.g., ML/OPS, ML Flow, Azure Data Factory, Azure Function, Data Bricks, Event Hub, Microservices/API, Python/PYSPARK/R, or SQL 2+ years of experience designing, developing, and implementing Big Data platforms using Azure Cloud architecture with structured and unstructured data more »
Employment Type: Permanent
Salary: USD Annual
Posted:

Expert IT Solution Architect - ML/AI

Chevy Chase, Maryland, United States
IT
in Azure Cloud technologies e.g., ML/OPS, ML Flow, Azure Data Factory, Azure Function, Data Bricks, Event Hub, Microservices/API, Python/PYSPARK/R, or SQL 2+ years of experience designing, developing, and implementing Big Data platforms using Azure Cloud architecture with structured and unstructured data more »
Employment Type: Permanent
Salary: USD Annual
Posted:

Expert IT Solution Architect - ML/AI

Great Falls, Virginia, United States
IT
in Azure Cloud technologies e.g., ML/OPS, ML Flow, Azure Data Factory, Azure Function, Data Bricks, Event Hub, Microservices/API, Python/PYSPARK/R, or SQL 2+ years of experience designing, developing, and implementing Big Data platforms using Azure Cloud architecture with structured and unstructured data more »
Employment Type: Permanent
Salary: USD Annual
Posted:

Expert IT Solution Architect - ML/AI

Mount Rainier, Maryland, United States
IT
in Azure Cloud technologies e.g., ML/OPS, ML Flow, Azure Data Factory, Azure Function, Data Bricks, Event Hub, Microservices/API, Python/PYSPARK/R, or SQL 2+ years of experience designing, developing, and implementing Big Data platforms using Azure Cloud architecture with structured and unstructured data more »
Employment Type: Permanent
Salary: USD Annual
Posted:

Expert IT Solution Architect - ML/AI

Temple Hills, Maryland, United States
IT
in Azure Cloud technologies e.g., ML/OPS, ML Flow, Azure Data Factory, Azure Function, Data Bricks, Event Hub, Microservices/API, Python/PYSPARK/R, or SQL 2+ years of experience designing, developing, and implementing Big Data platforms using Azure Cloud architecture with structured and unstructured data more »
Employment Type: Permanent
Salary: USD Annual
Posted:

Expert IT Solution Architect - ML/AI

Bryans Road, Maryland, United States
IT
in Azure Cloud technologies e.g., ML/OPS, ML Flow, Azure Data Factory, Azure Function, Data Bricks, Event Hub, Microservices/API, Python/PYSPARK/R, or SQL 2+ years of experience designing, developing, and implementing Big Data platforms using Azure Cloud architecture with structured and unstructured data more »
Employment Type: Permanent
Salary: USD Annual
Posted:

Expert IT Solution Architect - ML/AI

Montgomery Village, Maryland, United States
IT
in Azure Cloud technologies e.g., ML/OPS, ML Flow, Azure Data Factory, Azure Function, Data Bricks, Event Hub, Microservices/API, Python/PYSPARK/R, or SQL 2+ years of experience designing, developing, and implementing Big Data platforms using Azure Cloud architecture with structured and unstructured data more »
Employment Type: Permanent
Salary: USD Annual
Posted:

Expert IT Solution Architect - ML/AI

Takoma Park, Maryland, United States
IT
in Azure Cloud technologies e.g., ML/OPS, ML Flow, Azure Data Factory, Azure Function, Data Bricks, Event Hub, Microservices/API, Python/PYSPARK/R, or SQL 2+ years of experience designing, developing, and implementing Big Data platforms using Azure Cloud architecture with structured and unstructured data more »
Employment Type: Permanent
Salary: USD Annual
Posted:

Expert IT Solution Architect - ML/AI

Sandy Spring, Maryland, United States
IT
in Azure Cloud technologies e.g., ML/OPS, ML Flow, Azure Data Factory, Azure Function, Data Bricks, Event Hub, Microservices/API, Python/PYSPARK/R, or SQL 2+ years of experience designing, developing, and implementing Big Data platforms using Azure Cloud architecture with structured and unstructured data more »
Employment Type: Permanent
Salary: USD Annual
Posted:

Senior Data Engineer

Teddington, London, United Kingdom
Matchtech
following technologies Azure Synapse, Data Factory, Databricks, SQL Db, Datalake, Key Vault Azure Dev Ops and CI/CD pipelines Coding in SQL and PySpark/Python DW/Data Vault concepts Power BI Experience with core Finance reporting (Projects, GL, AP, AR etc) - Highly desirable Preferred experience Knowledge more »
Employment Type: Permanent
Salary: £55000 - £60000/annum
Posted:

Data Engineer

Derby, England, United Kingdom
Mirai Talent
related field Certifications such as Azure Data Engineer Associate are desirable. Knowledge of data ingestion methods for real-time and batch processing Proficiency in PySpark and debugging Apache Spark workloads. What’s in it for you? Annual bonus scheme – up to 10% Excellent pension scheme Flexible working Enhanced family more »
Posted:

Data Scientist/Engineer - Hybrid/Bristol - Up to £60k

Bristol, United Kingdom
Hybrid / WFH Options
Adecco
the insurance domain is advantageous. - Education : A degree in Computer Science, Data Science, Engineering, or a related discipline. Technical Skills : Proficient in Python, SQL, PySpark, and Databricks. Demonstrated proficiency in modern NLP techniques and tools. Proven track record in developing and managing data quality metrics and dashboards. Experience collaborating more »
Employment Type: Permanent
Salary: £50000 - £60000/annum Competitive package
Posted:

Lead Data Engineer

United Kingdom
Tredence Inc
Azure Cloud platform Knowledge on orchestrating workloads on cloud Ability to set and lead the technical vision while balancing business drivers Strong experience with PySpark, Python programming Proficiency with APIs, containerization and orchestration is a plus Qualifications: Bachelor's and/or master’s degree About you: You are more »
Posted:

Lead Data Engineer

London Area, United Kingdom
Tredence Inc
Azure Cloud platform Knowledge on orchestrating workloads on cloud Ability to set and lead the technical vision while balancing business drivers Strong experience with PySpark, Python programming Proficiency with APIs, containerization and orchestration is a plus Qualifications: Bachelor's and/or master’s degree About you: You are more »
Posted:

Senior Data Warehouse Engineer

West Midlands, Dudley, West Midlands (County), United Kingdom
Hybrid / WFH Options
Concept Resourcing
standardise the Data Warehouse environment and solutions. Required Skills, Knowledge, and Experience: Experience designing, developing, and testing Azure Data Factory/Fabric pipelines, including PySpark Notebooks and Dataflow Gen2 workflows. Previous experience with Informatica Power Centre is desired. Significant experience in designing, writing, editing, debugging, and testing SQL code more »
Employment Type: Permanent
Salary: £55000 - £70000/annum
Posted:

Python - Spark Big Data Software Engineer

Glasgow, Scotland, United Kingdom
Morgan McKinley
Proficiency in modern programming languages and database querying languages. Comprehensive understanding of the Software Development Life Cycle and Agile methodologies. Familiarity with Python or PySpark and cloud technologies like AWS, Kubernetes, and Spark is highly desirable. Ideal Candidate: Someone with a knack for innovative solutions and a commitment to more »
Posted:

Python Developer

Glasgow, Scotland, United Kingdom
Morgan McKinley
Cycle · Solid understanding of agile methodologies such as CI/CD, Applicant Resiliency, and Security Preferred qualifications, capabilities, and skills: · Skilled with Python or PySpark · Exposure to cloud technologies (Airflow, Astronomer, Kubernetes, AWS, Spark, Kafka) · Experience with Big Data solutions or Relational DB. · Experience in Financial Service Industry is more »
Posted:

Data Models Lead - Data Engineering - MarTech

Greater London, England, United Kingdom
Mars
understand consumers. Hands-on data engineering/development experience, preferably in a cloud/big data environment Skilled in at least one of Python, PySpark, SQL or similar Experience in guiding or managing roles in insight or data functions, delivering data projects and insight to inspire action and drive more »
Posted:

Data Models Lead - Data Engineering - MarTech - Adtech

London Area, United Kingdom
Mars
understand consumers. Hands-on data engineering/development experience, preferably in a cloud/big data environment Skilled in at least one of Python, PySpark, SQL or similar Experience in guiding or managing roles in insight or data functions, delivering data projects and insight to inspire action and drive more »
Posted:

Data Engineer

City of London, London, United Kingdom
Hybrid / WFH Options
Concept Resourcing
V2, Azure Databricks, Azure Function Apps& Logic Apps, Azure Stream Analytics, Azure Resource Manager skills (Terraform, Azure Portal, Az CLI and Az PowerShell) Strong PySpark, Delta Lake, Unity Catalog and Python skills. Includes ability to write unit and integration tests in Python with unittest, pytest, etc. Strong understanding of more »
Employment Type: Contract
Rate: £500 - £600/day
Posted:

Senior Data Scientist - Hybrid/Bristol - Up to £90k

Bristol, United Kingdom
Hybrid / WFH Options
Adecco
applied machine learning, probability, statistics, and quantitative risk modelling. High proficiency in Python & SQL. Experience with big data technologies and tools, particularly Databricks and Pyspark, is highly desirable. Experience in agile software development processes is a plus. Experience in insurance, cyber, or a related domain is ideal. Understanding of more »
Employment Type: Permanent
Salary: £70000 - £90000/annum Competitive package
Posted:

Lead Data Scientist

Exeter, Devon, South West, United Kingdom
Hybrid / WFH Options
Staffworx Limited
Ability to optimise workflows and analysis for map reduce processing Experience with BI software (Power BI, Tableau, Qlik Sense) Any experience with data engineering, PySpark, Databricks, Delta Lakes beneficial Confident presenting complex problems in ways suitable to target audience Experience leading or managing a small analysis team Familiarity working more »
Employment Type: Permanent, Work From Home
Posted:

Senior Data Scientist - Probabilistic Modelling

South Harting, England, United Kingdom
Hybrid / WFH Options
Adecco
learning, probability, statistics, and quantitative risk modelling. High proficiency in Python and SQL. Experience with big data technologies and tools such as Databricks and PySpark is highly desirable. Essential experience in Probabilistic Risk Modelling. Highly desirable experience with Monte Carlo, Capula, Gamma, Statistical modelling, financial modelling, and Stochastic modelling. more »
Posted:
PySpark
10th Percentile
£52,500
25th Percentile
£57,500
Median
£70,000
75th Percentile
£87,500
90th Percentile
£100,000