7 of 7 Remote PySpark Jobs in Yorkshire

data engineering and reporting. Including storage, data pipelines to ingest and transform data, and querying & reporting of analytical data. You've worked with technologies such as Python, Spark, SQL, Pyspark, PowerBI etc. You’ve got a background in software engineering, including Front End technologies like JavaScript. You’re a problem-solver, pragmatically exploring options and finding effective solutions. An More ❯

Continuous integration/deployments, (CI/CD) automation, rigorous code reviews, documentation as communication. Preferred Qualifications Familiar with data manipulation and experience with Python libraries like Flask, FastAPI, Pandas, PySpark, PyTorch, to name a few. Proficiency in statistics and/or machine learning libraries like NumPy, matplotlib, seaborn, scikit-learn, etc. Experience in building ETL/ELT processes and More ❯

engineering experience with data platforms and analytics support Hands-on experience with Azure Data ecosystem: Databricks, Data Factory, Data Lake, Synapse; certifications are a plus Proficiency in Python, with PySpark experience preferred Strong SQL skills Experience in building and maintaining data pipelines Managing DevOps pipelines Skills in process optimization, performance tuning, data modeling, and database design Desirable Experience in … Zero goal by 2050. We value diversity and inclusion; your anonymized diversity data helps us improve our outreach and inclusion efforts. Nice-to-Have Skills Python, Azure, Data Factory, PySpark, SQL, DevOps Work Experience & Languages Data Engineer, Data Infrastructure English Seniorities and Job Details Entry level Contract IT & Internet industry #J-18808-Ljbffr More ❯

Specification Strong SQL knowledge Proven experience working with Azure Git/DevOps Repos experience Demonstration of problem solving ability Synapse Analytics or similar experience - desirable Visual Files experience – desirable PySpark/Python experience – desirable Powershell experience – desirable What We Offer We aim to reward your hard work generously. You’ll be greeted in our offices with great coffee, fruit More ❯

re looking for the following: Good technical knowledge of Azure Databricks, Azure Data Factory, Terraform and Azure DevOps Strong grounding in both SQL and Python with extensive experience using PySpark Excellent communication skills and the ability to collaborate with different stakeholders and disciplines Ability to mentor and coach other members of the team What can we offer you? At More ❯

You will also work alongside external data engineers and data scientists, who may not be familiar with the datasets, to accelerate development. Our technology stack consists of: Python and Pyspark AWS glue jobs assembled into Step functions Pydeequ for data quality testing Amazon Athena for querying data Hosted on AWS, using S3, Glue, Step functions, EMR, and Athena Terraform More ❯

Join to apply for the Data Engineer role at Graphics Unlimited (Vic) Pty Ltd 1 day ago Be among the first 25 applicants Join to apply for the Data Engineer role at Graphics Unlimited (Vic) Pty Ltd Pay up to More ❯