151 to 175 of 219 PySpark Jobs

issues Contribute to new Finance Engineering initiatives What We’re Looking For Excellent programming skills in Python and strong working knowledge of Pandas and PySpark libraries Excellent knowledge of relational databases and SQL Experience with integration of multiple platforms Experience with ETL processes Experience providing first-line support ...

documentation and knowledge sharing What You Bring 5+ years as a Platform Engineer or Data Engineer within Azure Strong programming skills in Python and PySpark Hands-on experience with Databricks (Unity Catalog, Lakeflow, DABs) Experience with testing, version control, and Azure DevOps Relevant certifications (e.g., DP-203, Databricks Associate ...

databases and AWS cloud environments. Strong hands-on experience with ETL processes and tools (Talend, Informatica, Matillion, Pentaho, MuleSoft, Boomi) or scripting using Python, PySpark, and SQL. Solid understanding of data warehousing and modelling techniques (Star Schema, Snowflake Schema). Familiarity with security frameworks such as GDPR, HIPAA ...

governance , schema validation, and master data management. Strong grasp of real-time vs batch processing trade-offs . Beneficial Experience CockroachDB deployment and management. PySpark or similar for large-scale processing. SAP data structures and PIM systems. E-commerce and B2B data integration patterns. Why Apply? Fully remote contract ...

governance , schema validation, and master data management. Strong grasp of real-time vs batch processing trade-offs . Beneficial Experience CockroachDB deployment and management. PySpark or similar for large-scale processing. SAP data structures and PIM systems. E-commerce and B2B data integration patterns. Why Apply? Fully remote contract ...

mentoring experience, with a genuine commitment to team growth and wellbeing. Strong hands-on skills in: AWS (or equivalent cloud platforms) Python/PySpark for data engineering and automation TypeScript, Node.js, React.js for full-stack development Solid grasp of distributed systems design, secure coding, and data privacy principles. Familiarity ...

data governance, security, and compliance. Key Skills & Experience* Proven experience as an Azure Data Engineer.* Strong hands-on expertise with Databricks - 5+ years experience (PySpark, notebooks, clusters, Delta Lake).* Solid knowledge of Azure services (Data Lake, Synapse, Data Factory, Event Hub).* Experience working with DevOps teams ...

Databricks-based data warehousing solution Designing and developing data models, ETL pipelines, and data integration processes Large scale data processing using PySpark Monitoring, tuning, and optimising data platforms for reliability and performance Upskilling the wider team in Databricks best practices, including modern architecture patterns Location: Atherstone (Hybrid – 3 days ...

client requirement) Job Summary We are seeking a highly skilled Senior Data Engineer with strong expertise in AWS cloud services, Python, and PySpark to join our team in Columbus, OH. The ideal candidate will design, build, and optimize scalable data pipelines, ensuring high data quality, performance, and reliability. This … Data Engineer. Strong hands-on expertise in AWS Data Services: Glue, EMR, Redshift, Athena, S3, Lambda, Step Functions, CloudWatch. Proficiency in Python and PySpark for ETL, transformation, and automation. Strong experience in SQL and data modeling (star schema, snowflake schema, dimensional models Experience building scalable, high-performance data pipelines ...

scalable solutions. Proficiency in ETL between different RDBMSs (e.g., Oracle) to Databricks and NoSQL databases Experience working with Mongo DB Working knowledge in Python, PySpark, and Scala Design and implement scalable data processing solutions using Azure Databricks Collaborate with data scientists and data analysts to understand data needs Optimize ...

ground running Comfortable operating in high-pressure, delivery-focused environments Able to explain how you moved data, not just which tools you used Python (PySpark/Pandas/NumPy) and SQL using practically for data transformation Desirable Experience migrating data into Dynamics (or similar ERP platforms) Experience working with ...

complex operational challenges. You'll design and implement scalable generative AI workflows, often using technologies like Palantir AIP, while building robust data pipelines with PySpark, Python, and SQL. A key responsibility is executing sophisticated data integrations across distributed systems and enterprise environments, including ERPs and CRMs. You'll collaborate ...

Summary We are seeking a highly skilled Senior Data Engineer with strong expertise inAWS cloud services, Python, and PySpark to join our team in Columbus, OH. The ideal candidate will design, build, and optimize scalable data pipelines, ensuring high data quality, performance, and reliability. This role requires hands … Data Engineer. Strong hands-on expertise in AWS Data Services: Glue, EMR, Redshift, Athena, S3, Lambda, Step Functions, CloudWatch. Proficiency in Python and PySpark for ETL, transformation, and automation. Strong experience in SQL and data modeling (star schema, snowflake schema, dimensional models Experience building scalable, high-performance data pipelines ...

designing, building, and deploying production-level data pipelines using tools from AWS Glue, Lamda, Kinesis using databases Aurora and Redshift.Experience with Spark programming (pyspark or scalaHands on experience with AWS components like (EMR, S3, Redshift, Lamdba, API Gateway, Kinesis ) in production environmentsStrong analytical skills and advanced SQL knowledge, indexing ...

Services : S3, Redshift, Glue, Athena, Lake Formation, IAM Data Engineering/ETL: Building and optimizing ETL pipelines Data ingestion, transformation & orchestration using AWS Glue (PySpark/Python) Worki click apply for full job details ...

Dependent on experience. Required experience will include: Strong Python Programming skills. Strong design and development skills using Python. Python's libraries for machine learning: PySpark, Pytorch, scikit-learn and pandas. Technical experience using Databricks and MLFlow (Other Platforms can be considered). Good understanding of software code review standards ...

Dependent on experience. Required experience will include: Strong Python Programming skills. Strong design and development skills using Python. Python's libraries for machine learning: PySpark, Pytorch, scikit-learn and pandas. Technical experience using Databricks and MLFlow (Other Platforms can be considered). Good understanding of software code review standards ...

visualize data specifically around experimental design, KPI calculation, and A/B testing. 4+ years of experience in manipulating big data using Python, PySpark, or SQL. Expert Experience with data visualization tools in Python, PowerBI, etc. Bachelors Degree or higher in Computer Science/Engineering/Math, or relevant ...

TensorFlow Serving, TorchServe, ONNX, and TensorRT. Build and manage ML pipelines using MLflow, Kubeflow, and Azure ML Pipelines. Work with large-scale data using PySpark and integrate models into production environments. Monitor model performance and retrain as needed to ensure accuracy and efficiency. Collaborate with cross-functional teams ...

quality and structure of data ·Translate business needs into clear technical plans Experience required: ·Strong skills in data modelling ·SQL with either Python or PySpark ·Databricks or similar cloud data platform ·Experience communicating with both technical and non-technical users ·Leadership or mentoring experience ·Insurance or regulated sector experience ...

quality and structure of data Translate business needs into clear technical plans Experience required: Strong skills in data modelling SQL with either Python or PySpark Databricks or similar cloud data platform Experience communicating with both technical and non-technical users Leadership or mentoring experience Insurance or regulated sector experience ...

data for critical client projects. How to develop and enhance your knowledge of agile ways of working and working in open source stack (PySpark/PySql). Quality engineering professionals utilise Accenture delivery assets to plan and implement quality initiatives to ensure solution quality throughout delivery. As a Data ...

strategy. About you - Extensive Technical Expertise: Strong knowledge of Microsoft Fabric components including OneLake, Lakehouse/Warehouse, Delta Lake, Direct Lake, Data Factory, Spark (PySpark/Scala) and Power BI (DAX and semantic modelling). Advanced Programming and Data Engineering Skills: Proficient in Python, SQL and T-SQL with … experience in PySpark; familiarity with KQL for real-time analytics and robust ELT design using medallion architectures. Proven Experience in Modern Data Platforms: Track record of building and operating Azure-based data platforms, ideally in greenfield or transformational contexts, with integration across on-premise, cloud and third-party sources. ...

domain, specializing in building scalable data models and delivering actionable insights for risk management, payments, and customer analytics. Skilled in Python (pandas, scikit-learn, PySpark), SQL, and data engineering pipelines to enable predictive and prescriptive analytics. Adept at working with large financial datasets, ensuring data quality, and collaborating with … business decisions. Demonstrated success in developing machine learning models for fraud detection, credit scoring, and customer segmentation. Key Skills: Languages/Tools: Python, SQL, PySpark, R, SAS ML/AI: Scikit-learn, TensorFlow, NLP, Time-Series Forecasting Data Engineering: ETL, Data Wrangling, Data Pipelines Cloud Platforms: AWS, Azure ...

designs, development, and operations on automation flows based on real-time network data. Requirements Experience with Udex, Spark/Scala, or pySpark Experience with Spark streaming Knowledge of Phoenix, HBase and Hive Knowledge of professional software engineering practices and software development lifecycle best practices Knowledge and experience with basic ...