5 of 5 Permanent PySpark Jobs in Newcastle upon Tyne

backgrounds. The technology stack is flexible, but experience in some of the following are nice to have: Data Engineering & Programming: • Python • SQL • Spark/PySpark • Scala • Data modelling and warehousing concepts Cloud & Platforms: • AWS (S3, Redshift, Glue, EMR, Lambda) • Other cloud platforms (Azure/GCP considered) • Data lake ...

including: CloudWatch, IAM, S3, Glue, ECR, EC2, EMR, DynamoDB, Lake Formation Experience with Infrastructure as Code (Terraform) Proficiency in Python, SQL, and familiarity with PySpark Experience with Apache Spark and data processing frameworks Hands-on experience with Apache Airflow for workflow orchestration Experience using Jupyter Notebooks and/ ...

practices You have experience with Databricks, ideally also Azure You have experience of working with technologies such as SQL, Apache Spark and Python including PySpark and Pandas You're excited to join a start-up in a role that you can shape and influence You're collaborative with excellent ...

TensorFlow Serving, TorchServe).* Familiarity with ML lifecycle tools such as MLflow, Kubeflow, or Azure ML Pipelines.* Experience working with distributed data processing (e.g., PySpark) and SQL.* Understanding of software engineering best practices, including version control (Git).* Knowledge of CI/CD principles in ML environments.* Experience with ...

Senior Test Engineer Identifies and raises awareness of risks arising from automation test results. Identifies new and implements existing test frameworks to improve confidence in testing. Proficient in coding languages such as Python, Java, SQL ...