3 of 3 Parquet Jobs in Manchester

Learning – Understanding of AI/ML concepts, experience with LLMs, prompt engineering, or integrating AI capabilities into applications• Data Technologies – Experience with Kafka, PySpark, Parquet and Avro data formats, Apache Airflow for workflow management, or Streamlit for building interactive data applications• Advanced Data Management – Strong SQL design, query optimization ...

data - grounded in a desire to genuinely understand the data‐generating processes and domain context. Comfortable working across common data formats (e.g. CSV, JSON, Parquet) - loading, inspecting, joining, and aggregating as needed - and understanding what it means for the work when data is slowly changing versus arriving in near ...

backend logic and data services.Build and optimise data pipelines on AWS to collect, transform, and serve large datasets. Work extensively with S3 (Hive-partitioned Parquet data lake), Athena for SQL querying and analysis, DynamoDB for low-latency caching, and Kinesis/SQS for streaming and queue-based integration — including … CloudWatch.Experience building RESTful APIs and services with FastAPI.Hands-on experience with Infrastructure as code with Terraform.Containerisation with Docker.Data-engineering fundamentals: working with Parquet, Hive-partitioned datasets, and SQL against large tables (Athena/Presto). Solid working knowledge of the PyData stack — pandas and NumPy for data manipulation, Jupyter ...