1 to 25 of 38 Parquet Jobs in England

Secrets Manager Data Modelling Skills Star Schema Snowflake Schema Dimensional Modeling Data Vault Data Warehouse Design Data Lake Architecture Data Formats Experience working with: Parquet Avro JSON CSV ORC CI/CD & DevOps Git GitHub GitLab Bitbucket Jenkins GitHub Actions GitLab CI/CD AWS DevOps Tools Domain Experience ...

e.g., EPAM) delivery models is beneficial.Understanding of data quality principles, including validation, monitoring, alerting, and resolution.Experience with lakehouse and medallion architecture patterns, Delta/Parquet-based data products, semantic model readiness and data product lifecycle management.Strong software engineering discipline, including source control, peer review, unit/integration testing, deployment ...

environment. Experience working with distributed data processing frameworks such as Apache Spark . Working knowledge of common data formats such as JSON , Avro and Parquet . Technology Environment The role will involve working with a modern and evolving data stack. Candidates are not expected to have deep expertise ...

environment. Experience working with distributed data processing frameworks such as Apache Spark . Working knowledge of common data formats such as JSON , Avro and Parquet . Technology Environment The role will involve working with a modern and evolving data stack. Candidates are not expected to have deep expertise ...

invalidation, persistence strategy, data consistency MongoDB TimescaleDB NATS JetStream AWS S3/Glue Data lake staging, archival, batch ingestion into Snowflake Partitioning, file format (Parquet/ORC), Lake Formation governance Finance Domain Knowledge Candidates should have hands‐on data architecture experience in one or more of the following financial ...

compliance efforts to ensure adherence to standards and regulations.Required qualifications, capabilities and skillsExperience in working with technical data formats (JSON/Avro/Parquet)Formal training or certification on data engineering concepts and applied experienceRecent hands-on professional experience in a reporting, data analysis or business intelligence roleExperience ...

Learning – Understanding of AI/ML concepts, experience with LLMs, prompt engineering, or integrating AI capabilities into applications• Data Technologies – Experience with Kafka, PySpark, Parquet and Avro data formats, Apache Airflow for workflow management, or Streamlit for building interactive data applications• Advanced Data Management – Strong SQL design, query optimization ...

Orchestra for task orchestration Terraform for infrastructure Lightdash for data applications Airflow and Astronomer for job scheduling and tracking Circle CI for continuous deployment Parquet and Delta file formats on S3 for data lake storage Spark for data processing SparkSQL for analytics Why else you'll love it here ...

unifying and normalising data into a relational store with proper versioning and lineage; polling an external API and landing it as a Hive-partitioned Parquet dataset; storing document blobs and their metadata via a document-management approach. There will be many more shapes; your job is to choose ...

standards such as metrics and use of test tools Here's a snapshot of the technologies that we use: Scala Apache Spark Databricks Apache Parquet Azure Cloud Platform Azure DevOps (Test plans, Backlogs, Pipelines) GIT We'd love to hear from you if you have: Good experience in creating ...

technology stack through reusable libraries, APIs, and robust engineering practices.Optimise performance, scalability, and reliability of quantitative applications.Skills required:Python data engineering stack: Pandas/Parquet/FastAPI/Jupyter/Airflow/Streamlit/RayExperience with high-performance data stores and query engines like Trino/SnowflakeExperience with financial ...

issues to resolutionBonus Points:Experience deploying and operating services across multiple cloud providers (AWS, GCP, Azure, OCI)Knowledge of data serialization formats (Avro, Protobuf, Parquet) and schema managementExperience with observability platforms (Prometheus, Grafana, Datadog, Splunk)Understanding of data governance, security, and compliance requirementsContributions to open-source streaming or distributed ...

Strong scripting abilities in SQL, Python, and/or PowerShell. Data Formats: Experience working with structured and semi-structured data formats (CSV, JSON, XML, Parquet, MDF, BAK). Problem Solving: Exceptional troubleshooting, automation, and analytical capabilities. How to Apply Please include your most recent CV and a brief summary ...

Strong scripting abilities in SQL, Python, and/or PowerShell. Data Formats: Experience working with structured and semi-structured data formats (CSV, JSON, XML, Parquet, MDF, BAK). Problem Solving: Exceptional troubleshooting, automation, and analytical capabilities. How to Apply Please include your most recent CV and a brief summary ...

Storage, and SQL/NoSQL technologies. Experience monitoring and supporting production ML environments. Knowledge of data engineering practices and tools. Familiarity with GRIB, NetCDF, Parquet, and JSON is advantageous. Azure Data Scientist Associate certification is desirable. If you have the relevant skills and experience, please do apply promptly ...

tuning, prompt engineering, LLM evaluation, or model serving Technical stack: strong Python across production services and data pipelines, data engineering fundamentals (Spark, Delta tables, Parquet) Platform and infrastructure: Databricks (MLflow, Unity Catalog, Model Serving), AWS (EKS/Kubernetes, IAM), Terraform, GitHub Actions Cross-domain flexibility: comfort working across ...

high quality code and building lean processesExperience with distributed data processingExperience with monitoring, testing, and data qualityExperience building robust pipelines from diverse sources e.g. parquet, SQL & no-SQL databases, API endpointsIt would be helpful to have experience/expertise/knowledge in the following:PythonAWSKubernetesSpark & distributed computingdbtTerraformData Warehousing ...

data - grounded in a desire to genuinely understand the data‐generating processes and domain context. Comfortable working across common data formats (e.g. CSV, JSON, Parquet) - loading, inspecting, joining, and aggregating as needed - and understanding what it means for the work when data is slowly changing versus arriving in near ...

work effectively with remote teams"**Experience with the Following is Desirable:*** Go* Pinot or other time-series/OLAP-style database* Iceberg* Kubernetes* Jenkins* Parquet* Protocol Buffers/GRPC#LI-MZ1**Benefits of Working at CrowdStrike:*** Market leader in compensation and equity awards* Comprehensive physical and mental wellness programs* Competitive ...

tools, methods, and frameworks used by data scientists Familiarity with data engineering practices and tools. Familiarity with data formats such as GRIP, NETCDF, Parquet, and JSON is a plus. Azure data scientist associate certificate is plus ...

Glue Amazon S3 AWS Lake Formation Amazon Athena Experience building Lakehouse architectures and modern data platforms. Experience working with data formats such as Parquet and Iceberg tables. Strong experience with Terraform for infrastructure automation. #J-18808-Ljbffr ...

desks and ability to analyse and address issues and queries quickly and effectively.Recent hands-on experience with Python plus SQL Server and ideally some Parquet exposure.Evidence of strong delivery throughout the entire lifecycle.Strong problem-solving skills and capability to write code quickly and accurately, plus experience of troubleshooting production ...

PostgreSQL, and cloud databases Proven track record with complex data migration projects (terabyte+ datasets, multiple legacy source systems, structures and unstructured data) Proficiency with Parquet/Delta Lake or other modern data storage formats Experience with streaming architectures using Kafka, Event Hubs, or Kinesis for real-time data processing ...

PostgreSQL, and cloud databases Proven track record with complex data migration projects (terabyte+ datasets, multiple legacy source systems, structures and unstructured data) Proficiency with Parquet/Delta Lake or other modern data storage formats Experience with streaming architectures using Kafka, Event Hubs, or Kinesis for real-time data processing ...

PostgreSQL, and cloud databases Proven track record with complex data migration projects (terabyte+ datasets, multiple legacy source systems, structures and unstructured data) Proficiency with Parquet/Delta Lake or other modern data storage formats Experience with streaming architectures using Kafka, Event Hubs, or Kinesis for real-time data processing ...