1 to 25 of 405 Apache Jobs

design, scalability, and clean coding practices. Familiarity with application monitoring solutions Data Engineering 5+ years building scalable and reliable data pipelines using Databricks and Apache Spark. We need both. Experience with cloud data warehouse/data lake architectures and tooling. Experience building solutions using cloud providers, preferably Azure ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

version control, CI/CD pipelines, containerization). Experience building and optimizing data pipelines, ETL processes, and real-time streaming solutions using tools like Apache Airflow, Kafka, Spark, or equivalent. Knowledge of applied AI principles, particularly in implementing AI systems for operational decision support and analyzing unstructured data (e.g. ...

with cloud platforms (AWS, GCP, Azure) and container orchestration technologies (Kubernetes, Docker) Proven track record in building and scaling data pipelines using technologies like Apache Kafka, Apache Spark, Apache Flink, or similar streaming frameworks Strong background in database technologies, including both SQL (PostgreSQL, MySQL) and NoSQL (MongoDB ...

experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data ...

experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data ...

high-performance, data-heavy environments Strong fundamentals in algorithms, distributed systems, and parallel compute Experience with large-scale data frameworks: PySpark, Ray, Dask, Apache Arrow, Numba, Cython Exposure to containerised, cloud-native environments (Docker, K8s, Terraform) Familiarity with CI/CD, observability, and diagnostics: GitLab CI, Prometheus, Grafana, OpenTelemetry ...

governance tools (AWS Glue Catalog, Lake Formation). Knowledge of data warehouse design patterns and best practices. Experience with data orchestration tools (e.g., Apache Airflow, Step Functions). Working knowledge of Java is a plus. Education B.S. in Computer Science, MIS or related degree and a minimum of five ...

experience in cloud-based data services. Proficiency in SQL and Python for data manipulation and transformation. Experience with modern data engineering tools, including Apache Spark, Kafka, and Airflow. Strong understanding of data modelling, schema design, and data warehousing concepts. Familiarity with data governance, privacy, and compliance frameworks (e.g., GDPR ...

native solutions that support analytics, automation, and digital transformation. Data Engineering, Full Stack & Platform Development Design and implement scalable data pipelines using tools like Apache Spark, Airflow, or dbt.Build and maintain data lakes, warehouses, and real-time streaming solutions. Develop APIs and microservices to expose data securely and efficiently. ...

have strong Python backend software engineer skills You have experience working with large data sets You have experience of using PySpark and ideally also Apache Spark You believe in automating wherever possible You're a collaborative problem solver with great communication skills Other technology in the stack includes: FastAPI ...

have strong Python backend software engineer skills You have experience working with large data sets You have experience of using PySpark and ideally also Apache Spark You believe in automating wherever possible You're a collaborative problem solver with great communication skills Other technology in the stack includes: FastAPI ...

have strong Python backend software engineer skills You have experience working with large data sets You have experience of using PySpark and ideally also Apache Spark You believe in automating wherever possible You're a collaborative problem solver with great communication skills Other technology in the stack includes: FastAPI ...

have strong Python backend software engineer skills You have experience working with large data sets You have experience of using PySpark and ideally also Apache Spark You believe in automating wherever possible You're a collaborative problem solver with great communication skills Other technology in the stack includes: FastAPI ...

Charity Volunteer Days Cycle to work scheme And More.. DATA ENGINEER - ESSTENTIAL SKILLS Proven experience building data pipelines using Databricks . Strong understanding of Apache Spark (PySpark or Scala) and Structured Streaming . Experience working with Kafka (MSK) and handling real-time data . Good knowledge of Delta Lake ...

/or Azure (Data Lake, Synapse). Programming & Scripting:Proficiency in Python, SQL, PySpark etc. ETL/ELT & Streaming:Expertise in technologies like Apache Airflow, Glue, Kafka, Informatica, EventBridge etc. Industrial Data Integration:Familiarity with OT data schema originating from OSIsoft PI, SCADA, MES, and Historian systems. Information Modeling ...