76 to 100 of 138 Apache Jobs

root‐cause analysis. Experience building or supporting production data pipelines in a collaborative engineering environment. Experience working with distributed data processing frameworks such as Apache Spark . Working knowledge of common data formats such as JSON , Avro and Parquet . Technology Environment The role will involve working with … should bring relevant experience and the ability to work across comparable technologies. Examples of technologies in scope include: Data processing and logic: ANSI SQL, Apache Spark, Kafka Platforms and storage: Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, Sybase IQ Engineering and deployment: CI/CD tooling, containerised ...

environment 2+ years experience working with Red Hat Linux (or other Unix variants), including scripting 2+ years experience supporting applications such as Java, .NET, Apache or IIS Desirable: Experience within the financial services or trading environment Knowledge of Windows Server Familiarity with ITIL frameworks Exposure to market data ...

coding skills (any version, but we use Oracle) Experience coding in at least one dynamic scripting language (e.g., Python, Node JS, PowerShell or Apache Groovy) Business reporting intelligence experience (using tools like BIRT, Tableau or Power BI) Knowledge of REST APIs and standard HTTP methods and data migration; either ...

partnership with Inspire People, is hiring a Lead Data Engineer with strong SQL and Python expertise, experience across modern cloud data platforms including Databricks, Apache Spark and lakehouse architectures, and a proven abi... ZIPC1_UKTJ ...

partnership with Inspire People, is hiring a Lead Data Engineer with strong SQL and Python expertise, experience across modern cloud data platforms including Databricks, Apache Spark and lakehouse architectures, and a proven abi... WKCL1_UKTJ ...

with Inspire People, is hiring a Lead Data Engineer with strong SQL and Python expertise, experience across modern cloud data platforms including xxuwjjq Databricks, Apache Spark and lakehouse architectures, and a proven abi... If you want to know about the requirements for this role, read ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

data validation and application testing processes across distributed systems Investigate production issues using data analysis to identify root causes Work with orchestration tools (e.g., Apache Airflow) to monitor workflows and troubleshoot failures Validate data using tools such as Jupyter Notebooks and Amazon Athena Analyse data across multiple formats … additional programming language (e.g., Java) Experience with scripting languages such as Bash Strong understanding of automated testing frameworks and methodologies Hands-on experience with Apache Airflow and log analysis Familiarity with data processing tools such as Apache Spark Experience working with cloud platforms and services, including: Monitoring ...

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … Engineer Should Have: Active eDV clearance (West) Willingness to work full-time on-site in Manchester when required. Required technical experience in the following: Apache Kafka Apache NiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either ...

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … Engineer Should Have: Active eDV clearance (West) Willingness to work full-time on-site in Gloucester when required. Required technical experience in the following: Apache Kafka Apache NiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either ...

attention to detail Good written and verbal communication skills Desirable Skills Experience with shell scripting Knowledge of web technologies (HTML, CSS, JavaScript) Familiarity with Apache or web server administration Understanding of networking basics Exposure to domain registration technologies (DNS, WHOIS/RDAP, EPP, SSL/TLS, or registrar systems ...

Services, and IGA Scripting and automation experience Knowledge of SQL databases (Oracle, MSSQL, MySQL, PostgreSQL etc.) Experience with web/application platforms such as Apache and IIS Understanding of DevOps and modern software development practices Application integration and reporting experience What We’re Looking For Strong written and face ...

Data, Streaming & Analytics Oversee large-scale telemetry ingestion via highly available MQTT brokers handling 6+ billion messages per day . Guide streaming pipelines using Apache Pulsar and data storage across DynamoDB and Google BigQuery . Enable high-fidelity time-series analytics, machine learning, and forecasting at scale. Ensure robust ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. For more information, follow Databricks on Twitter, LinkedIn and Facebook. Benefits: At Databricks, we strive to provide comprehensive benefits ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

optimizing data pipelines and cloud resources on Google Cloud Platform (BigQuery) for cost-effective, high-performance processing; • Engineering scalable ingestion and transformation processes using Apache Spark, Spark SQL, and Python, orchestrated with Apache Airflow; • Developing advanced SQL queries and performing query optimization on large-scale data platforms such ...

infrastructure. Analyses and reports on test activities, results, issues and risks. Production data analysis to identify root cause of production environment issues. Using Apache Airflow for task orchestration and reviewing output logs. Basic understanding of EMR and reviewing output logs. Basic understanding of data processing using Apache Spark. ...

optimise scalable data pipelines within a Databricks Lakehouse environment. You'll work with both streaming and batch data pipelines using technologies such as Apache Spark Structured Streaming, Delta Live Tables, and Kafka, ensuring data flows efficiently and reliably across the organisation. Working closely with BI, product, and engineering teams …/7 Collaborative office environment with regular social and charity events And Much More!!! DATA ENGINEER - ESSTENTIAL SKILLS Strong experience with Databricks and Apache Spark (PySpark or Scala) Experience building streaming and batch pipelines using Spark Structured Streaming Hands-on experience with Kafka (MSK) and real-time data ingestion ...

Code tools such as AWS CDK, CloudFormation, Terraform, or AWS CLI Experience with real-time stream processing and Complex Event Processing (CEP) using Apache Flink or similar technologies is a plus Experience with automated testing frameworks, specifically Playwright for end-to-end and UI testing Strong focus on scalability … monitoring and analytics tools such as Grafana, InfluxDB, or similar Experience with cloud data stores and query engines such as Amazon Redshift, Athena, DynamoDB, Apache Iceberg and S3-based data lakes a plus Understanding of data modeling and transformation using AWS services such as Glue, Lambda, Redshift, Athena ...

Senior Software Engineer Hungerford, United Kingdom Tech stack JavaScript Web API ASP.NET web C TypeScript React Qualifications Our ideal candidate will have hands‐on experience in web and application development using technologies such as ASP.NET ...

Software Developer Permanent | Hybrid (willing to travel to Newcastle) | Python | Apache | Data | SC cleared Hybrid work arrangement. Office attendance is up to 60%. Location is flexible: London, Leeds, Newcastle, Sheffield, Blackpool, Manchester and Birmingham. You must be willing to travel to Newcastle when required. The Role ...

Description Software Developer Permanent | Hybrid (willing to travel to Newcastle) | Python | Apache | Data | SC cleared Hybrid work arrangement. Office attendance is up to 60%. Location is flexible: London, Leeds, Newcastle, Sheffield, Blackpool, Manchester and Birmingham. You must be willing to travel to Newcastle when required. The Role ...

Kingdom. The role demands strong expertise in Solution Architecture, Cloud-Native Architecture Design, and hands-on experience with Snowflake and Data Lakehouse architectures, including Apache Iceberg. Responsibilities involve creating Architecture Design Documents, managing S3-based Data Lakes, and ensuring platform performance tuning and observability. Ideal candidates should have substantial ...

Apache Associates is looking for a Software Engineering Manager to lead and scale a high-performing engineering team responsible for AI-enabled platforms for construction projects. This role involves mentoring engineers, establishing best practices, and driving AI tool adoption. Candidates should have strong management experience, a background in full ...

Description Software Developer Permanent | Hybrid (willing to travel to Newcastle) | Python | Apache | Data | SC cleared Hybrid work arrangement. Office attendance is up to 60%. Location is flexible: London, Leeds, Newcastle, Sheffield, Blackpool, Manchester and Birmingham. xkybehq You must be willing to travel to Newcastle when required. The Role ...