Spark Streaming Jobs

6 Spark Streaming Jobs

Senior Data Architect

London Area, United Kingdom
HCLTech
expertise in tools like Informatica & Talend MDM Big data – Hadoop eco-system, Distributions like Cloudera/Hortonworks, Pig and HIVE Data processing frameworks – Spark & Spark streaming Hands-on experience with multiple databases like PostgreSQL, Snowflake, Oracle, MS SQL Server, NOSQL (HBase/Cassandra, MongoDB more »
Posted:

Principal Data Consultant

England, United Kingdom
Adatis
DevOps/CI/CD/YAML/ARM/Terraform MSBI Traditional Stack (SQL, SSAS, SSIS, SSRS) Azure Automation/PowerShell Azure Streaming Analytics/Spark Streaming Azure Functions/C# .NET PowerApps Data Science Master Data Management/MDS WHY ADATIS? There more »
Posted:

Senior Data Engineer - £75K - UK Wide (London HQ)

London, United Kingdom
In Technology Group Limited
designing, building, and optimising Big Data solutions to support the creation of highly scalable data stores with Big Data technologies such as Hadoop, Spark, Kafka, etc. Project experience in developing optimal and reliable ETL processes ingested from a wide variety of data sources both structured and unstructured and … AWS S3 or Google Cloud Platform. Ideally, you could also have… Project experience of message queueing and stream processing systems such as StreamSets, Spark-Streaming and Kafka. Project experience of data pipeline and workflow management tools. Exposure to any of the following technologies: Pega, Salesforce, RPA more »
Employment Type: Permanent
Salary: £60,000
Posted:

Lead Data Engineer

Leeds, England, United Kingdom
HCLTech
Analytics in Azure Synapse Analytics, Azure Analysis Services Data Ingestion and Storage including Azure Data Factory, Azure Databricks, Azure Data Lake, Kafka and Spark Streaming, Azure EventHub/IoT Hub, and Azure Stream Analytics Experience with Object-oriented/object function scripting languages: Python preferred more »
Posted:

Graduate Data Engineer

Peterborough, England, United Kingdom
Tata Consultancy Services
and workflow management and their tools such as Airflow. Strong understanding of relational SQL and NoSQL databases, including MongoDB and stream-processing systems: Spark-Streaming, Kinesis etc. Ability to understand any scripting language and tools. Rewards & Benefits TCS is consistently voted a Top Employer in the more »
Posted:

AWS Data Engineer

London, United Kingdom
Hybrid / WFH Options
83zero Ltd
AWS services with the ability to demonstrate working on large engagements * Experience of AWS tools (e.g. Athena, Redshift, Glue, EMR) * Java, Scala, Python, Spark, SQL * Experience of developing enterprise grade ETL/ELT data pipelines. * Deep understanding of data manipulation/wrangling techniques * Demonstrable knowledge of applying Data … GCP DataProc or GCP Cloud Data Fusion. * NoSQL Databases. Dynamo DB/Neo4j/Elastic, Google Cloud Datastore. * Snowflake Data Warehouse/Platform * Streaming technologies and processing engines, Kinesis, Kafka, Pub/Sub and Spark Streaming. * Experience of working with CI/CD technologies, Git, Jenkins more »
Employment Type: Permanent
Salary: £75000 - £95000/annum + 5-10% Bonus, Pension, Insurance
Posted:
Spark Streaming
25th Percentile
£80,000
Median
£85,000
75th Percentile
£90,000