Data Scientist (Python ,Pyspark)
Smartedge’s Client is looking for an individual to help with their Data Scientist (Python ,Pyspark) @ Remote Working
Key area:
We are seeking an experienced Senior Data Scientist with strong expertise in Python, PySpark, advanced analytics, and agentic AI frameworks. The role focuses on building scalable, production-grade analytics and AI systems, leveraging LLMs, RAG architectures, and agent-based workflows to solve complex business problems and enhance decision intelligence.
Responsibilities:
- Design, develop, and deploy machine learning and advanced analytics models at scale Analyze large, complex datasets using Python and PySpark in distributed environments
- Build end-to-end data and analytics pipelines, including data ingestion, feature engineering, model training, validation, and deployment
- Develop agentic AI solutions to automate workflows, orchestrate tasks, and augment human decision-making
- Apply statistical analysis, ML techniques, and pattern recognition to uncover insights and emerging patterns Design and implement LLM-powered solutions, including:
- Retrieval-Augmented Generation (RAG) pipelines
- Vector databases and embedding-based retrieval
- Prompt orchestration and agent collaboration
- Build and maintain scalable systems, APIs, and microservices to support analytics and agent-based solutions in production
- Collaborate with business, product, and engineering teams to translate requirements into end-to-end AI and analytics workflows
- Monitor model and agent performance, conduct tuning, and ensure robustness, scalability, and maintainability
- Document models, agentic workflows, assumptions, and system designs for knowledge sharing and governance
- Stay current with advancements in data science, LLMs, and agentic AI frameworks
If this sounds like a role you would be interested in or if you know someone in this field.
Connect with me or email me at sirisha.p@smartedgesolutions.co.uk
Alternatively, you can call me on Tel: +44(0)203 500 2108.