Senior Staff Software Engineer, Distributed Filesystem
Druva
Pune, Maharashtra, IndiaPosted 1 month ago
Skill Required
Foundation TechnologySoftware EngineerSoftware DeveloperData StructuresGenerative AIETLKubernetesQuery OptimizationPythonDockerC++LinuxJavaAWS
Key highlights
- 6+ years of experience required
- B.Tech / B.E / M.E./ M.Tech (Computer Science) or equivalent qualification
Role overview
The Foundation team at Druva designs a highly performant and scalable cloud file system on the Druva cloud in AWS, handling billions of files per day and millions of metadata requests per second. The Sr. Software Engineer in the filesystem team will provide technical ownership for designing and implementing features within this petabyte-scale, distributed, services-oriented system, collaborating with architects, senior engineers, and product owners to drive high-quality solutions.
Responsibilities
- Provide technical ownership to create high-quality software by owning the design and implementation of features within the filesystem
- Collaborate with architects and other senior engineers to refine requirements
- Collaborate with other product owners to drive features to completion with good quality
- Be the technical owner in building enterprise-grade, scalable, performant systems which deliver the required functionality
- Design and implement sufficiently large and complex features and/or architectural improvements to the product
- Suggest and propose solutions to complex design problems
- Identify areas of engineering improvements to the product and work with product architects and the team to address them
- Technically guide junior engineers with feature design and implementation
- Review the design and implementation done by junior engineers
- Independently handle complex escalations and guide others as required
- Write technical blogs and make technical presentations in internal and external forums
Requirements
- 6+ years of experience, preferably in a product company with exposure to storage architectures
- Strong demonstrable experience in systems programming, especially in multithreading, synchronization, fault tolerance and data consistency at scale
- Hands-on experience in the design and development of complex products
- Extensive hands-on experience in Go/Python/C/C++/Java on Unix/Linux platforms
- A strong understanding of complex concepts related to computer architecture, data structures, algorithms, design concepts, and programming practices
- Experience in working with SoA (Service-oriented Architecture), especially in the service’s backend
- B.Tech / B.E / M.E./ M.Tech (Computer Science) or equivalent
Nice to have
- Excellent written and verbal communication skills
- Experience in Cloud Technologies (preferably AWS)
- Working knowledge of Docker and Kubernetes
- Working knowledge of storage and file systems, including file system consistency checks
- Hands-on experience using generative AI for codegen
Additional details
- Druva is the resilience foundation for the AI enterprise, helping organizations secure and recover from connected risk across data, cyber, identity, and AI
- The Resilience Cloud is a fully managed, cloud-native SaaS platform that delivers air-gapped and immutable protection across cloud, SaaS, on-premises, endpoint, and edge environments
- Powered by Dru MetaGraph, Druva’s graph-powered intelligence layer, the platform connects critical business context so customers can understand risk, respond faster, recover cleanly, and govern data with greater confidence
- Trusted by nearly 7,500 customers, including 75 of the Fortune 500
- The Foundation team’s file system is used to back up billions of files per day, translating to millions of metadata requests per second across regions
- The file system leverages various AWS services like S3, DDB, and Kinesis, and uses a purpose-built key-value store for managing metadata requests
- Allied components like the indexing engine, key-value store, and big data pipeline provide scalable search, analytics, and compliance services
- The team tracks newer services, storage tiers, and various aspects of existing AWS services to take advantage of their continuous evolution
- Key areas the team is working on: improving resiliency of the filesystem with periodic incremental consistency checks, both for petabytes of metadata and hundreds of petabytes of data residing in the cloud
- Metadata versioning and change tracking
- Third-party secondary storage appliance integration for data centre data protection
- Extend the filesystem to store a variety of workloads beyond files/folders, e.g., emails and messages
- Optimise the filesystem for cost using strategies and algorithms to reduce cloud cost (e.g., leveraging cheaper cloud storage tiers and reducing IO requests)
- Develop tools that help debug production issues more efficiently