Senior Distributed Systems Engineer
OpenDataLabs
WorldwideremotePosted 2 days ago
O
Skill Required
Distributed-Systems-EngineerSoftware-EngineerBackend-EngineerInfrastructure-EngineerProtocol-EngineerRemote-Senior-Distributed-Systems-EngineerRemote-Senior-Distributed-Systems-Engineer-Low-Latency-PipelinesSystem DesignSoliditytroubleshootingCryptographyPrototypingBlockchaindesigningdebuggingbuildingfintechAzurePythondesignCloudjQueryNode.jsWeb3.jsAWSGCPandEthereumDeFiGoAIMachine LearningFulltime
Key highlights
- Competitive salary with equity options
- Unlimited PTO
- Remote position with in-person onboarding/retreats
- Requires experience in large scale, secure, multi-node distributed systems
Role overview
Vana is the leading decentralized AI network powered by user-owned data, aiming to build a user-owned AI foundation model collectively owned by 100 million users. Starting out of MIT and having raised $20M from VCs including Paradigm and Polychain, Vana builds an open ecosystem to break down the walled gardens of tech giants. We’re looking for a Distributed Systems Engineer to help design and build the scalable infrastructure powering data access and compute in the Vana network. You’ll be designing and building systems that allow users to connect their data in a privacy-preserving way, as well as pool and monetize it, leveraging Trusted Execution Environments (TEEs) to ensure raw user data remains inaccessible.
Responsibilities
- Lead the development of data query and compute layer with the goal of scaling it to process data required to train AI models applied to use-cases in EV, robotics, finances, healthcare and more
- Design critical protocol mechanisms related to data privacy, permissioning and provenance applying recent cryptography techniques like ZK proofs, MCP, TEEs
- Contribute to the development of Vana - EVM-compatible L1 blockchain specifically designed for user-owned data transactions
- Develop comprehensive documentation and contribute to whitepapers, including collaborations with outside researchers and engineers from MIT and top AI labs/startups
- Develop and implement robust debugging and troubleshooting processes for quick resolution of node-related issues in production environments
- Participate in code reviews and provide technical guidance to team members
Requirements
- Experience in building large scale, secure, multi-node distributed systems
- Experience designing pipelines for processing large amounts of data, ideally leveraging distributed data storage
- Experience in Python, Go or similar languages in mission-critical systems
- Experience profiling, debugging, and optimizing distributed systems for scale and performance
- Some infrastructure experience with any of the top cloud platforms (GCP, AWS, Azure)
- Experience in a fast-paced, async-first, globally distributed startup environment with rapid prototyping and iterative development.
Nice to have
- Experience in the compute-over-data space including sandboxed execution, data locality etc
- Experience with ML workflows (cleaning data, training and fine-tuning models)
- Experience with privacy preserving computation (TEEs, MPC, ZKP)
- Experience or interest in decentralization technologies and web3 (protocol design, smart contracts development)
- Track-record of significantly contributing to OSS
Benefits
- A competitive salary with equity options.
- A comprehensive benefits package, including health, dental, and vision insurance.
- A flexible work schedule.
- Unlimited PTO.
Additional details
- This is a remote position with in-person onboarding and retreats a few times a year.
- Examples of teams building on the infrastructure include an EV startup collecting video data of edge cases, a robotics-startup fine-tuning models for grasping irregular objects, and a fintech improving risk-modeling via GDPR-compliant transaction record analysis.
- Originally posted on Himalayas
