Senior Software Engineer

Senior Software Engineer - ModelVault

About ModelVault

ModelVault is revolutionizing AI accessibility by building the world's first fully-integrated, on-prem AI appliance. We're a remote-first, async-friendly team passionate about empowering individuals and organizations with secure, local AI solutions.

Job Description

We are seeking a talented and experienced Senior Software Engineer to join our growing team. You will play a key role in designing and building the software layer for our on-prem AI appliance, enabling users to seamlessly deploy and manage AI models locally.

Responsibilities:

• Design and develop local APIs, CLI tools, and an admin web UI for our on-prem AI appliance.
• Integrate and manage containerized LLMs and vision models for local inference.
• Collaborate with systems and hardware engineers to optimize performance and ensure seamless integration.
• Participate in architectural discussions and gather feedback from early users to refine the product.

Qualifications:

• 5+ years of software engineering experience, preferably in devtools, infrastructure, or platform teams.
• Strong understanding of containerized environments (Docker, Compose, systemd).
• Proficiency in Python, FastAPI, shell scripting, and React/Next.js.
• Experience with GPU systems, Nvidia drivers, CUDA, or model performance tuning is a plus.

Benefits:

• Be part of a cutting-edge team shaping the future of local AI.
• Enjoy a remote-first, async-friendly work environment with high autonomy and ownership.
• Contribute to a product that empowers individuals and organizations with secure and accessible AI solutions.

Qualifications

We are seeking a highly motivated and experienced Senior Software Engineer to join our team and build the software foundation for ModelVault's groundbreaking AI appliance.

Required:

• Proven Track Record: 5+ years of experience in software engineering, with a focus on devtools, infrastructure, or platform development.
• Containerization Expertise: Strong understanding and hands-on experience with containerized environments, including Docker, Compose, and systemd.
• Technical Proficiency: Solid foundation in Python, FastAPI, shell scripting, and frontend development using React or Next.js.
• Collaborative Mindset: Ability to effectively collaborate with cross-functional teams, including systems and hardware engineers.
• Problem-Solving Skills: Demonstrated ability to identify and solve complex technical challenges.

Bonus Points:

• Experience with GPU systems, Nvidia drivers, CUDA, or model performance optimization.
• Familiarity with cloud computing platforms and infrastructure.
• Passion for AI and its potential to transform industries.

Key Responsibilities:

• Software Architecture & Development: Design and implement the core software components for ModelVault's on-premise AI appliance, including APIs, command-line interfaces (CLIs), and an administrative web user interface (UI).
• Model Integration & Management: Integrate and manage containerized large language models (LLMs) and vision models for local inference, ensuring seamless deployment and performance.
• Performance Optimization: Collaborate with systems and hardware engineers to optimize the performance and efficiency of the software stack, leveraging GPU acceleration and other hardware capabilities.
• User Feedback & Iteration: Engage with early users to gather feedback and iterate on the software design, ensuring it meets the needs of the target audience.
• Technical Leadership: Contribute to architectural decisions and mentor junior engineers, fostering a culture of innovation and technical excellence.

ModelVault Senior Software Engineer Hiring Workflow

1. Application Review: Candidates submit resumes and cover letters. The AI Agent automatically screens for required skills and experience based on the job description.

2. Technical Assessment: Shortlisted candidates complete a coding challenge focused on containerization, API development, and Python scripting.

3. Interview Rounds:

• Phone Screen: A recruiter conducts a brief phone interview to assess communication skills and cultural fit.
• Technical Interview: A senior engineer evaluates technical expertise through a problem-solving discussion and code review.
• Culture Fit Interview: The candidate meets with a team member to discuss work style, values, and team dynamics.

4. Decision & Offer: The hiring team reviews candidate performance across all stages. A final decision is made, and a competitive offer is extended to the selected candidate.

About ModelVault

ModelVault is revolutionizing the way individuals and organizations interact with artificial intelligence. We are building the world's first fully-integrated, on-premise AI appliance, empowering users to harness the power of AI securely and privately, without reliance on cloud services.

Our remote-first, async-friendly culture fosters a high degree of autonomy and ownership, allowing our team to make a real impact on the future of AI accessibility. We believe everyone deserves access to the transformative benefits of AI, and we're dedicated to making that a reality.