Software Engineer - AI Infrastructure We're seeking a software engineer to support our AI infrastructure team, helping build and maintain the foundation for advanced AI capabilities. Your role will involve developing high-quality tools and applications that enable seamless and efficient use of AI across the organization. Responsibilities:
- Develop high-quality AI tools and applications for workforce use
- Ensure high availability, reliability, performance, and security of AI tools
- Modify FOSS to accommodate customer’s use cases
- Engage with customers, conducting requirements elicitation and developing solutions
- Maintain existing customer-facing infrastructure and applications, ensuring reliable services
- Serve as a technical lead for AI Tools and Applications initiatives, coordinating work across teams
- Provide coaching, feedback, and support to assigned team members
- Navigate ambiguity and define solutions for complex requirements
- Establish new technical policies, standards, and governance frameworks where gaps exist
- Drive adoption of new technologies and practices across engineering teams
- Implement monitoring, logging, and observability solutions for AI services
- Communicate effectively with stakeholders at multiple organizational levels Required Skills:
- Expertise in UI/UX principles
- Significant experience using LLMs as part of a code solution workflow
- Ability to learn new technologies quickly
- Mastery of Python
- Demonstrate willingness to lead and manage multiple junior developers
- Familiarity with AWS or other cloud service providers
- Experience with Kubernetes/Helm
- Familiarity with Argo CD and/or other CI/CD frameworks
- Experience supporting production software using SRE best practices
- Experience with Docker and containerization Nice to Have:
- Experience with LLM UI Open-Source software such as OpenWebUI
- Proficiency with Kubernetes/Helm
- Proficiency with Argo CD and/or other CI/CD frameworks
- Familiarity with customer requirements elicitation, community outreach, and integration
- Experience hosting LLM models Experience Required: 12 years with Bachelor's degree in a technical field, or 16 years without degree Location: Columbia, MD Clearance: TS/SCI with Polygraph required Salary Range: $204,000 - $247,000
