Highlights
Direct ownership of critical components, access to high-end GPU resources, and rapid career growth.
Description
Job Summary
pJoin the innovative team at Janooma, India's first agent-driven AI marketplace. As an LLM Systems Engineer, you will design and implement advanced architectures for working with large language models. This role involves automated model discovery, evaluation, composition, fine-tuning, and optimization. Ideal for fresh graduates to early professionals seeking a challenge in cutting-edge AI technology.
Responsibilities
- Design automated pipelines for discovering, evaluating, and selecting high-performing LLMs.
- Develop advanced model composition techniques using state-of-the-art merging frameworks.
- Publish detailed introspections of LLM architectures to optimize performance.
- Create iterative improvement loops for multi-model comparison and fine-tuning.
- Optimize inference pipelines for high throughput using tools like vLLM or TGI.
Required Skills
- Python programming
- Hugging Face Transformers library
- Fine-tuning LLMs
- Transformer architecture understanding
- Git and Linux proficiency
Required Skills Explained
{'html': '
- Python and PyTorch proficiency
- Hugging Face Transformers library experience
- LLM fine-tuning using PEFT/LoRA/QLoRA methods
- Transformer architecture understanding (attention mechanisms, layers, embeddings)
- Model introspection tools like named_modules, state_dict, and named_parameters
- Git and Linux fundamentals
- MLOps practices including model versioning and experiment tracking
'}
Who is this for
pIdeal candidates are recent graduates or early professionals with a strong interest in large language models, AI systems engineering, and machine learning. You should have experience fine-tuning LLMs and be excited about working at the cutting edge of technology.
Why This Job is a Good Opportunity
{'html': 'ulliDirect ownership of critical components in an innovative LLM engineering stackliAccess to high-end GPU cloud resources for advanced model trainingliPotential for rapid career growth and transition into senior rolesliOpportunity to work on multiple LLM categories and advance model evolution systemsliA collaborative environment with clear architecture guidance and mentorshipliHigh-impact role contributing to the development of cutting-edge AI technologies'}
Interview Preparation Tips
{'html': '
- Review and practice LLM fine-tuning using PEFT/LoRA/QLoRA methods on similar models like Qwen2 or Phi-3
- Familiarize yourself with Transformer architectures, including attention mechanisms, layers, embeddings, and MLP blocks
- Prioritize hands-on experience with Git and Linux commands relevant to MLOps practices
- Explore model merging frameworks such as mergekit and techniques like DARE or SLERP if possible
- Create a GitHub project showcasing your LLM work, including fine-tuning, merging, evaluation pipeline, or inference work
'}
Career Growth in This Role
{'html': "pThe role offers direct ownership of critical components in the cutting-edge LLM engineering stack, providing ample opportunities for hands-on experience and skill development. As you progress, you can move into senior roles such as LLM Architect, leveraging your expertise to contribute significantly to Janooma's AI marketplace innovation.pWith Janooma’s expansion plans into multiple Indian cities and Southeast Asia, there is a strong demand for skilled professionals in the field of LLM engineering. This role positions you at the forefront of AI technology development, enabling you to build a robust skill set that can be applied across various industries and geographical regions."}
Explore More Opportunities
Skills
Frequently Asked Questions
What is the application process?Submit your resume, GitHub profile link, and a brief note showcasing one relevant project to madan@janooma.com.
Do I need prior experience in AI or ML?Fresh graduates are encouraged. Practical experience is beneficial but not mandatory.
What benefits does Janooma offer?Access to high-end GPU resources, MLOps practices, and rapid career growth opportunities.
