168. Senior AI Engineer – LLM and Agent Systems

We’re looking for a Senior AI Engineer – LLM and Agent Systems to join Source Meridian

About Source Meridian

Source Meridian is a development software company that works to solve the industry’s most challenging problems in healthcare practices. We are laser focused on specific technologies in the healthcare and life science industries: Healthcare technology, artificial intelligence, and healthcare interoperability.

About the Role

AI Engineer with hands-on experience in building production-grade artificial intelligence systems using large language models (LLMs), agentic frameworks, and modern data infrastructure. The ideal candidate designs, develops, and deploys intelligent applications that leverage LLM orchestration, retrieval-augmented generation (RAG), and memory-managed architectures.

What You’ll Do

        •       Design and implement agentic workflows using LangGraph and LangChain, including multi-step reasoning, tool usage, and human-in-the-loop patterns.
        •       Integrate LLMs (OpenAI, Anthropic, Google Vertex AI, open-source models) via REST APIs and SDKs into scalable backend services.
        •       Build and maintain RESTful APIs (FastAPI) to serve AI-powered functionality to frontends and external consumers.
        •       Architect and manage vector database solutions (Milvus) for semantic search and retrieval-augmented generation (RAG).
        •       Design context engineering strategies, including prompt templates, dynamic context window management, token optimization, and context compression techniques.
        •       Implement short-term memory (conversational buffers, sliding windows, summary memory) and long-term memory (persistent vector stores, knowledge graphs, user profile stores) using MongoDB                      and vector databases.
        •       Store and manage structured and unstructured data in MongoDB, designing schemas that support conversation history, user state, and agent checkpoints.

        •       Evaluate and improve the quality of LLM responses through prompt engineering, few-shot examples, guardrails, and automated evaluation pipelines.
        •       Collaborate with DevOps teams to containerize and deploy AI services using Docker, Kubernetes, and CI/CD pipelines on AWS or GCP.

Required Qualifications

• Strong command of Python (3+ years)
• Demonstrable experience with LangChain and LangGraph (graph-based agent orchestration, state management, conditional edges, parallel execution).
• Solid understanding of the fundamentals of LLMs: tokenization, embeddings, temperature/sampling, RAG.
• Hands-on experience with vector databases and embedding models for semantic search and retrieval pipelines.
• Experience designing and consuming REST APIs; knowledge of authentication.
• Proficiency in MongoDB (document modeling, aggregation pipelines, indexing strategies).
• Understanding memory architectures for conversational AI: summary memory, entity memory, and long-term persistent stores.
• Familiarity with context engineering: token budget management, hybrid search (sparse + dense).
• English level: B2 or higher

Nice to Have

        •        Experience with assessment frameworks (RAGAS, Langfuse (LangSmith), customized assessments).
        •       Experience with streaming responses.

What We Offer

✔ Permanent contract
✔ Learning and continuous growth environment
✔ Benefits package focused on health and well-being
✔ Competitive salary based on experience

 Apply only if you reside in Colombia or Ecuador

At Source Meridian, you’ll be part of a high-impact tech-health company, building products that truly make a difference.

If you meet the profile — or know someone who might be interested — apply now!

We’d love to meet you