AI Engineer-Memory Retrieval

Overview

About the Role & TeamIDC is building the next generation of AI-powered intelligence platforms that transform how technology decisions get made. Our platform re-imagines the way decision-makers discover and interact with trusted research and data, and is foundational to IDC's future. We are looking for an AI/Agent Engineer to join the Memory / Living Intel Pod, with an emphasis on cross-conversational retrieval and semantic search over conversation history. This is a stretch and acceleration hire. You will build the retrieval systems that find relevant prior conversations and extracted facts, design embedding and indexing strategies for conversation-derived content, and optimize relevance ranking for memory retrieval.Your work ensures that when the platform remembers a user, it remembers the right things at the right time. The quality of memory retrieval directly determines how personalized and useful every AI-generated response feels What You’ll Do

• Build specialized agents within multi-agent pipelines designed for handling complex research problems, developing durable outputs, and taking action in external systems on the user's behalf
• Build retrieval systems that find relevant prior conversations and extracted facts across a user's history
• Design embedding and indexing strategies for conversation-derived content
• Build and optimize relevance ranking for memory retrieval
• Build LLM-based memory capabilities: conversation summarization, cross-session context retrieval, and persistent user preference extraction
• Instrument pipelines for observability, tracing, and quality monitoring
• Collaborate with evaluation engineers on quality measurement and improvement

What You Bring

• 3+ years of experience building production Python systems
• Experience with LLM applications: agent orchestration, prompt engineering, RAG, or similar
• Hands-on experience with agent frameworks (LangGraph, LangChain, CrewAI, AutoGen, or similar)
• Understanding of LLM reasoning patterns and common failure modes
• Proficiency with modern Python web frameworks
• Comfort working in a fast-moving team where priorities evolve

Preferred Qualifications:

• Experience building semantic search and embedding pipelines
• Hands-on experience with vector databases (e.g., Snowflake Cortex, Pinecone, Weaviate)
• Background in information retrieval
• Experience with search relevance tuning and ranking optimization
• Familiarity with LLM observability tools
• Background in NLP, text summarization, or information extraction

Why This Role Stands Out At IDC, your work helps shape how the world understands technology and where it goes next. You collaborate with curious, high-caliber colleagues who value rigor, integrity, and shared success. As the premier global provider of trusted technology intelligence, IDC equips business and technology leaders with the evidence they need to make confident decisions. Our insights inform strategy, investment, and innovation across industries and regions. Recognized by IIAR as Analyst Firm of the Year for five consecutive years, IDC sets the standard for credibility and impact. With more than 1,000 analysts worldwide and a truly global perspective, we combine deep expertise with practical relevance. Here, your ideas matter, your voice is heard, and your contributions provide the insights leaders rely on every day. It is meaningful work, backed by a culture that supports growth, collaboration, and long-term career development with a globally respected brand.

What We Offer

• 15 vacation days (prorated based on start date)
• 12 company-paid holidays
• 6 paid sick days (prorated based on start date; may vary by state)
• Medical, dental, and vision coverage
• 2 floating holidays (prorated based on start date)
• 1 volunteer day
• 401(k) company match (IDC matches 3% on the first 6% of employee contributions)
• Company-paid short-term disability
• Company-paid life insurance
• Company-paid parental leave

Compensation

Transparency At IDC, we are committed to fair and equitable pay practices. Employees are compensated equitably for their work, aligned with their skills and experience. Salary and incentive structures are determined through a rigorous process that considers experience, education, certifications, role-specific requirements, internal equity, and verified U.S. market data from an independent third-party partner.The expected total annual compensation, depending on location and experience, is between $130,000 – $195,000 USD, inclusive of base salary and variable compensation.This is an evergreen posting used to identify and engage potential candidates for future opportunities. Timing and availability of openings may vary. Equal Opportunity Employer IDC is committed to providing equal employment opportunities for all qualified persons. Employment eligibility verification required. We participate in E-Verify. IDC is currently able to employ remote workers in the following states: Arizona (AZ), California (CA), Colorado (CO), Connecticut (CT), Washington D.C. (DC), Florida (FL), Georgia (GA), Illinois (IL), Indiana (IN), Kansas (KS), Massachusetts (MA), Maryland (MD), Maine (ME), Michigan (MI), Minnesota (MN), Missouri (MO), Mississippi (MS), North Carolina (NC), New Hampshire (NH), New Jersey (NJ), New York (NY), Ohio (OH), Oregon (OR), Pennsylvania (PA), Rhode Island (RI), South Carolina (SC), Tennessee (TN), Texas (TX), Utah (UT), Virginia (VA), Vermont (VT), Washington (WA), and Wisconsin (WI). #LI-JF1#LI-Remote Apply tot his job Apply To this Job