Data Researcher (Generative AI Analytics)

Data Researcher (Generative AI Analytics)

Day 1 onsite Sunnyvale, CA / Austin, TX / Elk Grove, CA (Prefers local folks)

Hybrid – 3 days onsite and 2 days remote

Long term contract

Direct client opportunity

No mid layer / No Implementation partners are Involved

Mode of Interview: 1 Round Virtual Interview Mostly

We're looking for a Data Researcher/Data Scientist with a strong research mindset to evaluate Generative AI and LLM-powered analytics agents through rigorous experimentation.

Required Skills

• 5+ years of Data Science experience (Python, SQL, Snowflake)
• Experience with Generative AI, LLMs, Prompt Engineering, RAG, or AI Agents
• Strong background in experimental design, hypothesis testing, and statistical analysis
• Experience evaluating AI/ML model performance and documenting reproducible research.
• 3+ years of hands-on experience designing controlled experiments — forming hypotheses, holding conditions constant while varying one thing at a time, establishing baselines, and designing against bias.
• 1+ year of hands-on experience constructing AI agents and using AI for analytics — prompt engineering, model/parameter control (temperature, etc.), programmatic API access, retrieval/RAG, and agent architecture..
• Experienced enough to modify these components confidently, because they are the variables you’ll be manipulating.
• 5+ years of data science fundamentals, including Python, SQL, and Snowflake; ability to reason about metrics and define what a “correct answer” to an analytical question actually is.
• 3+ years of experience evaluating model / ML system performance — measuring error and variability rigorously (percent error, distributions, reproducibility) and reasoning about failure modes.
• 5+ years maintaining disciplined, reproducible documentation — structured logging and records another person could re-run.

Skills

• SQL – 5-10 Years
• Statistical analysis – 5-10 Years
• Data Science – 5-10 Years
• Data Visualization – 5 - 10 Years
• Research – 5-10 Years
• Experimental design – 5 - 10 Years
• AI Agent – At least 1 year
• python - 5-10 Years

Preferred Qualifications

• Experience specifically evaluating LLM performance — measuring correctness and repeatability of non-deterministic systems.
• Tableau or similar visualization platforms.
• Domain familiarity with support / operations / IT analytics.
• Prior experience presenting research findings to executive audiences.

Pay Range

$65/hr - $70/hr

The specific compensation for this position will be determined by a number of factors, including the scope, complexity and location of the role as well as the cost of labor in the market; the skills, education, training, credentials and experience of the candidate; and other conditions of employment. Our full-time consultants have access to benefits including medical, dental, and vision as well as 401K contributions.