Data Analyst (100% Remote)

Our Customer is a technology company that connects people with the best of their neighborhoods across the US, Canada, Australia, Japan, and Germany. They enable local businesses to meet consumers’ needs of ease and convenience, and, in turn, generate new ways for people to earn, work, and live. By building the last-mile logistics infrastructure for local commerce, they’re fulfilling our mission to grow and empower local economies.

We are seeking a Data Analyst on a contract basis to help support our Customer's business needs. This role is 100% remote.

Responsibilities:

LLM Evaluations & Insight Generation

• Conduct end-to-end LLM evaluations and generate actionable insights
• Write evaluation rubrics and develop prompts for LLM testing
• Scrape data using internal tools
• Collect and annotate golden labels for model evaluation
• Collaborate with internal teams to calibrate model quality
• Run evaluations continuously and maintain reporting dashboards
• Analyze evaluation results and provide insights to improve processes and model performance

Vendor Coordination & Task Management

• Serve as the primary liaison between the company and third-party vendor teams
• Manage assignments, deadlines, and QA for vendor evaluators
• Provide instructions, clarifications, and feedback to vendor teams

Internal Support & Triage

• Act as the first point of contact for inbound questions related to evaluation tasks
• Route questions to the appropriate stakeholders
• Track open items and ensure timely follow-through

Skills and Qualifications:

• Prior experience in data analysis or a similar role
• Demonstrated interest in LLMs and modern AI tools
• Proficiency with Google Workspace, especially Google Sheets
• Basic SQL skills, including the ability to write simple queries and troubleshoot results
• Familiarity with Google Drive and documentation best practices
• Bonus: experience with prompt engineering
• Ability to work independently with strong attention to detail
• Excellent written and verbal communication skills
• Ability to work effectively in a fast-paced, high-accountability environment

Preferred Attributes

• Self-starter with curiosity and a resourceful mindset
• Enjoys solving ambiguous problems
• Strong collaborator across product, engineering, and vendor teams
• Interest in growing into a full-time opportunity

We offer a competitive salary range for this position. Most candidates who join our team are hired at the median of this range, ensuring fair and equitable compensation based on experience and qualifications.

Contractor benefits are available through our 3rd Party Employer of Record (Available upon completion of waiting period for eligible engagements)

Benefits include: Medical, Dental, Vision, 401k.

An Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or protected veteran status and will not be discriminated against on the basis of disability.