Job Title: Data Operations and Market Analyst (Content Producer I)
Location: Cupertino, CA 95014 (Hybrid)
Duration: 6 Months
Pay Range: Between $27/hr-$32/hr on W2 (DOE)
Description:
- Native-level fluency and Strong written communication skills in the US English language is essential to this role.
- Linguistic/cultural skills: expert knowledge of grammar, spelling, and cultural appropriateness to accurately represent user experience early in the software development cycles.
- Ability to work cross-functionally with Design, Product, Editorial, Safety, and Engineering teams to deliver quality on time. Collaborate with cross-functional teams to precisely define the evaluation requirements necessary for Machine Learning/ Large Language Model implementation across different projects.
- Ensure data quality is maintained at high standards and continually enhance processes based on both quantitative and qualitative feedback
Responsibilities may include, but are not limited to:
- Evaluating content, researching and verifying the accuracy of relevant metadata pertaining to different media types.
- Quality assurance reviewing, verifying, editing, scoring, transcribing, copywriting, and reporting on data and/or assets across a broad scope of media and content types.
- Problem solve, provide clear suggestions/feedback to leads, and effectively communicate recommendations to both editorial and engineering teams.
- Leverage established workflows and tooling for various content tasks. Collaborate and follow guidance from the Project Lead, Style Guides, and Terminology Databases on all matters related to the style and project requirements.
- Experience in Large Language Models and knowledge about LLM evaluation techniques, such as human evaluation and automated benchmarks is desirable.
- Conduct research with humans to validate and create automated benchmarks for LLM evaluations. Collect data from human participants (e.g., surveys, experiments) with knowledge about data quality, data validity, etc.
- Advanced degree in linguistics, computer science, machine learning, cognitive science, psychology, economics, or similar (preferred).
- 3+ Years of experience is needed.
Benefits Info:
Russell Tobin offers eligible employee’s comprehensive healthcare coverage (medical, dental, and vision plans), supplemental coverage (accident insurance, critical illness insurance and hospital indemnity), a 401(k)-retirement savings, life & disability insurance, an employee assistance program, identity theft protection, legal support, auto and home insurance, pet insurance, and employee discounts with some preferred vendors.
