TikTok • Austin, TX • Posted 30+ days ago
Responsibilities
About E&I
Evaluation & Investigation is a department within Search Operations that is tasked with the optimization of user experiences within the search function of our platform. We are tasked with ensuring the highest quality, most relevant, and up-to-date information is readily available upon recall. Our job has a significant impact on users all over the world and we take pride in pairing data analysis with market knowledge to provide a refined search experience.
Responsibilities
- Complete regular assessments relating to AI model quality in accordance with evaluation standard documents
- Use evaluation methods to complete daily strategy assessment of AI model quality in accordance with evaluation standard documents.
- Comb the types of AI model bad cases and rate the quality of the results.
- While it is assumed the evaluator will focus on their area of expertise, there will be occasions in which they will work on projects outside this core area that could require other capabilities, such as using assessment methods. Adaptability to support related projects is a must.
Qualifications
Minimum Qualification(s)
- Bachelor's degree or above
- Knowledge about AI, or related models, and its role within search functions, as well as familiarity with social media platforms
- An in-depth understanding of local culture and familiarity with the Internet usage habits of local users
- Strong ability to learn, retain complex procedures, and seek knowledge when necessary
- Familiar with common office software
- High spoken and written proficiency in English and Spanish. The Spanish skill set is required to evaluate quality cases from the MX Market and other case analysis/investigations.
Preferred Qualification(s)
- Search evaluation experience is preferred.