Label Quality Specialist, Moderation, Trust and Safety,
About The Position
As the Label Quality Specialist , Moderation, Trust and Safety, you will report to the Senior Director of Trust and Safety, and play an essential role in keeping our community and our platform safe. You will be managing the end to end label quality measurement program for our human and automated moderation workflows. You will understand and enforce our community standards and other policies regarding Developer and User activity on our platform. You will engage deeply with our XFN teams across Policy, Product, Engineering and others to help develop and execute solutions. Protecting our community is important to you. You will report to the Senior Director, Moderation.
Requirements
- 4-5 years of experience in managing Trust and Safety programs, with a strong interest in quality assurance
- Strong program management skills, with experience leading projects at scale
- Experience developing processes to improve operational efficiency
- Experience using data to lead decision-making
- Strong collaboration skills, with the ability to work with cross-functional teams, specifically Product Policy, Engineering, Data Science and Operations
Responsibilities
- Operationalize the label quality measurement workflow at Roblox to deliver high fidelity ground truth data sets for both human and AI/ML based moderation systems
- Work closely with Product Policy, Engineering, Data Science and Safety Operations teams to ensure high quality ground truth data sets are delivered on a regular basis.
- Identify, evaluate, prioritize and resolve policy, process and tolling gaps through deep root cause analysis
- Manage the end-to-end ground truth dataset creation process including scoping, planning, reviewer coordination, quality checks, and final delivery
- Act as the subject matter expert on Roblox policies and processes, ensuring accurate and consistent implementation across all product and asset types. Developing a deep understanding of these guidelines.
- Collaborate closely with outsourcing partners to scale ground truth dataset creation and ensure high quality data is being delivered by the outsourced partners.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed
Number of Employees
1,001-5,000 employees
