Content Risk Analyst, ASCI

Alexa is the voice activated digital assistant powering devices like Amazon Echo, Echo Dot, Echo Show, and Fire TV, which are at the forefront of this latest technology wave. To preserve our customers’ experience and trust, the Alexa Sensitive Content Intelligence (ASCI) team creates policies and builds services and tools through Machine Learning techniques to detect and mitigate sensitive content across Alexa. In this role, you will work on essential back-end operations that help maintain the quality and accuracy of our AI initiatives. This role involves basic data tasks, such as creating, reviewing, and managing test data sets. The ideal candidate is detail-oriented, willing to learn, and ready to contribute to the smooth operation of our team’s day-to-day tasks.

Key job responsibilities
Key job responsibilities
1. Enhance AI-related responsibilities:

• Lead the creation and annotation of MLOGs for model improvement across multiple domains
• Conduct in-depth audits of machine and manual annotations, providing detailed Insights
• Oversee data collection and quality for complex AI models (e.g. security, social engineering)

2. Red-teaming:

• Design and execute comprehensive red teaming strategies across multiple Alexa experiences
• Analyze red teaming results to identify trends and high-priority issues
• Collaborate with stakeholders to develop mitigation strategies for identified vulnerabilities

3. Augment customer feedback responsibilities:

• Lead the analysis of complex customer feedback, including emerging trends and edge cases
• Provide insights and recommendations based on customer interaction data

4. Enhance incident monitoring and escalation handling:

• Oversee the monitoring process for policy violations and emerging issues
• Handle complex escalations and coordinate with cross-functional teams for resolution
• Contribute to the development and refinement of monitoring processes and tools

5. Add process improvement and team leadership aspects:

• Propose and implement process improvements to enhance operational efficiency
• Mentor and provide guidance to L2 team members
• Contribute to the development of training materials and best practices

6. Expand required skills and qualifications:

• In-depth understanding of AI/ML concepts, including current trends and challenges
• Strong analytical and problem-solving skills, particularly for complex AI-related issues
• Excellent communication skills for collaborating with various stakeholders
• Ability to manage multiple priorities and adapt to rapidly changing requirements in the AI field