Task Description
This job requires performing QA testing for one of the upcoming feature launches for Android-based smartphones. This TVC will work with an engineering team to run commands on the command line while monitoring the state of a connected device for agentic actions. This testing needs to be run weekly and the TVC will analyze the resulting traces of screenshots and metadata, label them as successful or failure, and writing notes where necessary to improve the success rate of agentic actions.
Responsibilities:
Perform QA tasks by closely following instructions on a weekly basis
Run commands on the command line while monitoring the state of a connected device
Analyze the resulting traces of screenshots and metadata, and label them as successful or failure, writing notes where necessary
Group traces according to failure patterns, out of the ordinary situations, and flag issues and bugs
Present test results to the engineering team with detailed reports, with links to the traces and evaluation results on a spreadsheet
Requirements:
Ability to work independently with remote supervision
Take initiatives
Eagerness to dig deep systematically and repeatedly
Good spreadsheet analysis and reporting skills
Knows how to run commands on the command line, often with multiple parameters depending on the task at hand
Good analytical skills
Write detailed bug reports
Analyze failure patterns, and group them in categories that are useful for debugging
Good working knowledge of the Android ecosystem
Preferred skills / Nice to have:
Coding skills.
Bug report and stack trace analysis.
CS or Engineering background.