AI Risk Assessment Analyst (AI Programs)

Common Sense Media · San Francisco, CA

Data + Analytics
Health & Well-Being
Public Service & Civic Engagement
Education
$85,600 - $101,650 Per Year
Posted 3 days ago

Excel
Automated Testing
Python
Report an Issue
Featured Job

AI Risk Assessment Analyst (AI Programs)

Common Sense Media is dedicated to improving the lives of kids and families by providing the trustworthy information, education, and independent voice they need to thrive. Our ratings, research, and resources reach more than 150 million users worldwide and 1.4 million educators every year. Learn more at commonsense.org.

Job Overview:

Our AI Programs team works at the forefront of AI's impact on kids, families, and schools, and is focused on AI thought leadership, AI evaluations, AI literacy, and the creation of practical resources for families and educators.


The AI Risk Assessment Analyst will execute comprehensive evaluations of AI tools and platforms used by children, teens, and educators, under the strategic direction of the Senior Director, AI Programs. This is a highly collaborative role focused on rigorous execution of assessment protocols, data analysis, and report development within an established framework and methodology. The AI Risk Assessment Analyst will also contribute to process improvements to evolve our risk assessment framework and methodology as AI use cases and products continue to evolve.

 

Working closely with the Senior Director and an AI Risk Assessment Fellow, this position will implement systematic evaluation processes, conduct technical testing procedures, and contribute to public-facing analysis that shapes industry standards for AI youth safety. The analyst will be responsible for implementing assessment protocols as directed. In service of understanding risks to children, the analyst will be required to conduct evaluations of a range of sensitive content, including but not limited to mature themes, harmful language, inappropriate sexual content, violence, self-harm, and other potentially disturbing material. As such, the AI Risk Assessment Analyst must possess the professionalism, emotional resilience, and analytical detachment necessary to evaluate disturbing material while maintaining clear boundaries and focusing on child safety outcomes.

 

Location: San Francisco, CA

Reports To: Senior Director of AI Programs

Salary: $85,600–$101,650 per year

Type: Full-time, exempt

 


What You'll Do:

Assessment Execution & Implementation

  • In collaboration with the Senior Director, design and execute risk assessment test plans that evaluate AI tools and platforms used by kids, teens, and K–12, including conducting comprehensive evaluations of major AI platforms and emerging educational AI tools while following established methodologies.
  • Implement systematic prompt testing procedures using technical tools (e.g., Python scripts, API calls, and automated testing frameworks).
  • Apply standardized evaluation frameworks as directed across different AI applications and use cases. 

Technical Testing & Data Analysis

  • Run batch and manual prompt testing plans to produce AI system outputs across a range of scenarios to systematically assess AI tool behaviors, safety mechanisms, and content appropriateness.
  • Process and analyze large data sets from testing procedures to identify patterns, risks, and safety considerations.
  • Handle sensitive content evaluation, including potentially triggering or challenging material related to youth safety concerns.

Research & Literature Review

  • Conduct comprehensive background research on AI tools and platforms under assessment, including literature reviews, technical documentation analysis (model cards, system cards, safety documentation), and media coverage.
  • Synthesize research findings from academic papers, industry reports, and technical specifications to inform assessment approach and contextualize findings.
  • Prepare research briefs that summarize key background information, known risks, and relevant technical details to support assessment planning and execution.
  • Stay current with emerging research on AI safety, youth development, and platform risk assessment methodologies as directed.
  • Compile and organize assessment data into structured formats for analysis and reporting.
  • Document testing procedures and findings.

Report Writing & Communication

  • In collaboration with the Senior Director and team, translate complex technical findings into clear, accessible reports for diverse audiences, including educators, parents, policymakers, and industry stakeholders.
  • Draft assessment reports using Common Sense Media's voice, tone, and editorial standards.
  • Prepare executive summaries and key findings briefs for different stakeholder groups and communication channels, including clear data visualizations and summary materials.
  • Adapt communication style for various audiences while maintaining accuracy and analytical rigor.
  • Collaborate with Senior Director to develop public-facing risk assessment reports that meet Common Sense Media's standards for accuracy and accessibility.

Project Coordination & Team Support

  • Manage assessment project timelines and deliverables in coordination with organizational priorities.
  • Supervise Risk Assessment Fellow in executing research, assessment, and writing tasks.
  • Coordinate with subject matter experts and contractors for specialized testing or expertise as directed.

Partnership Support

  • Support collaborations with frontier labs by executing testing plans and analyzing outputs for compliance with policies.
  • Contribute to Advocacy team priorities by providing data and analysis to support recommendations.
  • Assist with business development efforts by conducting technical evaluations of potential partner platforms.

 

What We're Looking For:
Required Qualifications

  • Education: Bachelor's degree in relevant field (computer science, psychology, education, public policy, or related).
  • Experience: 3–5 years in research, data analysis, content moderation, or safety evaluations. 
  • Technical Proficiency: Demonstrated experience with technical tools to support automated testing.
  • Research Skills: Strong analytical skills, with experience in systematic evaluation methodologies.
  • Communication: Excellent written communication, with the ability to document complex technical findings clearly.
  • Content Safety Experience: Ability to handle sensitive, potentially upsetting content related to youth safety in a professional context.


Preferred Qualifications

  • Previous experience in AI safety research, platform trust and safety, or technology risk assessment.
  • Background in child development, educational psychology, or youth-focused research.
  • Experience with data analysis and methods.
  • Familiarity with AI platform APIs and testing frameworks.
  • Knowledge of privacy regulations and educational technology compliance requirements.
  • Experience working in collaborative, mission-driven organizations.


Core Competencies

  • Execution Excellence: Strong organizational skills, with the ability to manage multiple concurrent projects and deliver high-quality work on deadline.
  • Technical Aptitude: Comfortable learning new tools and technologies while maintaining proficiency with existing technical requirements.
  • Collaborative Approach: Effective partnership skills for working closely with AI Program Team and cross-functional teams.
  • Detail Orientation: Meticulous attention to accuracy in data collection, analysis, and documentation.
  • Professional Resilience: Ability to engage with challenging content while maintaining objectivity and professional boundaries.
  • Adaptability: Flexibility to adjust approaches and priorities based on strategic direction and emerging needs.


Our Benefits:

  • The chance to work with talented, passionate professionals. 
  • A great health and welfare benefits package, including medical, dental, vision, a matching 401(k), and other key benefits.
  • An organization that offers work/life balance.
  • The opportunity to really make a difference in the lives of kids and families!

 

Common Sense Media provides equal employment opportunities to all qualified individuals and prohibits discrimination and harassment of any type without regard to race, color, religion, sex, gender identity, sexual orientation, pregnancy, age, national origin, physical or mental disability, military or veteran status, genetic information, or any other protected classification or characteristic protected by federal, state, or local laws.

Common Sense Media will also consider for employment qualified applicants with arrest and conviction records. However, job offers are made on the condition that the applicant subsequently passes a criminal background check. If the background check indicates a prior criminal conviction, we will conduct an individualized assessment to determine whether the conviction should result in denial of employment. Pursuant to the San Francisco Fair Chance Ordinance, we will consider employment for qualified applicants with arrest and conviction records.

Related Jobs

Performance Marketing Manager - Common Sense Media
San Francisco, CA - Posted 3 days ago
Communications Director - Common Sense Media
San Francisco, CA - Posted 1 day ago
View more open tech jobs in San Francisco, CA
Be the first to see new AI Risk Assessment Analyst (AI Programs) jobs

Save this search to get an email when new jobs match this search.

Create Email Alert