Software Engineer, Trust & Safety Job at Gamma, San Francisco, CA

  • Gamma
  • San Francisco, CA

Job Description

Why this role matters now

AI has dramatically lowered the barrier for bad actors. Generating convincing phishing pages, spinning up realistic-looking fraudulent accounts, and producing abusive content at scale no longer requires specialized skill—a motivated attacker with access to widely available models can do it. The volume and sophistication of platform abuse is increasing faster than traditional approaches can keep up with.

At the same time, AI is transforming what's possible on the defensive side. A small, sharp T&S team equipped with frontier models can now build detection, triage, and response systems that would have required a team five times the size just a couple of years ago. AI-assisted content scanning, automated investigation workflows, and intelligent alert prioritization mean that a lean team can protect millions of users—if they build the right infrastructure.

About the role

Gamma is tackling one of the most critical challenges for any fast-growing AI platform: keeping millions of users safe while preserving the creative freedom that makes the product magical. As a Trust & Safety Engineer, you'll architect the systems that protect our platform from phishing, abuse, fraud, and malicious content, all while ensuring Gamma stays fast, reliable, and delightful to use.

You'll join a small, high-impact team building the foundation for trust at scale. You'll design infrastructure that serves millions, ship improvements daily, and build the internal tools that let our support teams act quickly on threats. You'll collaborate across engineering, product, and design to define how Gamma approaches safety for the long term.

Our team has a strong in-office culture and works in person 4–5 days per week in San Francisco. We love working together to stay creative and connected, with flexibility to work from home when focus matters most.

What you'll do

  • Own detection and prevention systems for fraud, abuse, spam, and malicious content across millions of daily users

  • Design and build scalable trust infrastructure including rate limiting, content scanning, anomaly detection, and account security

  • Build tools that empower internal support teams to investigate and act on suspicious or malicious activity

  • Investigate and resolve complex security incidents with limited context

  • Partner with engineering and product to balance security with user experience

  • Shape Gamma's long-term trust and safety strategy and technical roadmap

  • Leverage AI/LLM-based detection to stay ahead of AI-generated abuse—phishing, fraud, and malicious content that's increasingly indistinguishable from legitimate activity

  • Build automated triage and investigation workflows that let a small team operate at the scale of a much larger one

What you'll bring

  • 5+ years as a software engineer with a focus on abuse, spam, or fraud prevention

  • Strong systems thinking and experience building highly available web APIs, with proficiency in at least one programming language and comfort working across a modern web stack

  • Hands-on experience implementing trust features like rate limiting, content detection, and fraud prevention

  • Experience with event streaming systems (Redis, Kafka, or similar)

  • Passion for security, user protection, and solving problems at scale

Nice to have

  • Experience with AI/LLMs for content moderation, or familiarity with TypeScript, Prisma, Apollo GraphQL, or AWS

  • Experience building AI-assisted moderation pipelines or using frontier models for automated abuse detection and response

  • Familiarity with the evolving AI threat landscape—how generative models are being used for phishing, social engineering, and content abuse at scale

Compensation range:

The base salary for this full-time position, which spans multiple internal levels depending on qualifications, ranges between $180K - $310K plus benefits & equity.

Final offer amounts are determined by multiple factors, including but not limited to experience and expertise in the requirements listed above.

If you're interested in this role but you don't meet every requirement, we encourage you to apply anyway! We're always excited about meeting great people.

Job Tags

Full time, Work at office, Work from home

Similar Jobs

The Sherwin-Williams Company

Summer Finance-Intern, Accounting Job at The Sherwin-Williams Company

 ...reporting, and journal voucher creating and uploading. This is a summer internship and would be required to work 37.5 hours per week. Because...  ...a bachelor's program or higher with a focus in accounting or finance - Must be able to work in the office, 37.5 hours per week... 

Allstate

Licensed Insurance Sales Representative (Remote / Home-Based) Job at Allstate

 ...Insurance Sales Representative At Allstate, great things happen when our people work together to protect families and their belongings from...  ...SMS, and more in a work from home call center environment....  ..., including: ~ Health, dental, and vision insurance ~401... 

BJC Healthcare

Acute & Intermediate Med/Surg Clinical Nurse RN Job at BJC Healthcare

 ...provides comprehensive care for patients with complex conditions including heart and renal failure, endocrine disorders, GI diseases, infectious diseases, respiratory illnesses, and hematologic conditions. NeuroSciences: The department includes Neuro Medicine units... 

TravelNurseSource

Travel Nurse RN - Wound/Ostomy - $3,046 per week in Newport Beach, CA Job at TravelNurseSource

 ...Registered Nurse (RN) | Wound/Ostomy Location: Newport Beach, CA Agency: Lancesoft Inc Pay: $3,046 per week Shift Information: Days - 5 days x 8 hours Contract Duration: 13 Weeks Start Date: 9/14/2026 About the Position TravelNurseSource... 

Honda Aero, LLC.

Aviation Quality Inspector Job at Honda Aero, LLC.

What Makes a Honda, is Who makes a Honda Honda has a clear vision for the future, and its a joyful one. We are looking for individuals with the skills, courage, persistence, and dreams that will help us reach our future-focused goals. At our core is innovation. Honda...