AI Lip-Sync Animation Developer (iOS App Integration)

Job Title: AI Lip-Sync Animation Developer (iOS App Integration)

Job Description

We are seeking a developer/animator who can create a lightweight, in-house alternative to services like D-ID or HeyGen. The goal is to animate a single 2D character (named Iris), based on existing AI-generated portraits, so she can lip-sync spoken dialogue in our iOS app. The app will take ChatGPT responses, convert them to speech via TTS (e.g., ElevenLabs/Azure/Polly), and animate Iris’s mouth movements in sync with the audio.

We are not looking for a SaaS subscription model; we want a home-built solution that runs locally or via our own backend, so we avoid per-video costs.

Responsibilities

• Build or adapt a lightweight lip-sync animation system (2D) that works in real time or near-real time.
• Integrate TTS output (audio + visemes/phoneme timings) with a static Iris image to generate simple animated mouth movement.
• Package the animation so it can be embedded in an iOS app (Swift/SwiftUI or cross-platform framework).
• Ensure the animation looks similar in quality to D-ID’s “talking photo,” but optimized for low cost and scalability.
• Deliver clean, documented code that can be maintained and expanded.

Requirements

• Experience with lip-sync animation pipelines (e.g., Wav2Lip, SadTalker, Rhubarb Lip Sync, or custom viseme mapping).
• Strong skills in iOS app development (Swift, SwiftUI, or Flutter/React Native acceptable).
• Familiarity with integrating TTS APIs (ElevenLabs, Azure Speech, Amazon Polly, etc.) and handling phoneme/viseme timing.
• Ability to work with static character art and animate minimal but convincing facial movement.
• Portfolio or demos of previous animation or app projects.

Preferred Qualifications

• Experience optimizing real-time animation for mobile devices.
• Understanding of efficient GPU/CPU usage for lightweight lip-sync.
• Background in both development and simple 2D character animation.

Contract Type

• Independent contractor / project-based.
• Remote work acceptable.

Compensation

• Negotiable based on experience and deliverables. Please include rate expectations with application.

How to Apply

Submit resume, relevant portfolio or demo links, and a brief explanation of how you would approach building a D-ID-style lightweight animation system for iOS.

Job Type: Contract

Pay: $25.00 - $40.00 per hour

Expected hours: No less than 1 per week

Work Location: Remote