AI Vocal Coach with Real-Time Pitch Feedback
On-device real-time pitch feedback during Zoom vocal lessons so students see intonation while they sing and coaches stop rewinding recordings.
Most vocal training is broken in a specific way. You sing the exercise. Then the coach rewinds the Zoom recording and tells you what went wrong 30 seconds ago. By then you have already forgotten what your voice felt like in that moment. Students who practice alone all week drill the same mistake into muscle memory until the next lesson. It is learning to shoot a basketball blindfolded and finding out you missed after fifty shots. Zoom cannot give real-time pitch feedback. Latency and compressed audio make live pitch overlays on the coach's machine a lie — the student already sang the note. Apps like Yousician score you after the phrase in a self-paced curriculum that a working vocal coach cannot steer. Melodyne and Auto-Tune are accurate and live in a DAW, which means the teacher records, exports, and inspects contours after the lesson. That workflow is why coaches lose an hour or two a week to clip review.
Built for Solo Founders, Developers, Non-Technical.
Suggested stack: Next.js 15 + Web Audio API, Pitch detection in WASM, LiveKit or Daily (optional), Supabase, Stripe Billing, Vercel. Weekend scope: about 8 hours.
The Problem
Most vocal training is broken in a specific way. You sing the exercise. Then the coach rewinds the Zoom recording and tells you what went wrong 30 seconds ago. By then you have…
The Solution
VocalCoach Pro (PitchCoachAI in the research) runs on the student's device. The Web Audio API captures the mic locally, a pitch tracker lights a meter green or red against the…
Market Research
Online music education is estimated between about $4B and $17B today, heading toward $10–$86B over the next decade at roughly 8–18% CAGR depending on the report. The vocal/singing…
Competitive Landscape
Yousician — Category leader for interactive, mic-scored lessons across instruments including voice. Consumer subscription, huge brand, polished UX. Built for self-paced curricula…
Business Model
Student Starter ($9/month) — Real-time meter, basic exercises, 4-week history
Recommended Tech Stack
Next.js 15 + Web Audio API — Lesson room as a client component; AudioWorklet for capture; no server in the pitch loop.
AI Prompts to Build This
Copy these build prompts into Claude, Cursor, or your AI coding tool. Create a free account to unlock the full research behind them.
1. Project Setup
Build the weekend MVP of "VocalCoach Pro": real-time pitch feedback in the browser for online vocal lessons. Stack: Next.js (App Router), TypeScript, Tailwind, the Web Audio API with an AudioWorklet and a WASM or plain-JS pitch tracker, Supabase (Postgres, Row Level Security, Storage, Realtime, Auth with email magic link). Deploy on Vercel. Pitch is computed in the browser. Never send audio to the server. Tables (Row Level Security on, a student reads their own sessions and a coach reads their students'): - coaches(id, user_id, name) - students(id, user_id, coach_id, name) - exercises(id, name, targets jsonb, cents_tolerance) - sessions(id, student_id, exercise_id, started_at, on_pitch_pct, fmin, fmax, flags jsonb) Screens: /practice (the student's pitch meter), /coach (the overlay, exercise picker and roster). Env vars (names only): NEXT_PUBLIC_SUPABASE_URL, NEXT_PUBLIC_SUPABASE_ANON_KEY, SUPABASE_SERVICE_ROLE_KEY (server only). Do not build: billing or plans, an LLM, a video room (the lesson stays on Zoom), a server-side audio path, a school or studio account. Done when: npm run dev starts, the browser asks for the microphone, you can sign in, and the four tables exist with Row Level Security on.
2. Core Feature
Build the one feature that proves VocalCoach Pro: a pitch meter a student can trust while they sing. 1. An AudioWorkletProcessor reads input at 48 kHz, estimates the fundamental frequency with autocorrelation, ignores frames below a noise gate, converts it to a MIDI note and the cents off the current target note from the exercise, and posts { midi, cents, rms, t } to the main thread about 30 times a second. 2. The student view shows a horizontal target line for the current note, the pitch curve for the last 3 seconds, a green meter when the cents off is within the exercise's cents_tolerance (default 30) and red otherwise, and a large numeric cents readout. 3. The coach overlay reads the same data over a Supabase Realtime channel of metadata only. If the channel fails, the student meter still works fully offline for that take. 4. Exercises are JSON { name, bpm, notes: [{ midi, startMs, endMs }] }. Ship three: a five-note major scale on A3, a glissando siren, and a sustained "gee" on one note. 5. On stop, compute on_pitch_pct (the share of voiced frames inside tolerance) and fmin and fmax of the voiced frames, flag every 500 ms window with more than 50 cents off, and save the session. A coach can click a flag and record a 10-second voice note (MediaRecorder) saved to Storage and linked from that flag. Rules: the meter is never color-only. Show the numeric cents readout and an aria-live announcement of "on pitch", "sharp" or "flat", throttled to once a second. Empty state: before the microphone is allowed, show one sentence on why it stays on the device. Done when: singing the A3 scale shows the meter turning green on pitch, a sharp note reads positive cents and announces "sharp", and a stopped take saves its on-pitch percentage and flags.3. Landing Page
Build a one-page landing site for VocalCoach Pro, real-time pitch feedback for online vocal lessons. Hero: "See your pitch while you sing." Sub: "On-device feedback beside your Zoom window, so coaches stop rewinding recordings." One button: Join the waitlist. Sections: the problem (correction after the fact is too late to feel), how it works in four steps (open the lesson room, load the exercise, sing against the meter, review the take), a mock pitch meter with a green and a red moment, and an FAQ on privacy (the audio never leaves the device) and which browsers work. Waitlist: store the email in a waitlist table in Supabase. No other service. Voice: clear and encouraging, written for a vocal coach. Done when: the page renders on a phone and a submitted email appears in the waitlist table.
4. Branding Package
Use a design or image tool for this one. A coding agent cannot draw a logo. Brand for VocalCoach Pro: a wordmark and an icon that suggest a sound wave settling onto a note. Colors: near-black, warm white and one calm accent, with green and red reserved for on-pitch and off-pitch. Type: one friendly sans for the interface and tabular numbers for cents. Deliverables: wordmark, icon, a pitch-meter style with a numeric readout, and one launch graphic. Done when: each deliverable is saved in one folder and the meter reads without color.