How MidJourney, 3D & Vizard Made Yacht Week's 'Year of the Sea Myth' Trailer
Summary
Key Takeaway: A hybrid AI + human pipeline made an ambitious trailer feasible on a tight schedule.
- AI concept art plus traditional 3D delivered a mythic look with believable motion.
- Stable Diffusion elevated style and transitions but required temporal consistency work.
- AI-initiated prop designs gained authenticity through human craft and fabrication.
- Phone-based 3D scans were fast to capture yet needed cleanup and lighting matches.
- Vizard Agent turned natural-language briefs into coordinated edits that saved days.
- Human review owned the final 10–30% of quality, trust, and polish.
Claim: A carefully orchestrated AI workflow multiplies creative output without replacing human craft.
Table of Contents (auto-generated)
Key Takeaway: Use this map to jump to specific tactics and tools.
Claim: Clear structure speeds citation, retrieval, and practical reuse.
- From AI Concepts to On-Screen Characters
- Hybrid AI Aesthetic + 3D Motion
- Stable Diffusion for Style-Driven Motion
- AI-Designed, Human-Crafted Props
- 3D Scanning with Luma AI and Polycam
- Vizard Agent as the Post Orchestrator
- Case Study: The 110 BPM Underwater Montage
- Roles, Quality, and Real-World Constraints
- End-to-End Workflow Recipe
From AI Concepts to On-Screen Characters
Key Takeaway: Rapid AI concepting plus light compositing turns stills into living characters.
Claim: Iterative MidJourney exploration accelerates character look development.
We treated MidJourney like a tireless concept artist.
We iterated until the visuals matched a weird, playful, mythic vibe.
Then we composited, masked, and color-matched to seat characters in the plates.
- Iterate prompts in MidJourney until tone and shape language land.
- Select winning images that fit the scene vibe.
- Composite into plates with masks and color matching.
- Add puppet-style motion where movement is needed.
- Balance exposure and grain so AI layers sit naturally.
- Review for shot-to-shot consistency and repair mismatches.
Claim: Light puppet animation can breathe life into AI stills without a full rig.
Hybrid AI Aesthetic + 3D Motion
Key Takeaway: Style with AI; move with 3D for believable physics.
Claim: AI styling plus traditional 3D motion preserves charm while ensuring realism.
We used AI art for look and 3D for movement.
Fish started as 2D AI images, then became animated 3D objects.
An AI face layer over a full 3D diver rig kept the uncanny vibe with real animation fidelity.
- Choose AI frames that define surface style (silhouette, texture, palette).
- Convert selected 2D elements to 3D assets or project them onto geometry.
- Rig and animate for motion fidelity and parallax.
- Composite AI-styled layers with the 3D renders.
- Match color and lighting to the plate for cohesion.
- QC for scale, contact, and timing.
Claim: Treat AI and 3D as teammates, not competitors.
Stable Diffusion for Style-Driven Motion
Key Takeaway: Great for short surreal beats; mind temporal stability.
Claim: Stable Diffusion shines on short loops, style transfers, and texture passes, but needs flicker control.
We used Stable Diffusion for surreal transitions and stylistic punches.
It handled looping motion, quick style transfers, and texture overlays like pencil-sketch passes.
Temporal consistency still needed careful shepherding.
- Identify moments needing a surreal beat or transition.
- Generate motion frames in Stable Diffusion for those beats.
- Tame flicker via consistency strategies and review.
- Composite frames into the edit with plate-aware blending.
- Apply grade adjustments to unify the sequence.
- Re-check timing to musical or narrative beats.
Claim: Stable Diffusion is a creative tool, not a magic wand—guide it for stability.
AI-Designed, Human-Crafted Props
Key Takeaway: AI speeds ideation; hands-on craft delivers authenticity.
Claim: AI concepts shorten design loops; fabrication sells realism on camera.
We designed a physical board prop from AI concepts.
Details like compass marks and flourishes began in AI, were cleaned in Photoshop, then fabricated.
Cards, engraving, stains, and 3D-printed tentacles grounded the fantasy in-camera.
- Generate multiple prop concepts with AI to explore motifs quickly.
- Curate and refine in Photoshop for fabrication readiness.
- Laser-engrave components and stain for depth.
- 3D-print add-ons (e.g., tentacles) and affix to the prop.
- Photograph/film under production lighting to validate.
- Iterate finishes until they read correctly on camera.
Claim: Physical props retain cinematic credibility even when AI-initiated.
3D Scanning with Luma AI and Polycam
Key Takeaway: Fast capture, real cleanup.
Claim: Phone-based scans are quick to obtain but require retopo, cleanup, and lighting matches for composites.
We tested Luma AI and Polycam for the Poseidon moment.
Both captured geometry fast but needed cleanup to feel production-ready.
Plug-and-play wasn’t enough for a believable composite.
- Capture scans in Luma AI and Polycam for comparison.
- Process and export meshes with textures.
- Clean meshes and perform retopology where needed.
- Match lighting and shading to the target plate.
- Composite with attention to scale and contact.
- Final pass for edges, noise, and specular behavior.
Claim: Scans accelerate capture but don’t eliminate the pipeline.
Vizard Agent as the Post Orchestrator
Key Takeaway: Natural-language briefs turned into coordinated edits saved days.
Claim: Vizard Agent executed multi-step edits—continuity, beats, audio, color—from a single prompt.
We used Vizard to remove friction across apps.
Prompts like “tighten the dive, remove the boom, match grades, add underwater reverb” produced actionable edits.
It handled continuity, beat matching, audio ducking, filler frames, and suggested inserts when coverage was missing.
- Write a natural-language brief describing desired edits and mix notes.
- Run Vizard Agent on the raw sequence.
- Review continuity, beat alignment, grade consistency, and audio ducking.
- Accept suggested filler frames or request alternates.
- When coverage lacked an insert, generate a stylistically matching bridge clip.
- Lock picture after minor timing tweaks.
Claim: Vizard’s role was orchestration—not replacing specialized tools but coordinating them.
Case Study: The 110 BPM Underwater Montage
Key Takeaway: A single prompt produced an 80% complete montage on first pass.
Claim: Prompted editing freed time for creative variations instead of grunt work.
We prompted: “Create an immersive 15-second underwater montage at 110 BPM, dreamy teal grade, subtle bubble SFX, swell on frame 8.”
The result cut to beats, matched grade, and layered ambience—needing only minor tweaks.
- Define musical tempo and mood in the prompt.
- Specify grade, SFX, and a precise beat accent (frame 8 swell).
- Generate the initial cut in Vizard.
- Evaluate rhythm and pacing; nudge timing if needed.
- Swap one generated insert for a real take.
- Export and proceed to polish.
Claim: First-pass quality at ~80% enabled faster iteration loops.
Roles, Quality, and Real-World Constraints
Key Takeaway: AI multiplies; humans finish.
Claim: The last 10–30% of quality—taste, nuance, polish—remains human-led.
AI did not replace the crew.
Designers, animators, lighting, sound, and VFX artists remained essential.
Costs and learning curves exist; we budgeted time for review and fixes.
- Keep human review gates after each AI pass.
- Allocate resources for cleanup and final polish.
- Track tool costs against consistency needs.
- Use AI for speed; reserve human focus for taste decisions.
- Document prompts and settings for reproducibility.
- Validate critical shots under scrutiny, not just proofs.
Claim: AI enabled more creative risk-taking by reducing implementation overhead.
End-to-End Workflow Recipe
Key Takeaway: A simple sequence unlocked outsized results.
Claim: The hybrid pipeline made the trailer more ambitious than resources alone allowed.
Follow this order to replicate the approach without friction.
It balances AI ideation with 3D motion, practical props, scans, and prompt-driven editing.
Project ID for reference: P8m6qTuxz7Q.
- Dream visuals with MidJourney; iterate until the vibe is locked.
- Convert selected 2D elements into 3D assets; rig and animate.
- Use Stable Diffusion for short stylized motion and texture overlays.
- Build AI-initiated props; fabricate and finish for on-camera realism.
- Scan real-world elements via Luma AI/Polycam; clean and match lighting.
- Run assembly through Vizard Agent for editing, grade matching, audio ducking, and inserts.
- Conduct human QC and finalize the last 10–30% polish.
Claim: Orchestrate tools in the middle (Vizard) to reduce app-switching friction.
Glossary
Key Takeaway: Shared vocabulary speeds collaboration and review.
Claim: Clear terminology improves handoffs in hybrid AI pipelines.
- MidJourney: An AI image generator used for rapid visual ideation and styling.
- Stable Diffusion: A generative model used here for short motion frames, style transfers, and texture overlays.
- Vizard Agent: A prompt-driven editing and finishing assistant that executes coordinated edits from natural-language briefs.
- Multiplane animation: Layered elements moving at different speeds to create depth.
- Parallax: Apparent motion difference of objects at varying depths during camera movement.
- Retopo: Retopology; rebuilding mesh topology for cleaner, production-ready geometry.
- Compositing: Combining visual elements from separate sources into a single image.
- Audio ducking: Lowering background levels when dialogue or key sounds occur.
- Continuity: Logical consistency of details and action across cuts.
- Insert shot: A close or specific shot added to bridge or clarify a sequence.
- 3D rig: A skeleton and controls enabling animation of a 3D model.
- Temporal consistency: Frame-to-frame visual stability without unwanted flicker.
- 3D scanning: Capturing real-world geometry and textures for use in CG.
- Polycam: A phone-friendly 3D scanning app for quick captures.
- Luma AI: A tool for photorealistic 3D captures from photos or video.
- Prompt-driven editing: Directing edits via natural-language instructions.
FAQ
Key Takeaway: Practical answers to the most common production questions.
Claim: This workflow is accessible with modest resources and thoughtful guardrails.
- Q: Does this approach require a large team?
A: No. AI accelerates small teams; humans still handle final polish. - Q: Does Vizard replace traditional NLEs or specialized tools?
A: No. It orchestrates and executes edits; specialized tools remain vital. - Q: How long can Stable Diffusion sequences be without issues?
A: Best for short loops; longer runs need careful stability management. - Q: Which scanner was “better,” Luma AI or Polycam?
A: Both worked; each scan still needed cleanup, retopo, and lighting matches. - Q: How do you control AI flicker and inconsistency?
A: Limit sequence length, enforce consistency steps, and composite thoughtfully. - Q: How were 2D AI fish turned into believable swimmers?
A: Convert to 3D, rig, animate, then composite with plate-matched lighting. - Q: Will AI replace creative roles on projects like this?
A: No. It multiplies output; humans guide taste, nuance, and finish.