OraclipOraclip

Xから・モーション転送

Animated Princess Facial Motion Transfer

プロンプト

動画からOraclipが再構成
Close-up of a stylized 3D princess with large eyes, wearing a silver tiara with pink gems and a jeweled lavender gown. Background is a dark starry sky. 0-14s: The character mimics facial expressions including pouting, glancing around, and biting her lip with smooth animation and consistent lighting.
モデル
Wan
ワークフロー
motion transfer
長さ
14s
アスペクト比
720:852
カメラ
static close-up
スタイル
3D animation, stylized, cinematic

モーション転送版

参考動画と自分のキャラクター画像と一緒に使ってください。

Use the reference video for motion. Keep the exact facial expressions, timing, and head tilt; replace the performer with a stylized 3D animated princess wearing a tiara and ornate gown; setting is a starry night sky.

ネガティブプロンプト

photorealistic, grainy, distorted features, messy hair, plain clothing

元の投稿

Alibaba rethinks character animation with Wan-Animate-2 Anyone who has tried animating a character from a reference video knows the trade-off: you either lose identity, lose fine motion detail, or the compute cost becomes unbearable. Tongyi Lab, Alibaba's research team, just published a paper that tries to tackle all three problems at once, with a name that's already a statement: Wan-Animate-2. 🎬 The team frames the existing landscape around three paradigms and their flaws. Methods based on explicit motion representations suffer from extraction errors and identity drift, implicit motion features lose fine-grained dynamics through compression, and in-context learning avoids intermediate representations but incurs prohibitive computational costs. Wan-Animate-2 removes the intermediate motion extractor entirely, letting the driving video feed directly into a redesigned Diffusion Transformer. 📐 Architecturally, the framework conditions video generation on a reference image and a reference video through a dual-branch DiT, introducing Time-Align RoPE for temporal alignment between denoising video tokens and reference tokens, and Sparse-Ref Attention to selectively attend to the most informative reference features. 🕹️ One of the most interesting capabilities is text-driven viewpoint control, which decouples the output camera perspective from the driving video, a capability the authors describe as rarely supported by prior character animation methods that rely on explicit motion representations. ⚡ For interactive use cases, the team introduces Wan-Animate-2-Lite, an efficient variant designed to push inference latency down to real-time thresholds through a three-stage training paradigm combining teacher forcing pretraining with an error buffer mechanism and Self-Forcing distillation with chunk-wise backpropagation. According to independent reporting, this lite version reportedly reaches real-time streaming at 24 fps, opening deployment scenarios like digital avatars and live-streaming hosts that were previously infeasible at this quality level. Why it matters: if it holds up outside the demo reel, this changes the equation for anyone working with digital avatars, live streaming, or low-budget video production. No complex 3D rig, no expensive motion capture setup, just a reference video and an image. For companies and independent creators, it means access to professional-grade animation tooling without the hardware and pipeline barriers of traditional workflows, especially now that the team says it will release the Wan-Animate-2-Base model weights publicly. As a Creative & AI Specialist, what strikes me most isn't the visual quality itself, it's the decision to rethink the whole pipeline with live use cases in mind from day one: too many animation models stay stuck in offline mode because they were built for quality alone, while here the real-time variant looks like a design priority rather than an afterthought, and if the open weight release lives up to the paper, the real test will be how easily it slots into the workflows creators already rely on. 📱 Want AI updates on WhatsApp? DM me "AI" and I'll send you access. �� Follow me for the last AI updates! #AInews #WanAnimate2 #Alibaba #CharacterAnimation #AIVideo

プロンプトは参考用にXの公開投稿から集めたものです。権利は元の作者に帰属します。アレンジして使う場合は、必ずクリエイターをクレジットし、出典へのリンクを付けてください。