10 / THE LAB

交互实验室THE LAB

信号已接通:手势、表情、粒子与尺度,全部实时。Signal live: gestures, faces, particles and scale — all in real time.
CH1 手势GESTURE 0x3F CH2 表情FACE 0xA2 CH3 粒子PARTICLE 0x7D CH4 尺度SCALE 0x0E
[EXP-01] 运行中RUNNING
01
工具研发TOOL R&D

AI 表情表演控制台FACS × VA CONSOLE

FACS × Valence-Arousal · 可以被"导"的脸FACS × Valence-Arousal — a face a director can direct
年份YEAR 2026 MY ROLE 工具开发 / 表演控制方法Tool Dev / Performance Control Method

把表演变成可编程参数:FACS 面部动作编码 × Valence-Arousal 情绪坐标,输出 5×4 情绪网格与"愤怒→大笑"的连续过渡验证。AI 角色第一次拥有了可以被"导"的脸。

Turning performance into programmable parameters: FACS action units crossed with the Valence-Arousal grid, validated by a 5×4 emotion matrix and a continuous anger-to-laughter transition. For the first time, the AI character has a face a director can direct.

SYS FACS 面部动作编码FACS ACTION UNITS AXES VALENCE × AROUSAL OUT 5×4 情绪网格5×4 EMOTION GRID PROOF 愤怒→大笑 连续过渡ANGER→LAUGHTER SWEEP
5×4 情绪网格:FACS × Valence-Arousal 坐标下的表情矩阵
情绪矩阵 5×4 · 每格一个可寻址的表情状态5×4 emotion matrix — every cell an addressable state
连续过渡验证:愤怒 → 大笑,情绪曲线可导Continuous sweep: anger → laughter, a directable emotion curve
[EXP-02] 实时信号LIVE SIGNAL
02
实时视听LIVE VISUALS

TouchDesigner 合辑TOUCHDESIGNER LIVE VISUALS

画面不是渲染出来的,是"正在发生"的These images aren't rendered — they're happening
年份YEAR 2025–2026 MY ROLE 视听艺术家Audiovisual Artist

12+ 个实时视听工程——含 StreamDiffusion 实时 AI 扩散与 Oculus 立体 VR 实验。这是"TouchDesigner × UE5 实时体系"的实证板块:画面不是渲染出来的,是"正在发生"的。

Twelve-plus real-time audiovisual patches, including live StreamDiffusion AI diffusion and stereoscopic Oculus experiments. The proof section for the TouchDesigner × UE5 practice: these images aren't rendered, they're happening.

#01 Bubbles_Loop
#02 SculptureLoop
#03 MoonLoop
#04 Gaussian_POPs
#05 Human_Pain
#06 Pearl_Journey
#07 Vapor_Loop
#08 Character_Shooting
#09 ░░░░░░░░
#10 ░░░░░░░░
#11 ░░░░░░░░
#12 ░░░░░░░░
合辑 12+ 工程,持续归档中12+ patches in the series — archive ongoing
STREAMDIFFUSION · 实时 AI 扩散LIVE AI DIFFUSION OCULUS · 立体 VR 实验STEREOSCOPIC VR TOUCHDESIGNER × UE5
TouchDesigner 工程节点面板:实时视听信号链
节点面板:一条正在运转的信号链The patch: a signal chain in mid-run
实时输出截选Live output, excerpted
[EXP-03] 部署中DEPLOYING
03
交互装置INTERACTIVE INSTALLATION

toybox · 徒手改写重力与光toybox — gravity & light by hand

一间可以被手势揉捏的康奈尔盒A Cornell box you can knead with gestures
年份YEAR 2026 MY ROLE 创意开发Creative Developer

徒手改写物理:摄像头捕捉双手——左手张掌让房间失重、握拳唤回重力;右手张掌点亮体积光、捏合抓住光束拖走。自写刚体物理与四遍 ray-march 体积光,一间可以被手势揉捏的康奈尔盒。

Rewriting physics bare-handed: open your left palm and the room loses gravity; open your right to ignite a volumetric beam, pinch to grab the light and drag it. Hand-rolled rigid-body physics and four-pass ray-marched volumetrics — a Cornell box you can knead with gestures.

L

左手 · 重力通道LEFT HAND · GRAVITY CHANNEL

张掌OPEN PALM
房间失重,万物离地the room loses gravity — everything lifts
握拳CLOSE FIST
唤回重力,尘埃落定gravity returns — all things settle
R

右手 · 光束通道RIGHT HAND · LIGHT CHANNEL

张掌OPEN PALM
点亮 ray-march 体积光ignite the ray-marched volumetric beam
捏合PINCH
抓住光束,拖着走grab the beam and drag it away
PHYS 自写刚体物理HAND-ROLLED RIGID BODIES LIGHT 四遍 Ray-march 体积光4-PASS RAY-MARCHED VOLUMETRICS INPUT 摄像头手势捕捉CAMERA HAND-TRACKING
可玩版部署中,敬请期待PLAYABLE BUILD DEPLOYING — STAND BY
[EXP-04] 运行中RUNNING
04
互动科普INTERACTIVE EDUCATION

宇宙漫游COSMIC EXPLORER

七个尺度,一条红色的"你在这里"Seven scales, one red "you are here"
年份YEAR 2026 MY ROLE 开发(为孩子而做)Developer (built for a child)

从地球到可观测宇宙的 7 个尺度,一条贯穿始终的红色"你在这里"。为孩子做的 3D 互动宇宙——也是给自己保留的那部分天真。

Seven scales from Earth to the observable universe, threaded by a red "you are here." A 3D interactive cosmos built for a child — and for the part of the maker that stays one.

你在这里YOU ARE HERE SCALE 01 地球EARTH SCALE 02 SCALE 03 SCALE 04 SCALE 05 SCALE 06 SCALE 07 可观测宇宙OBSERVABLE UNIVERSE
红线贯穿 7 个尺度——无论飞到多远,"你在这里"始终亮着The red thread runs through all seven scales — however far you fly, "you are here" stays lit
CREDIT 01
秘技达成!隐藏频道已解锁CHEAT ACCEPTED
▶ Bilibili · Mahlercc