FOFPred

FOFPred is a diffusion-based model that predicts future optical flow from a single image guided by natural language instructions. Given an input image and a text prompt describing a desired action (e.g., "Moving the water bottle from right to left"), FOFPred generates four sequential optical flow frames showing how objects would move.

FOFPred is a diffusion-based model that predicts future optical flow from a single image guided by natural language instructions. Given an input image and a text prompt describing a desired action (e.g., "Moving the water bottle from right to left"), FOFPred generates four sequential optical flow frames showing how objects would move.

• 01Diffusion-based model for future optical flow prediction
• 02Guided by natural language instructions
• 03Generates sequential optical flow frames from a single image