Abstract

在前次提出的計畫經典影片之重生與再造NSC (97-2631-H-152-001)中已提出影片 修補技術的開發,緊接著於此次的計劃則是將延續之前的研究"數位內容的創作"與" 影像修補"技術的傳承,提出以技術為導向之"以多層次影片架構為基礎之新一代數位 影片重製技術"的兩年計劃。計畫內容中有將提出動作特效與場景特效技術應用在創新 的影片產生,以及利用數個同步式單眼攝影機建製出三維影片。 在計畫的第一年我們將致力於產生三維全景的技術開發。普遍來說,二維的全景是 採用像素點來呈現,而三維的全景而是由立體像素來呈現。因此為了能以三維的方式呈 現,將對於"場景的分層"、"景深的計算"、"三維場景的重建"以及"三維影片的 修補"等技術上研究與開發。而在計畫的第二年我們將對於"特效技術"、"三維物體 影片的重建"、" 影層合併"與"利用透式圖法方式來呈現三維影片"等技術開發, 並以記敘化影片設計平台方式呈現這兩年的研究成果。 此次提出的計畫中尚存有未知的技術開發困難,我們將盡力克服會遇到的問題並以 開發出自動化工具與發表高品質的研究論文做為此計畫的貢獻。

We have developed video inpainting technologies due to the project supported by NSC (97-2631-H-152-001). To continue our research in new technologies for digital content creation, we propose a two-year new technology-oriented project, which aims to develop several cutting edge technologies for creating new movies from existing ones as well as creating special effects. The video technology proposed includes creating 3-D videos, based on multiple synchronous monocular videos. The first year focuses on the generation of a 3-D panorama. Typically, a 2-D panorama or a stereo panorama contains 2-dimensional pixels. This 3-D panorama contains 3-dimensional voxels, in a sequence of cubs (instead of frames). Technologies developed include layer segmentation, layer depth calculation, 3-D reconstruction, and 3-D video inpainting. The second year investigates special effect technologies such as camera effects, slow motion interpolation and extrapolation, 3-D object video construction, layer fusion, perspective transformation to display 3-D video, and an authoring tool to integrate the above technologies. This project has several difficult challenges. We aim to contribute to the national project in producing automatic tools and publishing high-quality journal papers.


Project Chairs

 施國琛 教授 / Prof. Timothy K. Shih
   國立中央大學資訊工程學系 / CSIE, NCU
 林慧珍 副教授 / Prof. Hwei-Jen Lin
   淡江大學資訊工程學系 / CSIE, TKU
 林仁智 副教授 / Prof. Jen-Chih Lin
   國立臺北教育大學數位科技設計學系 / DTD, NTUE                                                        







Examples - Video Inpainting

Video Type :
Camera Panning

Link:
Source Video
After Inpaint

Video Type :
Camera Panning (In Scenery)

Link:
Source Video
After Inpaint

Video Type :
Camera Panning (Crowed)

Link:
Source Video
Remove Two
Remove Four
Remove All

Video Type :
Shaking Camera (In Scenery)

Link:
Source Video
After Inpaint


Experimental Results

Motion Interpolation

Link:
Source Video
Inpainting Result
Falsifying Result

Link:
Source Video
Inpainting Result
Falsifying Result

Link:
Source Video
Roll Normal
Roll Fast
Roll Slow

Link:
Source Video
Falsifying-Slow Motion
Falsifying-Slow & Fast Motion


Special Effect Production

Link:
Source Video
Inpainting Result
Falsifying Result

Link:
Source Video
Inpainting Result
Falsifying Result 1
Falsifying Result 2

Link:
Source Video
Falsifying Result1
Falsifying Result2

Link:
Source Video
Falsifying Result

Link:
Source Video
Inpainting Result
Falsifying Result

Link:
Source Video
Falsifying Result

Link:
Source Video
Inpainting Result

Link:
Source Video
Inpainting Result