Neural Networks and Animation

research and development

I’ve recently published, as an open source project, the code for feNeuralNet. This is a Fabric Engine extension for doing simulation of previously trained Neural Networks. Fabric Engine is a plataform for CG development that works standalone but is also integrated in many animation packages like 3ds Max, Maya, Softimage, and Modo. Yes, that means you can now play with neural nets in any of those packages.
If you are wondering what good is having neural networks in an animation package, so am I! On a more serious note, machine learning is enabling people in many fields to come up with computational solutions for problems that were previously very hard to solve… I am curious to see what real applications can emerge in animation and vfx pipelines in the next few years.
Here is the link to that code:
https://github.com/gustavoeb/feNeuralNet

Processing moCap data for Machine Learning with Fabric Engine

research and development, training

In this three part video series I show the challenges in pre-processing motion capture data for machine learning and how one can go about this task. I use Fabric Engine as a development tool for this task. If you find this video helpful or if you have further comments or questions on this topic, please, leave a reply bellow.

Video 2: https://vimeo.com/190895073
Video 3: https://vimeo.com/190897679

A thread from the Fabric Engine forum: http://forums.fabricengine.com/discussion/797/processing-mocap-data-for-machine-learning-with-fabric-engine#latest

Non-Humanoid Creature Performance from Human Acting

publications, research and development

In this work we propose a framework for using human acting as input for the animation of non-humanoid creatures; captured motion is classified using machine learning techniques, and a combination of preexisting clips and motion retargeting are used to synthetize new motions. This should lead to a broader use of motion capture.

This work was presented as a poster at SIGGRAPH 2016. Click here for the full publication.

dibr

Stereoscopic image quality in virtual environments

publications

Abstract: The number of products capable of displaying stereoscopic (also known as 3D) images has been growing in recent years. The use of this technology has outgrown the silver screen and is now available in televisions, computers, tablets, and even cell phones. Due to its nature, content created for stereoscopic media requires attention in relation to some characteristics not present in the context of monoscopic media. With a focus on image creation, the objective of this research was to assess how different stereoscopic image generation methods can affect human perception. To achieve this a virtual environment was created and from it different videos were generated using various methods including converging cameras, parallel cameras, and depth image-based rendering (DIBR). These videos were shown to participants who assessed the picture quality, depth quality, and visual comfort of the media. It was found that there was very little difference between the perception of images generated by parallel and convergent cameras, while there was a substantial difference in terms of perception between these two types of image and DIBR images. Such results can significantly affect the choice of technology for stereoscopic image generation, influencing the production costs, the methods involved, and human and machine time consumption.

Full paper

Originaly presented at the International Conference on 3d Imaging, december 2014.

capa

Island Adventures

publications

Cross-media adaptation

Dias Velho e os Corsários (1988) is a Graphic Novel, written and illustrated by Eleutério Nicolau da Conceição, which depicts a pirate invasion to the island of Santa Catarina in the 17th century. Using a historic event as inspiration the work successfully represents local themes such as culture and social organization. The audience to which the publication was originally targeted (13+) allowed the story to be represented in a realistic manner, with complex characters and episodes of violence and death. This work details the adaptation of such story to the media of animation and a significantly younger audience (pre-schoolers).

Complete Article

This work was originally presented at: XVIII Colóquio Internacional da Escola Latino-Americana de Comunicação, december 2014.

brasao_UFSC

UFSC

career development

I have recently been invited to teach Animation for the Design course at Universidade Federal de Santa Catarina. It is very gratifying being able to return to the college where I have studied, as a faculty member, and I sincerely hope I can contribute to the institution and its students.
The course has seen great improvement since when I was a student. Specially regarding animation, which was a underdeveloped area at the time. I hope I can share some student content here soon.

Masters’ Dissertation

career development

People close to me might be aware that, for the last year and a half, I have been atending to the masters program at the post-graduate program of Design at Universidade Federal de Santa Catarina(Brazil). I have also use that as an excuse to not perform many  time consuming activities like freelance jobs, friend gatherings and others. Tomorrow this excuse will be over with.

At 9am. in the Drummond Auditiorium I’ll be presenting my masters’ dissertation entitled: The quality of the stereoscopic effect assessed in relation to different image creation methods. The session will be open to members of academy and society in general.