Machine Learning.
Turn algorithms into art
Machine learning has the power to accelerate creativity and automate the mundane across visual effects, animation and beyond. Artists and studios can achieve results they couldn’t before and get to the final creative faster by removing drudge work. Through ongoing research and product development, our aim is to provide the framework by which artists can gain creative freedom and control to apply the technology to create beautiful images. Foundry’s compositing tool Nuke has a full suite of tools to make machine learning accessible, empowering artist and algorithm to work in harmony.
Nuke’s CopyCat: making machine learning accessible
We've implemented machine learning in a way that is aligned with the ethos of Nuke—that artists should have full technical and creative control over their shots. This is why we created CopyCat, an ML tool released in Nuke 13.0 that solves impossible problems while being entirely controlled by the artist. Tasks like deblur, rotoscoping, and beauty work that previously took days to work on can now be resolved in a matter of hours.
Machine learning for the masses: Inference & Nuke 13.1
Nuke’s Inference node is used to apply CopyCat models to images in Nuke. Nuke 13.1 saw the functionality of this node extended via third party PyTorch model support, allowing users to bring their own machine learning models into Nuke, and run them performantly and reliably. This opens up Nuke to a broad range of community generated ML models.
Tackle industry challenges
-
Accelerate your creativity
Smash deadlines and meet demands with a comprehensive ML toolkit at your fingertips in Nuke’s industry-leading architecture, supporting rapid creative workflows—without sacrificing quality.
-
Scale projects and processes
Work easily at scale with CopyCat, allowing users to train neural networks to complete a whole range of tasks using only a small number of reference frames.
-
Automate the mundane
Nuke’s Upscale and Deblur nodes use a pre-trained machine learning network to enable artists to resize footage by x2 and remove motion blur from footage quickly and easily, so you can crack on with creative work faster.
-
Reduce manual tasks
Automate the more mundane tasks and save huge amounts of time, especially when facing tight deadlines. With this extra time, you can spend more time focusing on the creative side of things rather than boring manual tasks.
Machine learning solutions
-
Advanced, industry-standard compositing
Amplifying the power of core Nuke, NukeX adds advanced tools for machine learning, 3D camera tracking, clean up and refining. It puts more power and control into the hands of compositors and elevates the creative process, whilst reducing the need to roundtrip between other packages. CopyCat and the Inference nodes, as part of NukeX’s machine learning toolset, enable artists to harness the power of ML inside of Nuke and create bespoke effects and tools with high-quality results in relatively little time.Take me to the NukeX
-
Multi-shot management, editorial and compositing
Nuke Studio is your post-production powerhouse—now with the added bonus of formidable machine learning capabilities. With multi-shot management, editorial and compositing in a single application, you can experience greater creative control, work seamlessly from start to delivery, and experiment with AI and automation workflows to get to that final pixel-perfect image faster.Explore Nuke Studio
Framestore accelerates their creative process using Nuke’s CopyCat
We caught up with Framestore to find about the creative process behind anti-knife campaign Long Live The Prince, and how machine learning technology in the form of Nuke’s CopyCat node was deftly used to benefit the production.
Learn more
-
Introduction to Machine Learning in Nuke
Learn how the visual effects industry is impacted by machine learning, and how you can introduce it to your compositing workflows in Nuke.
Show me more -
Get started with CopyCat
Discover how to train the neural network inside CopyCat to replicate sequence-specific effects, such as beauty repairs, shot clean-up, garbage matting, or deblurring.
Watch now -
Discover near real-time
Go behind-the-scenes of Comandante and discover how the novel technique near real-time was developed to meet the production constraints of the project.
Take me there -
Using AI to Speed Up Your VFX Shot Prep
Discover how to use Nuke’s CopyCat node to perform preliminary work on a VFX shot and let AI do the heavy lifting—so you don’t have to.
Learn more