top of page

Virtual Production

 

電影虛擬製作技術

 

Logo_ArTech Complex white.png

VP LAB

虛擬製作效果  

ArTech Complex

Virtual Production Studio 荃灣

associating

VPLUSTUDIO

虛擬製作簡介

 

 

虛擬製作在疫情期間起飛

媒體和電影產業近年熱切於虛擬製作的部分原因是疫情 ; 電影攝製組在疫症期間被逼保持社交距離和轉向遠端工作, 他們因而需要調整創作和製作的工作流程以減少現場的人數, 並採用新的工具快速完成工作, 後來大家揭示了虛擬製作更多的優勢 ; 它不但節省了時間和金錢, 擴大工作室的產能, 它更即時帶來身臨其境的XR體驗, 令團隊可在製作過程中就可預覽成果, 儘早發現問題及修補, 從而交付高品質的成果 ; 因此, 今天越來越多工作室開始採用虛擬製作, 包括最新一集上映的「星球大戰」電影, 而荷里活已開始培訓12歲以上的小孩

 

技術原理

使用3D 遊戲引擎實時 Rendering 的功能即時創建虛擬的場景, 並顯示在實體場景後面的大型 LED幕牆上, 然後透過3D追蹤技術將引擎與場景中的攝影機同步, 以增強互動的真實感和透視度 ; 在製作過程中, 所有工作人員都可以即時預視最終的視覺效果, 從而及早作出指導及修補, 尤其是提升了視覺藝術總監和道具製作等的效率, 作出虛擬和實體完善結合的整體設計 ; 在新科技的幫助下, 視覺效果已不再僅留待後期製作處理, 而過去導演習慣「後期修復」的老口號現在就可變成更具前瞻性和規劃性的「前期修復」了

 

虛擬製作的優點

  • 節省 : 時間和成本

  • 預覽願景 : 任何人都可以在製作過程中預覽和檢討成果, 及早察覺問題和修改

  • 可見性 : 相對綠幕, 演員可更真實地對佈景做出反應, 投射在身上的燈光更加真實

  • 快速切換 : 現場快速過渡場景, 甚至控制天氣, 演員在同一個地點拍攝多個場景

  • 資產庫 : 團隊可以累積數碼資產, 而無需從頭開始建造每一個新場景, 降低成本

  • 全球合作 : 創意和技術專家無論身處何方都可全球協作, 團隊互動創建虛擬內容

 

 

 

加拿大

1分鐘廣告片

VP 經典示範

 

 

 

Hong Kong's First Large Scale

On Set Virtual Production Test 

  

By : HK Society of Cinematographers

At : House of X Studio by Hiller Pharma

       (HPCL) at Shaw Studios    

 

A big team of pioneering hero leaded by HOX & ShawStudio 

香港首趟 : 電影虛疑製作測試

由 : 香港電影專業攝影師學會

於 : Hiller Pharma (HPCL) 邵氏影城 House of X 

       

Co-org & supporting, see ​YouTube descriptions

 

 

Hong Kong Film Test Explores

On-Set Virtual Production

  

Interview of Mr. Tony Ngai - Founder Director of Society of Motion imaging Limited

 

C+T ASIA - September/October 2022

C+T_OSVP copy.jpg

Virtual Production

XR LED Set Virtual Production 

On Set Virtual Production - Extended Reality (XR) with LED wall set and auto tracking camera crew

 

Key elements : 

  –  Unreal Engine game engine

  –  Blender 3D animation

  –  MoCap Meta Human

  –  Resolume Arena DMX

  –  3-side LED wall set

  –  Camera & lens tracking systems

  –  Digital Lighting & Sound systems

  –  Creativity & Humanity 

  –  BIM・AEC・STEM

  –  Pioneers starting from : Grade 4

BIM : Building Information Modeling

ACE: Architecture, Engineering & Construction

STEM: Science, Technology, Engineering, & Mathematics

HOX 1.jpeg
HOX 2.jpeg
HOX 4s.jpeg
HOX.JPG

Unreal Engine 5 for Architecture | Webinar

Timestamps:

00:00 Intro

00:50 Getting started

01:28 Architecture templates

02:10 New UI

03:00 Level templates

05:50 Template water material

07:05 Template Post Process Volumes

10:00 Template spline tools

12:46 Other template tools

13:05 Import projects using Datasmith

21:26 City Sample buildings

22:08 Quixel Bridge

23:52 Lumen

33:10 Direct Link interoperability

35:08 Modeling Tools

40:23 Create a still render

47:00 Conclusion

Unreal Engine 5 enables creators to include far more information and data in their architectural visualizations, in scenes that are of an incredible visual fidelity. Watch now to learn about:

  • UE5 updates to the Architecture Project Template

  • The latest Datasmith improvements

  • How to use Lumen for archviz 

  • Various workflows for editing models

  • Learn more > https://tinyurl.com/2p823ffy

Partition.jpg

 

.

What's Virtual Production?

   

 

.

  

  

What is Virtual Production? 

DIGITAL ASSET MANAGEMENT | DESIGN

By Ryan L'Italien

 

November 21, 2022

https://www.perforce.com/blog/vcs/what-is-virtual-production

Virtual production took off during the pandemic. It is expanding possibilities for teams in media & entertainment and saving them time and money in post-production. For that reason, it is here it stay. More and more studios are starting to adopt new tools to create immersive, groundbreaking experiences in real-time.

 

What Is Virtual Production?

Virtual production is a media production technology in which a virtual set is displayed on large LED walls behind a physical set. Teams use real-time 3D engines (game engines) to create a virtual set, display it on the LED wall, then sync the engines with cameras on set for enhanced realism and depth of perspective.

 

Virtual production takes advantage of the real-time rendering capabilities of game engines. With virtual production, visual effects are no longer applied to a scene only in post-production. Now, they are worked and iterated on throughout pre-production (known as previs). The old mantra of “fix it in post” is now becoming “fix it in pre.”

 

For studios of all sizes, there are a lot of advantages for adopting virtual production techniques.

 

 

Virtual Production Advantages

The media and entertainment industry’s recent push to virtual production is partially due to the pandemic. The sudden shift to remote work and social distancing meant coming up with a different way to get work done fast while fewer team members were on set. It required film crews to adopt new tools and adjust their creative workflows and pipelines.

 

But virtual production is about more than just connecting virtually. It has uncovered several advantages that allow studios to build bigger, innovate more, and deliver high-quality results earlier in the production process. 

 

Time and Cost Savings

For many studios, virtual production saves time and money. Virtual scouting — creating virtual versions of proposed sets — can eliminate travel time and additional expenses. Making creative decisions and revisions earlier in the process ensures that the right decisions can be made while actors are on set. This leads to cleaner takes and less rework. It also saves a ton of time (and money) in post-production.

 

Idea Iteration

Virtual production allows creatives to develop their vision earlier. It opens room for exploration by visualizing shots and environments before anyone steps foot on set. Iterating on their vision helps studios bring people together to create something out of this world.

 

Enhanced Visibility

Historically, filmmaking has been siloed. It wasn’t until the final release that the rest of the crew could see the CGI graphics and re-edited storylines. But with virtual production, everyone can have a more complete understanding of the film, from previs to post.

Virtual cameras and green screen live compositing act as a window into virtual worlds so contributors can see exactly what they are capturing. LED walls show filmmakers and actors what the set they are on looks like, both through their eyes and in-camera. (Two major added benefits to having graphics displayed on LED screens behind the actors: the lighting it casts on the foreground set and actors is more realistic, and actors can more authentically react to the set.)

Quick On-Set Transitions

Using a virtual environment, teams can transition from one scene to the next with minimal interruption. All of it is happening at one location! Digital assets can be changed up quickly, allowing filmmakers to shoot several scenes with the same actors.

 

Also, in a virtual location, the filmmaker has full control over the weather, time of day, lighting, object position, and more. These conditions can be recreated at any time and are immediately available.

 

Library of Assets

Virtual production teams can utilize pre-built assets from existing libraries. They can quickly be customized to meet the needs of any production, without having to build from scratch. These virtual assets are stored electronically, reducing the cost of physical storage, transportation, and labor.

 

Global Collaboration

Virtual content can now be created by decentralized teams around the globe without delays. Now filmmakers can build up their teams with creatives and technical specialists no matter where they are located. The possibilities widen without increasing the cost.

 

How to Build a Virtual Production Studio

Transitioning to a virtual production workflow requires a different way of thinking about the production process. It is less linear and involves new tools — like game engines.

 

The flexibility and interactivity of virtual worlds within the game engine, combined with the ability to visualize content earlier on in the production process, uncovers new possibilities for studios to realize and refine their vision.

 

Films like Lion KingRipple Effect, and Mandalorian were made using game development technology. Just like creating a video game, using a game engine for virtual production requires a high level of orchestration. It is not a linear process, and for that reason, all teams need much more information earlier in the production process. They also need an array of tools to help them iterate on their ideas throughout the process.

 

 

What VFX Studios Need for a Virtual Production Pipeline

How can you set up your virtual production pipeline? What do you need to get started? Review some the basic virtual production tools and learn how to get started.

 

Real-Time 3D Engines/Game Engines

Real-time 3D engines/game engines are essential for virtual production. With tools like Unreal Engine and Unity, teams in media & entertainment create photorealistic virtual worlds and characters to be displayed on LED walls on set in real-time. Then, the practical cameras on set are synced with virtual cameras in the game engine, so that the virtual scene moves as the cameras do, offering enhanced realism and depth of perspective.

Guide to Game Engines

Learn more about game engines and get started fast. 
GAME ENGINE OVERVIEW

 

Cloud Data Management

When people are working on lots of large files, they need instant access, and let more people collaborate wherever they are located. Moving to a hybrid or cloud model can help teams access the virtual production assets they need quickly. Cloud data centre are available everywhere and can quickly be spun up based on where teams are located. They get faster throughput and lower latency. This avoids the WAN wait that can quickly delay your film. Then you can give people permissions to these files and track how they evolve.

 

Version Control

Studios who adopt game engines for virtual production find themselves with massive digital files to manage, increasingly complex projects, and large, often dispersed teams. Good version control enables teams to contribute to the same project without overwriting, breaking, or duplicating each other’s work. It also allows teams to share massive files to remote team members instantly. Game developers have been using version control for decades, and so filmmakers are beginning to use it as they adopt the same technology.

 

Digital Asset Management

Virtual production involves creating many digital assets. These binary art files are often massive, making them difficult to manage. That is where version control like Helix Core comes in. But many creative teams also opt to use digital asset management (DAM), which make it easier to manage all of their digital creative files.

 

Partition.jpg

 

.

Who's Who on Set

   

 

.

Who’s Who on a Film + TV Set

https://www.backstage.com/magazine/article/everyone-know-set-3936/#section11

Key Creative Team

 

Director: You should definitely know who the director is, because you and your co-stars will be working very closely with her. The director pushes the vision of the production forward—she’s involved pretty much every step of the way, from hiring to script edits.

Producer: Everything the light touches is the producer’s kingdom. Producers are the key to all aspects of a smooth-running production. They make sure everything is done on time and within budget, while maintaining an environment the cast and crew can flourish in.

Writer: The writer is responsible for creating the script or screenplay. The script will either be the writer’s original story or an adaptation of another story. TV writers, in particular, are always on a strict deadline, since they are continually writing and revising the script until the launch of the pilot episode. It’s a pretty high-pressure job. Not only do they need to write for a specific audience, they also need fill a specific time slot—say, 22 minutes for a sitcom.

 

Production Department

Executive Producer: EPs are responsible for the quality and success of the production and ensuring that it will have appeal on the market. Though they are not always involved in the daily filming process, they are heavily involved in financial aspects of the project. This means their say on the final product can hold a lot of weight.

Associate Producer: APs play a significant creative role on set. They can provide help in securing location and talent, as well as contribute ideas to the development of the script. APs also carry out any tasks delegated by the producer.

Assistants: Production assistants are the definition of “all hands on deck.” Their days consist of various tasks, from getting coffees to escorting actors back to their trailers to managing paperwork. Responsibilities change daily, so there’s never a slow or typical day for a PA.

1st Assistant Director: The AD supervises both cast and crew, and is the person who will come get you when filming starts. He keeps track of time for the director and makes sure filming is always on schedule. The AD will also keep you safe—he’s responsible for eliminating and minimizing hazards on set.

Key 2nd Assistant Director: The 2nd AD relieves the 1st AD of certain tasks, like putting the cast through hair, makeup, and wardrobe. She’s in charge of the call sheets, so scheduling is her key responsibility, as well as assisting the 1st AD whenever needed. You’ll typically find them on a larger set, so your very first gig may or may not have one.

2nd 2nd Assistant Director: Yes, even the assistant to the assistant needs an assistant. Though it may seem redundant, 2nd 2nd ADs are essential to getting the smaller parts of the set moving—literally. They direct extras and vehicles for background action during large crowd scenes.

Script Supervisor: A majority of your scenes will be shot out of script sequence, so script supervisors have an important role: to make sure the finished product makes verbal and visual sense. They work closely with the director and keep a detailed written and photographed record of things like dialogue, costumes, props, and set design (just to name a few out of many) to ensure no continuity errors occur.

Stunt Coordinator: Though stunt coordinators don’t actually perform stunts, they do something equally vital—plan them! All those seemingly spontaneous big booms, crashes, and fights are carefully designed and rehearsed. They bring the adrenaline and danger to a production, but also implement safety measures just in case a stunt goes wrong. (Hopefully, it won’t!)

 

Art Department

Production Designer: Everything looks the way it does on the set thanks to the production designer. A lot of hard work and imagination goes into every backdrop and location. Whether it’s the inside of an apartment in NYC or a fantasy realm based in the 19th century—the PD sets the atmosphere to bring the story to life.

 

Art Director: Art directors fulfill the PD’s vision—they manage the art department’s budget and working schedule and oversee the construction of the set.

Art PA: Similar to production assistants, art PAs are the main support for the art department. They run basic errands like making sure everyone has lunch and supply the draftsmen with art materials. If there are any last-minute changes to sets or supplies required, the art PA handles them.

Prop Master: The prop master and set decorator’s roles overlap a bit—they both select and oversee placement of props for the set. However, the set decorator is mostly in charge of the bigger props, like bookcases and plants, while prop masters take care of the smaller props that the actors actually handle. Think things like mail, pens, pots and pans, and so on.

Assistant Prop Master: Assistant prop masters are considered the right hand of the department. When the prop master is unavailable or absent, they are their representatives.

 

Prop Assistant: Moving furniture, filling glasses, turning on lamps—prop assistants are in charge of all the movement of props, as well as making sure things look the same during the reshooting of scenes.

 

Camera Department

Director of Photography (or Cinematographer): DPs are all about aesthetics—they oversee the visual representation of the production. Creating the ideal look of the show is a collaborative project, so they work closely with rest of the camera crew, grip department, and gaffer (who runs the lighting) to create the ideal look for the show.

A Camera Operator: The A camera op has to have 20/20 vision in terms of creating the cinematic experience. He gets first look in the camera’s lens to make sure that everything the DP and the director has instructed is visually set up. He handles the camera during shooting. (On smaller sets, the DP and camera op tend to be the same person.)

 

B Camera Operator/Steadicam: See that person zooming around with camera equipment? That’s the Steadicam operator! The Steadicam system helps follow movement while remaining stable. Smooth camera movement definitely doesn’t happen on its own; someone wearing a weighted vest (up to 90 pounds!) for a long period of time helps make it happen.

A Camera 1st Assistant: You’ll see 1st ACs extremely focused on set as they focus and refocus the camera lens while you and your co-stars are moving in and out of the frame. They do this without actually looking at the lens, but at marks placed on the set, floor, and props.

A Camera 2nd Assistant: Despite being the 2nd AC, the pressure is on these guys to ensure everything runs smoothly in the camera department. They’ll be the ones handling the clapperboard, changing and charging camera lenses and batteries, and dealing with film labs and stock. Before the shoot begins, they unload all the camera equipment that’s being used for the day.

Digital Imaging Technician: The DIT is in charge of all the digital handling of the footage. He’s the one making sure all cameras are set to the correct settings, as well as backing up the footage after shoots.

Stills Photographer: The stills photographer, arguably, holds the success of the production in their camera. She will be taking the press shots of you and your co-stars that will appear when promoting the show. It might be a good idea to become her buddy and let her in on what your best angles are.

 

 

Lighting + Electrical

Gaffer (aka Chief Lighting Technician): Gaffers are in charge of the lighting on set, which means they literally get to make the DP’s vision for the production shine. Getting the right lighting doesn’t mean just picking the right light bulb, but actually being able to shape the light by finding the best light placement and using colored gels and filters, depending on the feel of the scene.

Best Boy Electric: The best boy is the gaffer’s second in command—she makes sure all the cables, generators, and light bulbs are working and placed correctly in their respective locations. And, yes, despite the gender-specific title, either a man or a woman can be a best boy.

Grip: Once the gaffer has decided, along with the DP, what the lighting design should look like, it’s the grip who executes it. They physically create the patterns, diffusions, or shadows necessary to set the mood, as well make sure everything is safely rigged and secured. On smaller sets, the grip, the gaffer, and the best boy might be the same person, but on bigger ones, there is a Key Grip who reports to the gaffer and tells all the other grips what to do.

Lamp Operator: The lamp ops go by many names: lighting technicians, juicers, or just electricians. But they all do the same thing, which is operate the lights and run all the cables on set. They’re considered the heavy lifters of the lighting department.

Grip Department

 

The grip department is responsible for any non-electrical gear on set—for example, tripods, cranes, rigging, or dollies. They work closely with the electrical department to achieve the correct lighting for shots.

 

Key Grip: The chief of all the grips—you’ll usually find a key grip on a bigger set. (On a smaller set, the grip, the gaffer, and the best boy might be the same person.) He reports to the gaffer and gets to tell everyone else what to do.

Best Boy Grip: Like the best boy electric, the best boy grip is the key grip’s right hand.

 

Dolly Grip: See the person moving the dolly with the camera and camera operator? That’s the dolly grip! She builds the track the cart moves on, and is responsible for operating the cart during scenes that require tracking.

 

Grip: Grips execute the lighting design decided on by the gaffer and DP. If certain patterns or shadows are needed, grips physically create them. They also build and maintain the supporting camera equipment—assembly often comes with specific instructions describing where and how cameras need to be mounted, hung, pushed, or pulled. 

Hair and Makeup

 

Wardrobe Department

Costume Designer: If you want to get a say in what you’re wearing, you might want to get to know who your costume designer is. According to costume designer Ingrid Price, it’s one of the most collaborative jobs on set. Designers collaborate with the production designer and hair and makeup to make sure outfits work with the overall vision of the production. “Talk to your costume designer,” Price suggests. “Your costume designer, along with the hair and makeup people you’re working with on a project, can be your best allies.”

Assistant Costume Designer: The assistant costume designer is in charge of all the logistics of the costume department, like budget control and organization of production schedules. He helps the costume designer break down the script to assess what kind of costumes, and how many, are needed.

 

Costume Supervisor: The costume supervisor acts as the designer’s representative—before you get in front of the camera, she’ll be checking to see you’re wearing your designated outfit correctly.

Set Costumer: Everything you’re wearing the set costumer bought. She contacts vendors to purchase necessary materials and maintains the wardrobe itself with laundry and ironing.

Costume PAs: Costume PAs are just starting out in the business, so you’ll see them running around completing various tasks like picking up costume orders, driving the designers to and from the set, and getting coffee and lunch for the department.

Set Decoration

Sound Department

Sound Mixer: A sound mixer records all the sounds and dialogue during filming. It’s a particularly difficult role due to inevitable background noise—someone might be whispering a little too loudly during the shoot, or traffic could be particularly loud during an outside scene. However, it’s his job to choose the best microphones for every scene and make sure they’re positioned adequately for the clearest, cleanest sound coverage.

Boom Op: The boom operator is easy to spot—she’s the one holding the long mechanical arm with the big microphone attached to the end. She needs to be able to move very steadily, since she has to get as close to the action as possible without getting the microphone in the shot.

Utility Sound Tech: Utility technicians serve as assistants to the sound mixer and boom op. Since they usually have their hands full, these guys and gals assemble and test equipment, pull cables, and operate other mics needed during shoots.

Transportation Department

Catering

Craft Service: You’ll probably get to know the craft services department intimately, seeing as they provide the food and snacks that are always available to the crew. These aren’t hot entrees, but they’re great pick-me-ups to keep you going for the day. Cookies aren’t the only thing they have to offer—they also help any department with small but necessary tasks needed to keep things moving.

 

 

Partition.jpg

 

.

10 On-set Terms

   

 

.

10 On-Set Terms You Need to Know

https://www.backstage.com/magazine/article/set-terms-need-know-4974/

 

Above the line

On a budget sheet, there are individuals who contribute to the direction and narrative of a film. “Above the line” refers to these people and any expenditure related to them. Examples include screenwriter, producer, director, casting directors, and actors, among others. These are the most expensive line items, and this is the area that can make or break a movie in terms of the quality of the leaders.

 

Below the line

On a budget sheet as well, “below the line” refers literally to the “line” that separates the actors, directors, producers, and writers from the remaining on-set crew. This is where your team resides as well as every aspect related to it, from food and fuel to parking and wardrobe. Where “above the line” could be considered the upper management, “below the line” would be the team players themselves.

 

Blocking

In setting up a scene, an actor’s moves need to be worked out in relation to the camera. “Blocking” refers to the working out of these details. An analogy would be choreographing a dance. It’s like planning and ensuring things like the actors, extras, crew, and equipment are all moving in harmony with each other. It’s to make sure that the above-the-line guys and the below-the-line guys are all on the same page. It also gives the script supervisor a point of reference for continuity on how things are supposed to go, which can alert them if something strays too far from it.

 

First unit

This refers to the team of individuals who are involved in shooting the sections of the film that are of primary importance, typically scenes involving actors or the stars of the film. In large productions, there would typically be a first and second unit.

 

Second unit

There is another team responsible for shooting supplementary footage. When there’s a lot to get done it can be more efficient to have a second team shoot at the same time the first unit is shooting. While the first unit handles primary shots, the second can take care of elements like horses trotting through a field, people walking in the streets, or establishing shots.

 

Call sheet

Based on the director’s shot list, the assistant director will put together a schedule that's given to the cast and crew. It lets them know where and when they will be needed on set on any given day of filming. It’s called a “daily call sheet.” It also contains things like what’s being shot, the nearest hospital, and the weather forecast.

 

Dailies

At the end of each day of shooting, the footage is assembled for the director and other staff to view each night. The purpose of “dailies” is to ensure what was shot does not contain technical issues. They are also used to get a feel for the pace of the movie, how things are going in general, what’s working and what’s not, and to monitor the overall structure.

 

Hot points

This is a safety term used by grips to let those nearby know they are carrying some equipment, like a light stand for example with its tip pointing forward. It can also mean some heavy equipment in the vicinity that could be harmful or dangerous.

 

Last looks

This refers to the casts’ hair and makeup. It’s used to indicate that the scene is about to be filmed and that if any final touch-ups are needed, now is the time to do them. And although it’s technically intended for hair, makeup and wardrobe, it is also a signal to the entire crew that everyone needs to ensure everything is in its proper place.

 

Video village

This is a viewing area for directors and other production personal. It contains monitors, chairs, and the like where the crew are able to see what the cameras see. Sometimes talent will sit here in between scenes as well, or executives to see how the overall production is going. And it’s where the script supervisor lives.

 

VP LAB簡介

VP LAB為IPF 資訊科技體育基金 (NGO#91/15045) 與VPLUSTUDIO的合作, 致力創建一個ArTech Complex 的概念去推動共享經濟丶實驗社區和體藝STEM教育, 從而促進 (1)香港媒體及電影製作產業加速銜接全球Web3.0技術革新的發展, (2)凝聚前衛藝術家與雙重特殊資優學生(2e)共享丶碰撞丶大膽創作, (3)中小學共享虛擬製作STEM教育的專業資源, 尤其是已安裝LED幕牆的學校可善用既有資源延續全方位的Art Tech STEM發展, (4)社商校協作研討相應的Web3.0年輕「文創企業家」及「獨立創作人」國際生涯發展品牌網絡

VP LAB附設於VPLUSTUDIO位於荃灣海盛路3號TML廣場地下的虛擬製作工作室, 設置弧形XR LED 幕牆丶鏡頭3D定位追蹤丶電子燈光丶3D伺服器等專業虛擬製作設施

  

.

VP LAB

  

ArTech Complex

Virtual Production Studio 荃灣

associating

VPLUSTUDIO

bottom of page