Honestly as someone that has used the Replay mod for a small cinematic showcase the TH8 areas of Genso 2, I don't think it would be the right tool for the job. Why? Now, don't get me wrong, it's great for trailers and such, but "Gensokyo ~ The Second Dream" isn't a trailer, it's a feature length movie. Sure, we could do it just for the trailer, but I don't like the idea of the trailer looking so differently than the full length thing.
So why do the videos look so janky and amateurish? I think there are two main reasons. 1. We export a low bitrate, low framerate 24fps 720p video. Why not try to go to atleast 1080p high bitrate? (Higher framerate could be harder because of shaders). 2. reason, Remi doesn't know how to hold and move around with a camera. He makes it mostly up as he goes, and in some cases, the Replay mod could help with that, in others, it could very well make it worse.
So, let's talk Replay mod in detail, what it does, how it could benefit stuff, and how it would not.
How does it work? It works by recording all the packets you receive during a play session, and converting that to it's own format where it notes the entities visible at a given point, they locations, movements etc and all other things visible are tracked.The way I see it, it takes the role of two different tools depending on how it's used.
For mostly static content, it's a 360 degrees global camera that can be placed anywhere and moved around in the scene without a player, sometimes changing the pace of time while doing so. This is where the mod is at it's best.
For dynamic content (this is what we have), it's a camera placement and revising tool. When using it in this fashion, you decide roughly where the camera is in a let's say 32 block radius around the recorder, and what it's looking at. That seems oddly specific, why? Because one of the things the mod tracks is loaded chunks. Meaning that if the camera moves too far away from the recorder, it enters unloaded chunks. So even though it might be tempting to use a higher speed in an area where you want to go fast, you might not be able to, unless you also go fast through time. If you do that however, you can't have any entities around at all or it will look really weird. There is also the problem of tight corners indoors. This is not really a place where it's easy to turn without colliding with the walls.
So, how it would most likely work if we decided to do this is that everyone would still meet up with Remi at recording day. Remi would enter spectator mode so that he would have a bit more control over his speed. From there he would go around recording everything and look at everything as if this was the final recording. This is important to make sure the he wouldn't run out of time in a specific area. Once that would be over he would jump into the editor, redo the entire journey again using keyframes. Once he's done that he needs to go over every keyframe again, tweak it's settings, make sure it doesn't collide with anything, or that the camera does any other weird motion (this sadly happens more often than you would think).
Ok, so I've gone over some of the bad parts. What are the positives? In my opinion, 3 big things. The first is a smooth camera. Now, do note that I say smooth camera, and not smooth panning. We can already do the later in minecraft. Remi just hasn't bothered turning it on for any of the videos. Second is roll. Normally in minecraft you can look up and down, and side to side, but you can't tilt the camera itself. Normally this is fine, but in some cases it could also give a better feel when going around corners and such. The third and IMO biggest advantage is rendering. You can render with wonderful shaders at 60 or more fps. One of the big sources of a janky feel in the videos is a low fps. This would go completely around that.
Let's look at a real example. Here's the video I mentioned at the top where I used the mod.
Let's go over some of the noteworthy things in the video:
- First off, while you get smooth camera, the speed isn't always as smooth. It's more noticeable in some places than others.
- Next off, sudden blackout at the bridge, why? Because I was an idiot, and wanted to go after something else. Tried going with the flow there, but it just didn't really work. So, I went with the bridge there instead. However, to do that I had to skip a lot of time to get back to the point where those chunks were loaded. That's why the timeskip is there too.
- The sundown over the roof looks cool, and requires a lot of time manipulation. You can partially see this with the rabbits that suddenly pop up as the recorder got close enough to them.
- You can really feel me struggling with the corners in Eientei
- Rolling camera is cool :P
Now, I have glossed over it here and there, but the biggest reason why I don't think we should use the Replay mod is time. That two minute clip took hours to make. Just getting the camera path just right took hours.
So, what can we do instead that would take much less effort?
- Use the cinematic camera mode in Minecraft
- Plan out the whole thing in detail
- Have a script
- Do multiple takes, and begin recording after say the third one
- Use spectator mode for increased movement options, and no "Stop flying quick drop"
- Upload better fotage
- Teach Remi basic cinematography