by arijun on 10/16/23, 9:02 PM
This looks great! The main potential use for this must be for VR video with 6 degrees of freedom. What they have now does an incredible job of conveying space, but feels a bit limiting when your view doesn’t translate with you.
by lnyan on 10/17/23, 9:46 AM
This is bad news for me. I am working on a simliar project (gaussian splatting + dynamic scene). Our method is different with the mentioned 4D gaussian splatting, but I am unsure shall I continue or not.
by jayd16 on 10/16/23, 11:33 PM
Does anyone know if the pixel overdraw of the GS scene is consistent from every view angle? I'm asking because I would assume there is inconsistent GS density but the paper doesn't give a range of FPS measurements or 99th percentile or anything like that.
by reactordev on 10/16/23, 9:39 PM
This gives me hope that one day we'll have a holodeck. Holy crap! The applications for this are pretty broad. From safety (scene reconstruction from video sources) to real-estate, to hollywood and video games. I'm just blown away. Will we eventually see 4D GS AR/XR scenes we can walk about? I feel like that would make the perfect VR sherlock holmes game.
by nialv7 on 10/16/23, 9:40 PM
Holy heck this is going to fundamentally change media production
by heurist on 10/16/23, 11:17 PM
After reconstruction, is there any way to scan for a particular condition in the model, and map it onto the 3D structure? For instance, find the broken cookie, or find a surface matching some input image.
by mortenjorck on 10/16/23, 9:20 PM
Hard to believe the original Gaussian Splatting paper is still less than three months old, given the explosion of new techniques in recent weeks. It's wild to see the state of the art in environment and object capture suddenly advancing this quickly – beyond the obvious applications like real estate, I wonder what else GS will end up transforming.
by syntaxing on 10/16/23, 9:39 PM
Does anyone have a video or post that explains the optimization part for the original paper? I understand most of it but that part and can’t seem to wrap my head around it.
by shultays on 10/17/23, 11:48 AM
Can someone help me understand what this is actually doing?
by raytopia on 10/17/23, 1:18 AM
With tech like this I'm starting to wonder if realistic games are going to become normalized and what will happen as a result.
Also has anyone been working on solving the "blurry" look these splats have up close?
by jjcm on 10/16/23, 8:55 PM
I'd love to see a machine learning model trained on the resulting data of this. It'd be crazy to see if it can effectively learn and generate realistic looking video as an output.
by omneity on 10/17/23, 1:47 PM
Can someone explain to me how is it possible using gaussians to have different reflections based on the angle of view like on the demos? I'm finding it hard to grasp.
by KaoruAoiShiho on 10/17/23, 1:06 AM
Feel like this changes everything, trying it out right now...
by cubefox on 10/17/23, 11:48 AM
by fennecfoxy on 10/18/23, 11:28 AM
by Cieric on 10/16/23, 9:18 PM
I've been slowly building my own rendering and training on a non cuda library (trying with vulkan/spirv) I'm curious how many cameras they used here though.
by MrTrvp on 10/16/23, 10:04 PM
Reminds me the Deja Vu movie and how they maneuver angles.
by petargyurov on 10/17/23, 9:09 AM
Anyone know how well this technique deals with mesh/lattice type structures? For example, fences, ladders, climbing frames, etc.
by teaearlgraycold on 10/17/23, 1:35 AM
Combine this with state of the art VR tech (something with good eye tracking and 4k per eye) and we're living in the future.
by ge96 on 10/16/23, 9:44 PM
Wondering when this technique will be used for meal calorie counters
by sheepscreek on 10/17/23, 12:24 PM
Can someone also explain the implications of this on gaming?
by vavooom on 10/17/23, 12:25 AM
This is just incredible technology
by xrguy on 10/17/23, 4:20 AM
i like how galaxies look like ellipsoids if you zoom out
by astlouis44 on 10/17/23, 6:28 PM
Mind blowing stuff.
by VikingCoder on 10/16/23, 10:41 PM
Well, Rule 34 is about to happen. And "splatting" is already a decent name...