ТРАНСКРИПЦИЯ 🔗
WEBVTT
00:00:10.473 --> 00:00:13.476
Hi, Welcome to the Serious Goat Podcast number 13.
00:00:13.476 --> 00:00:15.080
Lucky number 13.
00:00:15.080 --> 00:00:21.390
Ooh yikes, I know right, so it's a little bit of a lighter news week.
00:00:21.390 --> 00:00:27.646
I think everyone is sort of terrified about what's going on around us to really do anything.
00:00:28.320 --> 00:00:33.484
I'm terrified beyond the capacity for rational thought it's a healthy place to be.
00:00:33.987 --> 00:00:38.539
Yeah, the slores, and all that being roasted.
00:00:38.865 --> 00:00:39.698
No, he's actually.
00:00:39.698 --> 00:00:42.569
You don't know what we're talking about.
00:00:42.569 --> 00:00:44.777
You'll never know what we're talking about.
00:00:45.180 --> 00:00:49.466
The Gen Xers probably do All right, so I'm Byron.
00:00:50.046 --> 00:00:50.628
I'm Anthony.
00:00:51.090 --> 00:00:53.182
I'm Sean and we have a.
00:00:53.182 --> 00:01:15.805
Yeah, like I said, we have a little bit of a lighter episode, but we have some more in-depth topics this time and, yeah, so we're going to start it off with James Cameron and Boz, the CTO of Meta, talk about 3D video on Boz's podcast, boz to the Future, sort of a podcast, talking about a podcast.
00:01:15.805 --> 00:01:17.691
You know podcast-ception.
00:01:17.691 --> 00:01:18.492
How meta can you get?
00:01:18.492 --> 00:01:20.746
How meta can you get?
00:01:20.746 --> 00:01:29.100
Indeed, can you get, indeed?
00:01:29.100 --> 00:01:31.584
Um, so this one is interesting because obviously, james cameron is a luminary in the 3d field.
00:01:31.605 --> 00:01:40.323
He's been around and four million, four million years yeah, um, I mean the we.
00:01:40.364 --> 00:02:16.350
we talked about him a couple episodes ago, about how he got started with T2 3D back in the day and then obviously went on to Avatar and the never-ending Avatar sequels, relevant because meta earlier in the or late last year announced that there was going to be a partnership between meta and james cameron's company, light storm.
00:02:16.350 --> 00:02:33.508
Um, and through time we've sort of figured out that lightstorm is a 3D, so not immersive video, but like what Apple calls spatial video, which is just side by side.
00:02:34.180 --> 00:02:34.641
Once again.
00:02:34.641 --> 00:02:38.320
If we go back in time, you rewind the clock from like.
00:02:38.320 --> 00:02:45.846
If we look at the terminology evolution of virtual reality, it has a lot of names Virtual, mixed spatial.
00:02:46.520 --> 00:02:50.807
Yeah, and a lot of the names that people use are conflicting and competing names.
00:02:51.020 --> 00:02:53.949
Which is why we are so here for you and so confused.
00:02:54.400 --> 00:02:59.573
But we help you define reality effectively.
00:02:59.573 --> 00:03:01.066
So what is James Cameron?
00:03:02.344 --> 00:03:03.293
So what Light Storm?
00:03:03.372 --> 00:03:12.935
Entertainment is doing and why this is relevant is because they're trying to
Load full transcript
build some sort of pipeline sort of system to make 3D video more accessible.
00:03:12.935 --> 00:03:41.909
Because, for James Cameron, what he realized, and what this video, the podcast, is largely about, is him coming to the realization that headsets are the end game for the types of content that he creates and that, watching in a theater, he talks about the experience of authoring this content on a perfect Perfect resolution, perfect fidelity.
00:03:42.139 --> 00:03:45.544
Yeah, like a Dolby Vision screen, basically a laboratory.
00:03:45.544 --> 00:03:55.086
A laboratory with the best luminance values and the brightest screen that you could possibly get for watching 3D movies.
00:03:55.086 --> 00:04:01.919
And so they're in the lab watching these 3D movies in an absolutely optimal scenario, and then they go into the theater.
00:04:02.121 --> 00:04:06.945
Then they go into the walk down to the local Regal, get their popcorn and go.
00:04:06.945 --> 00:04:07.929
I can't see.
00:04:09.580 --> 00:04:15.893
Yeah, like, and obviously that was a very frustrating experience for him.
00:04:15.893 --> 00:04:25.317
And so when he first found that VR headsets were being used to watch 3D movies, there was an aha moment, and now he has a new target used to watch 3D movies.
00:04:25.317 --> 00:04:29.951
There was an aha moment and now he has a new target market for his 3D movies.
00:04:29.951 --> 00:04:35.149
And, as someone who you know, I've always been a fan of 3D movies.
00:04:35.680 --> 00:04:53.267
The first 3D movie I ever saw was Captain EO 3D, back at Disneyland in the early 90s, before it was even um, honey, I Shrunk the Kids 3D, which was also one of the first 3D movies I saw.
00:04:53.267 --> 00:05:03.247
And then, uh, living in San Diego, going to the Ruminate Fleet Space Center, they had 3D movies, um and so, and then eventually seeing T2 3D.
00:05:03.247 --> 00:05:50.689
I'm a big fan of 3D movies, but I've always felt the experience of watching one at a movie theater except for very, very specific circumstances, of which I'll get into was incredibly disappointing, especially since the type of 3D and the type of rotoscoping that they were doing, which is, for anyone who doesn't know, we'll get to that Rotoscoping is the process by which you create a 3D depth map from or fix 3D depth maps for times when the stereo isn't completely perfect, so a lot of 3D movies are fixed in post, but the worst ones are completely done in post.
00:05:50.689 --> 00:05:53.346
They're not shot in 3D, historically.
00:05:55.069 --> 00:05:56.973
Example Good example.
00:05:57.841 --> 00:05:58.605
Clash of the Titans.
00:05:58.605 --> 00:06:02.430
That is a famously bad 3D post-conversion.
00:06:04.562 --> 00:06:09.252
Not the best adaptation of a classic work of Greek tragedy.
00:06:10.663 --> 00:06:16.850
You can tell when you're watching a badly done movie like this doesn't look right and what you can tell is that there's not a sense.
00:06:16.920 --> 00:06:19.028
So the worst 3D post conversions.
00:06:19.028 --> 00:06:24.226
It feels like there are distinct layers but there is no actual depth.
00:06:24.226 --> 00:06:25.800
There is no actual depth is no actual depth, it's just like.
00:06:25.800 --> 00:06:39.052
It's like a paper cut out in front of a paper cut out um with no, with no uh nuance to the depth um class of the titans being the most, uh, widely maligned example of this um.
00:06:39.052 --> 00:06:49.807
However, when you get true shot 3d with you know, bespoke three separate cameras, usually that's pretty good, but sometimes they still need to be cleaned up with rotoscoping.
00:06:49.807 --> 00:07:19.451
So what Cameron is talking about in this is partially that that process of rotoscoping is incredibly time consuming, and so Lightstorm Entertainment is sort of working on this merging of post-production tools and shooting with bespoke 3D images, and he's talking about using AI to sort of merge the fields yeah.
00:07:22.040 --> 00:07:25.834
And there are some tools that already exist that, uh, we've tried out.
00:07:26.394 --> 00:08:04.225
Um, yeah, you've used it more than I have yeah, owl 3d is the only one I've actually used owl 3d uh which works really, really well until it doesn't, uh, but it mostly works really well it seems to me that, uh, because I I tested it recently on um, uh, revenge of the sith, and it worked for certain shots, but then there were some shots with like smoke and that type of thing right, which it absolutely didn't know how to do, and then created weird artifacts or like depth that shouldn't have depth, or the smoke had like weird holes in it and that type of thing it's very interesting like so my experience.
00:08:04.286 --> 00:08:09.033
More specifically, so was doing like actual scenes and things like that that I'd shot in 2d.
00:08:09.033 --> 00:08:20.841
Anything that was hanging or protruding off of the body would get thrown off, like if you were wearing glasses and you turn this oh okay, yeah, or like this is a glass, like this hair strand right here, yeah, depending on.
00:08:20.880 --> 00:08:22.324
It just depends on how it is.
00:08:22.324 --> 00:08:25.331
It always was foreign objects, like a bracelet hanging off of somebody's wrist.
00:08:25.331 --> 00:08:26.785
It gets sent to the background.
00:08:26.785 --> 00:08:29.548
Same thing with part of the glasses, and so you have this break.
00:08:29.548 --> 00:08:36.248
But outside of that, if there's no things hanging off the person, the depth is dramatically nice.
00:08:36.248 --> 00:08:37.585
It's very pleasing actually.
00:08:38.681 --> 00:08:40.606
So your lightsaber would be an issue?
00:08:40.606 --> 00:08:42.091
Yeah, probably.
00:08:43.000 --> 00:08:45.349
Oh, and I guess I got off track there for a second.
00:08:45.349 --> 00:08:53.065
What Cameron was saying was that the 3D in theaters isn't great.
00:08:53.065 --> 00:09:09.150
That's why they need rotoscoping and working from getting a distinct Feed per eye.
00:09:09.150 --> 00:09:11.355
That's the big advantage One image per eye, exactly.
00:09:11.399 --> 00:09:17.465
The big advantage is that you're not Like in theaters if you don't know watching 3D movies, or even at home watching 3D movies.
00:09:17.465 --> 00:09:22.519
You don't have crosstalk, yeah, you either have these polarized glasses or shuttered glasses.
00:09:22.519 --> 00:09:23.890
Which is the best version of it?
00:09:23.890 --> 00:09:33.006
Either way, you're trying to force your brain into thinking it's 3d based on like doing this basically very quickly, yeah, and it always creates eye strain.
00:09:33.047 --> 00:09:41.057
It never really works that well and, and it also every, every other method increases the brightness, dramatically decreases or sorry, decreases.
00:09:41.057 --> 00:09:48.033
So this is the other big problem yeah, but with a vr headset you get the full image, you get the full brightness.
00:09:49.080 --> 00:09:51.668
It's an individual feed per eye, so you just don't have the eye screen.
00:09:52.419 --> 00:09:53.384
So wait, wait, wait, wait, wait.
00:09:53.384 --> 00:09:55.167
Back to the T800.
00:09:55.167 --> 00:10:08.807
James Cameron just got on Boz and talked about his new workflow, his new vibe, full picture, both eyes.
00:10:09.702 --> 00:10:15.509
Well, that's why he's seen VR as the future is because it's the optimal way to watch it.
00:10:16.984 --> 00:10:17.485
In a theater?
00:10:17.986 --> 00:10:18.948
No, not in a theater.
00:10:18.969 --> 00:10:22.589
It's not optimal In James Cameron's vision.
00:10:22.679 --> 00:10:30.980
The best 3D that I ever saw was at a Dolby Vision theater when Star Trek Beyond came out in 2016.
00:10:30.980 --> 00:10:49.148
It was the first Dolby Vision 3D I'd ever seen and it was incredible Because Dolby Vision uses laser vision and they use two distinct projections, so one per eye Right so it has the maximum brightness you can get and it was truly immersive.
00:10:49.148 --> 00:10:53.231
However, it was still using polarized glasses, so there was a little bit of crosstalk Eye strain.
00:10:53.231 --> 00:11:00.907
Yeah, it looked amazing, but then I saw VR versions of 3D movies and I was like, oh wow.
00:11:01.400 --> 00:11:09.607
This is so much more Similar thing, but with gravity, gravity was the one that was like, wow, this is great, this is well done in 3D, yeah, but still you kind of have a little bit of a headache at the end.
00:11:10.020 --> 00:11:15.653
I mean it is interesting to hear how much talk about AI was in this.
00:11:15.653 --> 00:11:32.226
I mean, it makes sense because James Cameron has invested in some AI companies, has invested in some AI companies and obviously Meta has their own AI implementation, which is they are, as everyone is, are leaning very hard into.
00:11:32.226 --> 00:11:40.611
And there is some talk in this video about uses of AI for creative purposes.
00:11:40.611 --> 00:11:47.652
I'll be very honest I do not agree with
their where they land on.
00:11:49.865 --> 00:11:50.506
With generative.
00:11:50.888 --> 00:11:51.490
With generative.
00:11:51.490 --> 00:12:06.700
Yeah, I think there was a little bit more nuance in there than I expected them to go with, but I still vehemently disagree with the way that they sound like they're okay with using it.
00:12:06.779 --> 00:12:12.567
And you can vehemently disagree, as well, with the link that we may or may not provide in the comments.
00:12:13.879 --> 00:12:18.011
Yeah, I mean, everyone has a lot of different takes on it.
00:12:18.011 --> 00:12:20.023
I mean being creatives.
00:12:20.023 --> 00:12:32.686
I think we have very specific takes on it, Certainly, I don't know if you want to get into it here, but I think I mean we've made our feelings known over the past several episodes.
00:12:32.706 --> 00:12:33.568
People can figure it out.
00:12:35.398 --> 00:12:44.644
I just generally don't think that we should be using AI to create art unless it is in an assistant mode.
00:12:44.663 --> 00:12:53.749
Yeah, it's the way that it works right now too, especially because it's not really AI, it's like artificial, it's like intelligent copying, really.
00:12:53.879 --> 00:13:13.086
And that's some of my biggest issues with what they get into is that they talk about the inputs rather than the outputs and they don't have very nuanced ideas about the people that they're hurting with stealing the input right, yeah, yeah.
00:13:13.527 --> 00:13:24.241
But I mean really, like we think about the current, what we keep calling ai is really like brute force, creativity, yeah, and so you have to like you know, boil the ocean.
00:13:24.241 --> 00:13:26.366
I mean, what was uh?
00:13:26.366 --> 00:13:32.065
Sam altman recently said it costs oh yeah tens of millions of dollars because people say please and thank you.
00:13:33.307 --> 00:13:46.464
So maybe the model is not so good if it's that inefficient yeah, and well, mind you, I'm guessing that's like because hundreds of millions of people are asking it, that oh I mean it is.
00:13:46.484 --> 00:13:48.770
I mean I don't think they actually have that many people using.
00:13:48.770 --> 00:13:50.884
I think it's just like literally throughout the entire world.
00:13:50.884 --> 00:14:05.490
They do have hundreds of millions of gpus all burning, yeah right, okay, maybe tens of millions, yeah, because I don't think their, their user base is certainly our politeness is around the whole world, maybe not in the united states, but like I mean.
00:14:05.509 --> 00:14:08.345
The thing is, there's a lot of other ais out there, though, right?
00:14:08.345 --> 00:14:16.200
That's true, yeah, and it seems like their people are a lot more polite sure, yeah, but it's just a good example of how inefficient the whole thing is.
00:14:16.200 --> 00:14:32.168
I mean getting into deep seek, I mean they proved that you could do almost the exact same thing with like a tenth of the resources so yeah, but a lot less of the, the, the training wheels and safety guards how so?
00:14:32.327 --> 00:14:33.812
like oh, that there was.
00:14:33.812 --> 00:14:43.166
There was a lot of evidence that DeepSeek doesn't have the safety guards that the other models do.
00:14:43.166 --> 00:14:46.027
It could be propaganda, but yeah, who knows?
00:14:46.027 --> 00:14:46.730
I mean that's the thing.
00:14:46.779 --> 00:14:48.890
They need to besmirch it because they're like wait a minute.
00:14:49.273 --> 00:15:01.725
Yeah, it speaks to a point that deregulated, unregulated AI in an industry that's struggling Seems like it could Skynet us back to the Well, it's going to Skynet, the industry for sure.
00:15:01.784 --> 00:15:02.746
I mean, we're already seeing that.
00:15:03.249 --> 00:15:07.807
Yeah, yeah, we're already inside the matrix.
00:15:08.229 --> 00:15:08.971
Yeah, so I mean.
00:15:08.971 --> 00:15:10.746
So it was just interesting to see this.
00:15:10.746 --> 00:15:20.224
I think there's a lot of good that they're talking about this video and some stuff where I'm just like, come on, guys like James Cameron should know better than this.
00:15:20.224 --> 00:15:28.688
In some ways, boz, I'm not surprised at all, but it is especially when they're talking about the filmmaking specifically.
00:15:28.688 --> 00:15:48.712
I think it's very interesting to see how much they're relying on the VR headsets to sell 3d video specifically, and I think we realize that these headsets are gonna be used more and more over time for video watching.
00:15:49.095 --> 00:15:56.089
I mean, that's why this podcast exists, yeah it's just, it's good to see james cameron has finally reached the conclusion that we did four years ago.
00:15:56.188 --> 00:15:59.754
Yeah, exactly and you know um welcome.
00:15:59.754 --> 00:16:15.327
Welcome, james, we helped, yeah anyways, uh, anyway, that's the future of uh I think, I think we could probably move on um we're, we're going with a little bit more meta news we're gonna move on from meta news to more meta news.
00:16:15.868 --> 00:16:18.932
So this is uh sort of not surprising.
00:16:18.932 --> 00:16:19.111
It's a.
00:16:19.111 --> 00:16:34.869
It's a little bit like uh our going back to our uh like xr glasses video from a couple months ago um meta's new smart glasses with a display.
00:16:34.869 --> 00:16:46.458
So we first heard they're called the product name, the code name.
00:16:46.458 --> 00:16:48.506
The code name is Hypernova.
00:16:48.506 --> 00:16:52.549
Sorry, I'm fighting a cold so my head is a little swimmy.
00:16:53.120 --> 00:16:53.504
And soon.
00:16:53.647 --> 00:16:55.863
I will have that cold yeah we will all.
00:16:55.863 --> 00:16:57.306
It's our cold, the cold.
00:16:57.306 --> 00:17:08.231
Yeah, so they're expecting it to launch in late 2025, between 13 and 1400 bucks.
00:17:08.231 --> 00:17:09.641
That's a lot of money.
00:17:09.641 --> 00:17:12.462
Yeah, that's like as much as a smartphone.
00:17:12.483 --> 00:17:25.164
Pretty much, yes not pretty much like that is up there with a flagship where our flag means death but supposedly they're heavily integrated with ai and they're also going to have cameras.
00:17:25.767 --> 00:17:30.160
They're also going to have like uh, gesture based controls.
00:17:30.160 --> 00:17:48.180
But they'll also have like sort of like swipey UI, sort of like Mac doc or like if you've ever used the Oculus interface, I doubt that it'll have hand tracking but you'll, you know, swipe around on your temples or anything like that.
00:17:48.180 --> 00:17:57.132
But there's the reason why this is interesting, is good, is because there's going to be a monocular display in the lower right-hand corner.
00:17:57.132 --> 00:18:24.111
So I was sort of wondering when Meta would ship a display glass, glasses, form factor, because all the other companies seem to be having a lot of very, very quick success, specifically like X-Reel, yeah, with these glasses form factors, and obviously the Meta Ray Bands have been a gigantic hit for them.
00:18:24.111 --> 00:18:29.366
I didn't think it would be a monocular display.
00:18:30.288 --> 00:18:30.690
Why not?
00:18:30.690 --> 00:18:33.179
Why not monocular, which is the opposite of binocular?
00:18:33.619 --> 00:18:36.015
Well, because why do you want monocular when you can do binocular, which is the opposite of binocular?
00:18:36.015 --> 00:18:40.374
Well, because why do you want monocular when you can do binocular, like it's like they're trying.
00:18:40.394 --> 00:18:42.442
They're like just don't call it google glass please.
00:18:42.541 --> 00:18:55.849
Yeah, well, and that's the thing is that like the it when, when you think about it, the closest thing to it is the google glass, which had, you know, famously, uh, a small display up in the upper right-hand corner which launched.
00:18:55.849 --> 00:18:57.231
What was that?
00:18:57.231 --> 00:18:58.512
2011?
00:18:58.594 --> 00:18:59.994
Definitely 2010?
00:18:59.994 --> 00:19:03.680
Yeah, three, somewhere around there, somewhere around there, yeah, somewhere around 2010.
00:19:04.340 --> 00:19:12.971
But then was like the glass holes thing, which I don't think is really going to be as much of an issue these days.
00:19:13.221 --> 00:19:15.327
I mean it helps that they package them up nicely.
00:19:15.327 --> 00:19:17.298
Right Like these don't look going to be as much of an issue these days.
00:19:17.240 --> 00:19:24.308
I mean it helps that they package them up nicely right Well, and also we live in a world now where everyone has their phone camera out almost at all times.
00:19:24.308 --> 00:19:33.470
If you see a Gen Z that's out in the world, there is a very good chance that they have their camera out.
00:19:34.421 --> 00:19:37.328
So a monocular display on the right side.
00:19:37.328 --> 00:19:38.050
Is it configurable?
00:19:38.050 --> 00:19:39.317
Can you put it on the left if you're like?
00:19:39.336 --> 00:19:39.579
oh gosh no.
00:19:39.579 --> 00:19:42.308
So, it's going to be hardware baked in.
00:19:42.328 --> 00:19:45.128
Oh no, that's going to definitely take out a certain percentage of.
00:19:46.020 --> 00:19:47.286
But I do think it is.
00:19:47.286 --> 00:19:54.253
I think they're trying to figure out what is the potential market for these display glasses.
00:19:54.253 --> 00:19:58.224
What is the potential market for these display glasses?
00:19:58.224 --> 00:20:03.163
How is it going to work and really dip their toe in before they'd go full binocular, because once they get into binocular there's going to be an expectation there.
00:20:03.163 --> 00:20:12.324
And also these glasses seem to be uh, these aren't like video glasses, right?
00:20:12.324 --> 00:20:17.472
These are smart glasses that have a display yeah, it's more.
00:20:17.492 --> 00:20:20.644
Yeah, it's designed around input, not output yes, exactly so this is.
00:20:20.964 --> 00:20:31.743
This is like integrating social features into your life, having a like a small heads-up display for like turn by turn directions, stuff that we talked about on the other, on the other episode.
00:20:32.005 --> 00:21:10.432
But this is not like the x reels where you're watching movies on them, or uh, yeah, this is for like driving, working and and like being in, like yeah, uh, I don't imagine unimagined being like used for door dashing not not even joking, because there are hundreds of times where I've seen like a door dash delivery guy, girl, gal, robot kind of just not be able to find the door because it's dark, it's, there's a complex, you live in a nice development and it's really difficult to find that, you know.
00:21:10.432 --> 00:21:21.452
But if I could just be, if you just less wandering in the parking lot, more just hot food, I think that's what this they're trying to do.
00:21:21.452 --> 00:21:24.141
I mean, that's the market as I see yeah, among others.
00:21:24.181 --> 00:21:26.405
I mean I saw one video the other day that was like.
00:21:26.405 --> 00:21:32.251
It was a school bus driver who was like, uh, constantly dealing with cars passing with the.
00:21:32.251 --> 00:21:41.710
You know they had a little stop sign out and people still blowing by and they're like, oh, record it with my meta glasses and it was like really interesting because it's really more like a dash cam for your face.
00:21:41.849 --> 00:21:49.734
Yes, yeah, yes, you know, I see I've been seeing the implementation of the meta Ray-Ban glasses.
00:21:49.734 --> 00:22:04.442
A lot of people at conferences or at events where they're not allowed to bring in a camera, everybody still brings their smartphone.
00:22:04.442 --> 00:22:04.923
But, uh, yeah, exactly.
00:22:04.923 --> 00:22:05.263
Well, uh, yeah.
00:22:05.263 --> 00:22:27.227
So like the nintendo switch 2 launch happened, um, in new york city a couple weeks ago and uh wolf den, one of my favorite like uh video game youtubers uh, they weren't allowed to bring in cameras but he brought
his Ray-Bans and just recorded him his interaction with the console, so he recorded himself playing it and the footage looked great.
00:22:27.227 --> 00:22:33.444
It was a very good implementation of that tech for this specific use case.
00:22:33.444 --> 00:22:40.605
Right, right, yeah, it makes me sort of wonder, like I wonder if we could get stereo.
00:22:40.605 --> 00:22:45.512
Are there any stereo versions of these?
00:22:46.694 --> 00:22:52.078
I mean, it's a little bit more challenging because you, by nature of it, especially like this type of design.
00:22:52.078 --> 00:22:54.224
Yeah, your, your ipd will always be off.
00:22:54.224 --> 00:22:54.685
It'll be too.
00:22:54.846 --> 00:22:56.069
It'll be a little bit too wide, yeah.
00:22:56.069 --> 00:23:00.328
So, unless you put, which would kick cameras here or here, create a hypo-stereo effect.
00:23:00.641 --> 00:23:05.885
That's where their roadmap, which was leaked earlier this year, kind of reveals that.
00:23:05.885 --> 00:23:15.525
All those fine-tune, all that data that they need to figure out what what is the solution to the fact that we all have different eyes, faces and brains?
00:23:15.525 --> 00:23:25.294
If the entry barrier is, I don't want to put those, because I hear people throw up all the time and you can say no, no, no, no, no, this is different.
00:23:25.294 --> 00:23:27.936
Then okay, maybe I'll give it a shot.
00:23:27.936 --> 00:23:28.277
Why?
00:23:28.277 --> 00:23:39.972
Because I hate looking at my maps, or I want to go into Comic-Con, but I don't want to take off these prescription glasses.
00:23:39.992 --> 00:23:50.429
It's funny that you mentioned comic-con, because when I was at the star trek convention last year, uh, the first night that we were there, I saw a guy wearing meta ray-ban glasses.
00:23:50.429 --> 00:23:53.903
They did, they say, and he was like I'm recording right now, just fyi, so you know.
00:23:53.903 --> 00:23:56.037
I was like oh whoa, okay, that's now just FYI, so you know, I was like oh whoa.
00:23:56.057 --> 00:23:56.480
Okay, that's cool.
00:23:56.480 --> 00:23:58.084
Did he go to see the trailer for Predator?
00:24:02.320 --> 00:24:04.547
Well, this was at the Star Trek convention, not Comic-Con.
00:24:04.547 --> 00:24:12.664
Okay, so this was Vegas, the real one, I mean, comic-con is real, anyways moving on.
00:24:12.664 --> 00:24:14.248
They both exist in the same universe.
00:24:14.248 --> 00:24:27.105
So supposedly their meta is already working on a successor to the Hypernova which will have a binocular display, so they are shooting for it long term.
00:24:27.105 --> 00:24:36.305
But apparently they just haven't cracked that code yet, which I don't know they're also working on some Oakleys right, they're like a $100 billion company.
00:24:36.305 --> 00:24:37.067
I feel like they could do it.
00:24:37.729 --> 00:24:41.404
Yeah, well, spending all that money on AI instead?
00:24:41.404 --> 00:24:42.366
Yeah, all right.
00:24:44.881
--> 00:24:46.806
Yeah, I guess probably time to move on.
00:24:46.806 --> 00:24:54.400
Okay, so this is Excuse me, this is interesting Apple immersive video utility.
00:24:54.400 --> 00:25:04.844
So we covered something sort of similar to this a couple months ago, but that was like an external right, like a third party.
00:25:04.864 --> 00:25:07.451
Yeah, that was, that was a and it was.
00:25:07.820 --> 00:25:10.705
It was an Apple vision, yeah, but, and it was an Apple vision pro app.
00:25:10.705 --> 00:25:13.444
Is it the spatial or is it a different thing?
00:25:13.444 --> 00:25:14.907
No, it was the one.
00:25:14.907 --> 00:25:17.594
It was like CapCut for yeah.
00:25:18.901 --> 00:25:19.903
Which episode was that?
00:25:20.385 --> 00:25:21.569
I don't remember, darn it.
00:25:21.569 --> 00:25:23.547
I think it was 11.
00:25:23.547 --> 00:25:23.788
Yeah.
00:25:24.961 --> 00:25:25.925
Okay, algorithm.
00:25:25.925 --> 00:25:30.912
Please link this version to the 11th stereoscope.
00:25:31.441 --> 00:25:31.863
That's me.
00:25:31.863 --> 00:25:32.826
I'm going to be editing this.
00:25:33.801 --> 00:25:35.146
Yeah, you are the algorithm.
00:25:35.146 --> 00:25:38.166
Anthony is our homegrown algorithm.
00:25:38.307 --> 00:25:41.288
He's our basilisk, he's an organic algorithm, if you will.
00:25:42.181 --> 00:25:54.653
Anyway, so Apple has their own new app that they released, apple Immersive Video Utility, and this is sort of like iMovie, but for Apple Vision Pro.
00:25:54.653 --> 00:26:14.231
Yeah, so very similar functionality of those so it's like importing, organizing and reviewing your footage um that you take either with your Apple Vision Pro or, I wonder, can you take it video.
00:26:14.251 --> 00:26:17.016
So does it only edit spatial video and not immersive?
00:26:18.101 --> 00:26:22.432
No, it says it also does up to 8K 180.
00:26:22.432 --> 00:26:29.413
So it looks like it's a general VR 180 and spatial video editor.
00:26:29.413 --> 00:26:37.109
They can also connect directly to the Vision Pro to stream immersive videos.
00:26:37.109 --> 00:26:39.413
That's yeah, really.
00:26:39.413 --> 00:26:40.501
That was the major thing.
00:26:40.501 --> 00:26:47.442
Interesting, yeah, oh wow, with options for synchronized playback and multi-device viewing sessions.
00:26:47.442 --> 00:26:48.086
It's like a group.
00:26:48.086 --> 00:26:49.108
That's fascinating.
00:26:49.108 --> 00:26:52.661
Um, so is that like co-watching or exactly?
00:26:52.862 --> 00:26:53.201
it's like.
00:26:53.201 --> 00:26:56.729
It's like the movie theater, but you're not even in the same room.
00:26:56.729 --> 00:26:57.451
Necessarily.
00:26:57.451 --> 00:26:57.750
It's synced.
00:26:57.750 --> 00:27:02.586
It's so different than what we're used to.
00:27:02.586 --> 00:27:06.009
Have you seen the last episode of So-and-So?
00:27:06.009 --> 00:27:13.507
Yeah, but I didn't see it the same time you did, whereas flashback 10, 15 years ago we would have to go to the bar to see the finale.
00:27:16.201 --> 00:27:18.367
Supposedly this is literally just for Apple.
00:27:18.367 --> 00:27:22.627
Immersive video and Spatial is included.
00:27:22.627 --> 00:27:27.965
Interesting, ivory has enabled eye tracking on PSVR 2 for PC.
00:27:27.965 --> 00:27:40.306
So in the last episode we talked about the price cut for the PSVR 2, which has sort of rebooted the PSVR 2's existence and this solidifies it.
00:27:40.306 --> 00:27:49.752
So one of the things we talked about last time was that the PSVR 2 was lacking features on PC.
00:27:49.752 --> 00:27:58.301
So it was still a good buy because there is very little else on the market that compares at a price point.
00:27:58.301 --> 00:28:13.088
But I was maligning the fact that it didn't have eye tracking, it didn't have HDR, it didn't have the haptic support, but now they've enabled both eye tracking and limited HDR support, though that one is with a major caveat.
00:28:14.160 --> 00:28:17.026
But eye tracking does seem like the.
00:28:17.026 --> 00:28:22.407
That's a step into the playing field being like hey, hey, I learned how to lay up, is that okay?
00:28:22.720 --> 00:28:25.750
That is a huge feature to have at this price point.
00:28:25.750 --> 00:28:37.978
So Ivory is a third-party dev who got this working through their own custom firmware which they sell.
00:28:37.978 --> 00:28:44.390
The driver support through steam and so you can buy this, the custom firmware.
00:28:44.630 --> 00:28:59.487
So it's 399 399 cut by 150 bucks cut by 150, okay, yeah multiplied by the greek value of uh, the tariff divided by the exqualification of the bloviated goblendering, it's probably going to be.
00:29:00.701 --> 00:29:02.730
So technical Sean, yes.
00:29:05.383 --> 00:29:05.502
Shit.
00:29:05.502 --> 00:29:07.651
Pause the tariffs for 90 days, yeah.
00:29:08.281 --> 00:29:23.192
So this implementation is custom firmware, so it's not going to work out of the box unless you get some extra juice in there, and it's not going to be supported by a lot of things because it hasn't existed thus far.
00:29:23.192 --> 00:29:31.173
But what this will enable is things like eye-tracked foveated rendering, which we have talked about previously yes, my favorite words.
00:29:31.173 --> 00:29:35.788
And so that's a dynamic foveated rendering.
00:29:35.788 --> 00:30:03.313
This this could also allow for um I tracking control of your interface, though there currently isn't any implementation of that in any of the the various interfaces on pc, though I'm guessing somebody will most likely hack that not hack, but like code that into SteamVR, because pretty much everything gets integrated into SteamVR.
00:30:03.400 --> 00:30:11.346
And while they're at it, they'll try to work with the luminance levels and try to get HDR to fix with 10-bit, yeah, so that is another thing that is going to have to be added.
00:30:11.726 --> 00:30:28.460
that is not currently supported is that they got the 10 bit color
working for HDR, but currently SteamVR does not support custom luminance levels, so half of the implementation of the HDR is broken.
00:30:29.502 --> 00:30:30.605
It's up to you to fix it.
00:30:31.648 --> 00:30:46.987
Yeah, so literally somebody in the community is going to have to figure out how to implement or get Valve which is actually the more likely scenario to get Valve to support dynamic luminance levels in SteamVR.
00:30:48.363 --> 00:30:49.244
They'll probably do it.
00:30:49.925 --> 00:30:51.229
They most likely will, why not?
00:30:51.450 --> 00:30:52.511
Just more eyes on their work.
00:30:53.039 --> 00:30:59.180
Well, and here's the other thing, it's almost certainly going to be implemented into the Deckard in some capacity.
00:31:01.223 --> 00:31:02.445
And it's all cross-play, it's Steam.
00:31:03.106 --> 00:31:03.728
That's the whole point.
00:31:03.728 --> 00:31:04.569
They went either way.
00:31:04.569 --> 00:31:05.151
That's the beauty.
00:31:05.432 --> 00:31:22.523
Yeah, and you know the Steam Deck has an OLED panel, so there is I don't know if it supports HDR, though Interesting, so Steam is gonna have to work this stuff out eventually, most likely for the Deckard.
00:31:22.523 --> 00:31:30.000
This is all speculation, so they'll probably end up putting it into SteamVR at some point, but we don't know.
00:31:30.000 --> 00:31:33.263
I hope Sony stays in their lane with this so it doesn't try to.
00:31:33.263 --> 00:31:38.431
So the only thing that's lacking thus far is the haptic support for the headset.
00:31:38.431 --> 00:31:43.328
I'm not sure if they've got it working on the controllers actually.
00:31:45.121 --> 00:31:46.507
But it does work on the headset.
00:31:46.507 --> 00:31:47.806
I didn't know until recently.
00:31:47.806 --> 00:31:49.231
No, it does not work on the headset.
00:31:49.231 --> 00:31:54.045
Oh, it does not work on the headset, but I did not know that until recently that it even had haptics.
00:31:54.160 --> 00:31:58.943
That the headset had haptics the headset, but I did not know that until recently that it even had haptics.
00:31:58.943 --> 00:32:07.922
Yeah well, and some people have said that because I I haven't played call of the mountain, um on psvr2, but in that it shakes your head when you get like hit.
00:32:07.922 --> 00:32:13.864
It sort of sounds gimmicky yeah, um, but some people said that it heavily increased immersion.
00:32:14.044 --> 00:32:15.990
Yeah, I'm like be fair, everything sounds gimmicky.
00:32:15.990 --> 00:32:20.211
A lot of the stuff that we're talking about sounds gimmicky until you experience it.
00:32:20.380 --> 00:32:21.726
I like hashtag gimmicky.
00:32:21.987 --> 00:32:22.307
Gimmicky.
00:32:22.307 --> 00:32:23.857
It goes along with bloviated.
00:32:23.857 --> 00:32:25.945
We got a lot of mush mouths today.
00:32:25.945 --> 00:32:26.909
Bloviated hashtag, gimmicky.
00:32:26.929 --> 00:32:29.401
Myself included, yeah.
00:32:29.401 --> 00:32:39.463
So it's interesting that this has been enabled because it sort of very much solidifies sort of the reboot and resurgence of the psvr2.
00:32:39.463 --> 00:32:55.790
We're going to see a lot of people purchasing the headset for pc and I mean, I think I'm going to, finally, because now that they've got eye track for video rendering, that's going to help with um performance on pc for certain games like Like.
00:32:55.790 --> 00:33:08.568
We actually didn't include this, but it was announced that Microsoft Flight Simulator is permanently adding directly integrated dynamic foveated rendering into the game.
00:33:08.568 --> 00:33:23.515
So now it at a at a low level it will support dynamic dynamic foveated rendering, which is great because microsoft flight simulator is ridiculously, uh, powerful in terms of, um.
00:33:23.996 --> 00:33:37.400
it requires a lot of resources, a lot of resources, to play that game correctly, including Including a pilot's license, and so you really need to eke out every frame on that game, and adding dynamic boviated rendering will help with that quite a bit.
00:33:37.579 --> 00:33:44.249
The question is will you be able to tolerate going back in time and dealing with Fresnel lenses?
00:33:44.249 --> 00:33:53.570
I mean, we always forget about that big caveat probably you know.
00:33:53.611 --> 00:34:03.967
Like I will say, I booted up my psvr one a couple months ago and I used it for the first time in a really long time and I was surprised.
00:34:03.967 --> 00:34:07.851
Surprised at how good it looked.
00:34:07.851 --> 00:34:26.166
Still, um, mostly because when, when I play on pc, I've gotten so used to uh, streaming and uh, the streaming artifacts, the, the built-in compression right, it just has that look to it right right right.
00:34:26.547 --> 00:34:28.492
Um, so you're used to flying blindfolded.
00:34:28.492 --> 00:34:42.179
I'm used to flying with like a little veneer of blockiness through all of, at least when I'm playing on PC, when I'm just like playing Quest 3 stuff.
00:34:42.179 --> 00:34:45.945
It looks great, but you also have a pilot's license.
00:34:45.945 --> 00:34:48.489
No, oh, it expired.
00:34:48.489 --> 00:34:51.074
It expired like 15 years ago.
00:34:51.074 --> 00:34:53.143
Fine, all right.
00:34:53.143 --> 00:35:03.514
Moving on, blackmagic finally fully revealed the Blackmagic Ursa Immersive at the NAB show, which is the National Association of Broadcasters.
00:35:03.514 --> 00:35:12.467
It's a large broadcasting convention, I mean like a lot of things like that.
00:35:12.606 --> 00:35:13.369
It is.
00:35:13.650 --> 00:35:14.190
It's a trade show.
00:35:15.081 --> 00:35:36.731
Yeah, it's just another place that camera companies announce cool stuff and it's usually the big one for the year for cameras, yes, and so we've sort of gotten peaks and glimmers of information from the various influencers over time and still, to this day, actually that's the only place where we've seen video of the device.
00:35:36.731 --> 00:35:42.059
I was actually looking for some in-house videos from Blackmagic of the camera, and they have.
00:35:42.059 --> 00:36:02.186
Yet there are promotional stills which you're seeing behind you, but there aren't any official videos yet, which is frustrating, because I wanted to include some videos and I don't try to include third-party other influencers' content in our videos, because that would destroy the algorithm.
00:36:02.206 --> 00:36:04.010
I don't know.
00:36:04.351 --> 00:36:11.012
It just, but we do have some high-quality stills of the camera behind us.
00:36:11.760 --> 00:36:15.387
And it looks really cute, if I must say it's a chunker.
00:36:15.487 --> 00:36:16.148
I can tell you that.
00:36:16.670 --> 00:36:17.210
How much is it?
00:36:18.273 --> 00:36:19.054
$30,000.
00:36:19.074 --> 00:36:20.378
$29,99.
00:36:20.378 --> 00:36:20.938
$95.
00:36:21.320 --> 00:36:22.891
That's like three tariff anyway.
00:36:22.911 --> 00:36:29.378
So we don't know exactly, yeah, how much is a camera that James Cameron would want to use in the year 2004?
00:36:30.000 --> 00:36:39.000
Well, and we were talking about this earlier, is that a cinematic, like a professional cinematic camera, is $100,000.
00:36:39.420 --> 00:36:44.599
Yeah, I mean, there's a reason you use the term camera package because there's, like always, these components.
00:36:44.599 --> 00:36:56.384
So what's impressive about this is how much you basically have a ready to shoot situation out the gate for 30k, whereas something like you know you could get a red raptor for 2025 somewhere in that range.
00:36:56.384 --> 00:37:04.068
Um, but then you've got to add batteries and lenses and adapters and wireless all these things media cards, all that stuff.
00:37:04.068 --> 00:37:06.280
This thing's got eight terabytes of storage built in.
00:37:06.280 --> 00:37:08.385
It's got 10g networking built in.
00:37:08.465 --> 00:37:16.061
It's got the lenses built in and those and the eight terabytes, that's hot swappable right uh, I don't know if it actually don't.
00:37:16.222 --> 00:37:22.733
I mean, you're not going to be recording, it's not, it's hot swappable, and that you don't have to shut the camera down to swap it out.
00:37:22.733 --> 00:37:27.527
I mean, that's what I mean, yeah but yeah, it's basically an array of m2 drives and.
00:37:27.527 --> 00:37:30.614
And they have a 16 terabyte option available?
00:37:30.699 --> 00:37:34.231
Yeah, and we learned a couple months ago that you can work directly off of the drives.
00:37:34.800 --> 00:37:39.052
The 10G networking that's in it means you plug it in, it's on your network.
00:37:39.052 --> 00:37:41.985
You can start pulling footage directly off of it.
00:37:41.985 --> 00:37:43.248
That's very impressive.
00:37:43.349 --> 00:37:44.211
That's a big deal.
00:37:44.331 --> 00:37:44.833
In real time.
00:37:44.833 --> 00:37:46.567
That's a big, big, big deal.
00:37:46.567 --> 00:37:53.150
We're using 10G, but I don't
have SSD storage.
00:37:53.150 --> 00:37:55.545
So, it's still like when you hit 10G.
00:37:55.806 --> 00:38:07.166
The bottleneck, unless you have SSDs, is the drives, which is kind of crazy, which we have learned, yeah, so you could like like theoretically plug this into like a RAID server.
00:38:08.208 --> 00:38:11.012
You could plug it in and plug and play.
00:38:11.092 --> 00:38:12.054
You don't need a RAID server.
00:38:13.661 --> 00:38:14.188
It is its own RAID server.
00:38:14.208 --> 00:38:17.208
You plug it into your Switch and you bring it up on your computer and you're editing, yeah.
00:38:18.101 --> 00:38:22.019
So we'll just go through a little bit of the specs, because it's pretty impressive.
00:38:22.019 --> 00:38:25.909
So it's got dual 8K sensors.
00:38:25.909 --> 00:38:38.170
Yeah, it's got 8K stereoscopic recording at 90 90 frames per second, which is the highest that I've ever seen um 16 stops of dynamic range which incredible.
00:38:38.170 --> 00:38:39.632
Uh, and this is a.
00:38:39.632 --> 00:38:43.905
This is a big one and a lot of there's some some spiciness.
00:38:43.905 --> 00:38:47.210
Here is fixed focus pre-calibrated lenses.
00:38:47.210 --> 00:38:59.447
Yes, some people are not a fan of this, but working in VR video, this is almost required.
00:39:00.110 --> 00:39:04.204
Yeah, I mean having a lens that we, the R5C lens here.
00:39:04.204 --> 00:39:11.003
The 5.2 mil has variable focus and it's more of a pain than it's worth yeah, and you're constantly on it.
00:39:11.063 --> 00:39:12.670
Yeah, because it will drift away.
00:39:12.670 --> 00:39:14.797
You have to yeah for every single shoot.
00:39:14.797 --> 00:39:16.222
You have to calibrate.
00:39:16.342 --> 00:39:19.047
Yeah, yeah, we're not every but I mean you're.
00:39:19.047 --> 00:39:23.101
It's like it's not very, it's kind of delicate.
00:39:23.101 --> 00:39:29.304
There's like some prisms in there, and so they they'll get out of whack and every now and then you got to tweak the lenses that the interfocal it's.
00:39:29.304 --> 00:39:30.646
Yeah, it's not great.
00:39:30.646 --> 00:39:31.889
So this this locked in.
00:39:31.889 --> 00:39:38.007
Uh, you know, my biggest like fear, or whatever, is like we don't really know what aperture they picked.
00:39:38.349 --> 00:39:42.858
It's a fixed aperture as well, yeah, and they haven't said yet they won't say they're apparently like, literally like I.
00:39:42.978 --> 00:39:51.405
I've seen a couple of videos I think hughes was one of them where they will ask over and over and then there'll be a jump cut and they'll be talking about something else?
00:39:51.425 --> 00:39:52.188
Hey, don't ask about that.
00:39:52.188 --> 00:39:54.427
What do you think a good aperture would be?
00:39:54.427 --> 00:39:56.650
I mean, if I was to shoot in the dark.
00:39:56.670 --> 00:39:57.635
Shot in the dark 5.6.
00:39:57.635 --> 00:39:58.460
That would be my guess.
00:39:58.460 --> 00:40:05.384
Somewhere between 4 and 5.6, where it's sharp enough because you need to have enough depth of field to have focus from.
00:40:05.384 --> 00:40:09.188
They're saying like one meter to infinity is what they say it is.
00:40:09.628 --> 00:40:12.052
But they even said that you could get even closer.
00:40:12.612 --> 00:40:14.974
Right, there's like some, just by observation.
00:40:14.974 --> 00:40:27.478
They're just claiming one meter, but by observation you can get closer than that, which again would lead me to believe that there's a pretty stopped down aperture which makes it really like.
00:40:27.478 --> 00:40:32.985
My biggest concern, or curiosity anyway, about this is how's it going to do in low light, because you're already?
00:40:33.105 --> 00:40:37.445
running at 90 frames per second, which is way cutting down the amount of light you can take in.
00:40:37.445 --> 00:40:39.489
Then you have a fixed aperture.
00:40:39.489 --> 00:40:48.235
So you really the only thing you can do is play with shutter angle to get, and iso to get, a brighter image.
00:40:48.577 --> 00:40:52.088
Hey, necessity is the mother of creativity.
00:40:52.380 --> 00:40:59.525
Yeah, but I'm because I work with B-Raw a lot and they have 16 slots of dynamic range stuff like that.
00:40:59.525 --> 00:41:01.023
I think it's going to be fine.
00:41:01.023 --> 00:41:05.867
Clearly they wouldn't put out something that's just unusable in anything other than the brightest lights.
00:41:06.360 --> 00:41:08.420
Yeah, magic knows what it's doing.
00:41:08.420 --> 00:41:12.851
I don't think that they're going to kind of go oh shit, pause the tariffs for 90 days.
00:41:12.851 --> 00:41:13.635
Yeah.
00:41:14.760 --> 00:41:16.789
So it also has built-in ND filters.
00:41:16.789 --> 00:41:19.047
Clear two-stop, four-stop and eight-stop.
00:41:19.047 --> 00:41:23.188
A fold-out five-inch HDR touchscreen monitor.
00:41:23.188 --> 00:41:23.811
That's nice.
00:41:24.360 --> 00:41:28.445
That's a launcher with the one on the assistant side, on the other side of the.
00:41:28.927 --> 00:41:44.505
Oh yeah, it looks like a little robot with it's got stereo microphones and two XLR inputs, 12g SDI, ethernet and USB-C ports, high-speed Wi-Fi antennas.
00:41:44.505 --> 00:41:49.528
8 terabyte that's the hot swappable M.2 SSDs that you're talking about.
00:41:49.528 --> 00:41:55.431
B-raw, and so this is a little bit.
00:41:55.431 --> 00:42:00.369
This part is almost certainly.
00:42:00.369 --> 00:42:19.228
Why the camera exists is that it has Apple Vision Pro integration, which is the camera system was designed with this in mind from the ground up, so it's designed to maximize Apple immersive video versus Cine Immersive offers lifelike 180 degree stereoscopic imaging.
00:42:19.228 --> 00:42:33.585
So what this means is that the camera was designed to work in tandem with Apple Vision Pro at a system level yeah, like at a yeah it's.
00:42:33.967 --> 00:42:34.409
I mean it's.
00:42:34.409 --> 00:42:40.208
I'm trying to think of the
best way to put it yeah, it's hard to describe because there's nothing really like it and there's a pipeline like da vinci.
00:42:40.208 --> 00:42:48.304
Resolve is part of this pipeline, yeah, um, but it is fascinating because, uh, the whole thing is metadata driven.
00:42:48.945 --> 00:43:06.318
So yeah, you were telling me about this a couple days ago which is that like, rather than having everything flattened into one image, right A lot of the effects and the exposure, control.
00:43:06.318 --> 00:43:13.487
I wouldn't say exposure control but like specifically, the unwrapping is one of the things.
00:43:13.507 --> 00:43:14.590
Okay, yeah, that's what you were saying.
00:43:14.590 --> 00:43:27.807
So, like the, you can feed an unwrapped version like the footage going into the avp via this pipeline will be the dual fisheye so it's not an equirectangular, it's not yet okay, so everything included.
00:43:27.807 --> 00:43:33.539
The unwrapping data is all coming from the calibration that was done at the factory.
00:43:33.539 --> 00:43:36.668
That is baked into the metadata of the B-Raw file.
00:43:36.668 --> 00:43:46.547
So the instructions for how to correctly unwrap the footage per the particular set of lenses in that particular camera is all metadata.
00:43:46.820 --> 00:43:51.664
It's fed via metadata all the way to the avp, which then unwraps it.
00:43:51.965 --> 00:44:19.067
Does that save you time, it saves a lot of time and it saves a lot of quality well, and I was also including like things like you can have an editing timeline with transitions and it just feeds both videos and the instructions for the point and which type of transition to the headset and the headset does well, and also this this this camera is also capable of live streaming, so some of this stuff you can do in real time so you could add effects.
00:44:19.748 --> 00:44:38.347
I don't know about that, so I think there was some I watched some some narrative on this, which that there are going to be some effects that you're going to be able to enable in real time that happen in DaVinci, which will feed through to the camera, to be able to be live streamed.
00:44:38.500 --> 00:44:43.130
Yeah, I mean that would be because you have all the 10G Ethernet feeds.
00:44:43.130 --> 00:44:47.150
You could, and you can, get a live feed of the camera via 10G.
00:44:47.150 --> 00:44:48.889
So I could definitely see that.
00:44:48.889 --> 00:44:53.230
See that using DaVinci Resolve would become like a switching hub basically.
00:44:53.250 --> 00:45:08.820
Yeah Well and it makes sense because a lot of in the new that's why it's at the NAD DaVinci Resolve 20 beta they implemented a bunch of new live switching features into the new version of Resolve.
00:45:09.099 --> 00:45:15.273
So more like party balloons coming at you, more like fun cat face emojis.
00:45:15.614 --> 00:45:15.753
Yeah.
00:45:16.320 --> 00:45:26.219
Well, and you were telling me the other day that that's sort of how Apple's camera stack works and this was interesting nuance that I think is really important.
00:45:26.219 --> 00:45:26.619
Yeah, and it's something I only recently learned about.
00:45:26.239 --> 00:45:27.449
And this was interesting nuance that, I think, is really important.
00:45:27.449 --> 00:45:28.324
Yeah, and it's something I only recently learned about.
00:45:28.324 --> 00:45:37.699
When you make an edit on your iPhone, whether it's to a photo or a video, it is also just metadata until you share it with somebody who's not on Apple.
00:45:37.920 --> 00:45:39.527
So until you flatten that image Right.
00:45:40.121 --> 00:45:48.188
So that's why you can go back to a photo that you edited two years ago and just hit undo and revert back to the way it was, because none of the changes are destructive.
00:45:49.621 --> 00:45:53.170
So it's until you export that video and send it to me, an Android user.
00:45:54.121 --> 00:45:58.831
Then it's got to do a little bit of processing before it can flatten the video or the photo and send it out.
00:45:58.972 --> 00:46:00.804
Yeah, which does also save time.
00:46:01.807 --> 00:46:02.927
Yeah, I mean.
00:46:02.927 --> 00:46:08.751
The beauty is it's non-destructive, so you save time, but you're also not.
00:46:08.751 --> 00:46:12.971
Every time you do a conversion you're losing some quality.
00:46:12.971 --> 00:46:20.931
So by leaving it, pixel perfect all the way until the end user and the end user is unwrapping it, that's pretty mind-blowing.
00:46:21.119 --> 00:46:23.086
This is like a chain of custody of edits.
00:46:23.648 --> 00:46:28.547
Yeah, basically You're just sending instructions, which again is what the iPhone does with these things.
00:46:28.547 --> 00:46:40.340
It's just a set of instructions, but not actually doing like transforming the media, which just really goes to show how powerful the AVP itself is, that it can do all this stuff In a headset in real time.
00:46:42.114 --> 00:46:43.181
It's better than Bitcoin.
00:46:43.181 --> 00:47:13.364
So it seems like a lot of this implementation is also DaVinci itself and that DaVinci has sort of which is interesting because up until about a couple years ago, there was no baked in VR support in DaVinci, Right Like they didn't even have an awareness of VR 180.
00:47:13.364 --> 00:47:16.664
We have to just treat it like a.
00:47:17.516 --> 00:47:22.164
Yeah, I mean right now we're using tools that somebody else made Andrew Hazleton shout out yeah, the Cardiverse.
00:47:22.119 --> 00:47:24.420
Yeah, the Cardiverse stuff, like using a lot of the tools he's developed that are just, you know, tools that somebody else made andrew hazleton shout out card at cardiverse.
00:47:24.376 --> 00:47:49.362
yeah, the card PR stuff, like using a lot of the tools he's developed uh, that are just, you know, plugins that you download and install and you know they work, but like it's not nearly as efficient as app it had been written and like when, when I, when I
first uh, because I made some um 3d titles that like flew at you right in fusion I literally had to just create two cameras and sync them and then align them.
00:47:49.815 --> 00:47:57.695
But it was so hacky and if I had messed up one of those nodes the entire thing would have broken.
00:47:57.755 --> 00:47:58.697
You were not pleased with your.
00:47:58.697 --> 00:48:01.085
Yeah, I wouldn't call it hacky, no, I was not.
00:48:01.235 --> 00:48:03.440
I mean it just made it so much harder to be able to iterate because I'm not call it hacky no, I was not.
00:48:03.440 --> 00:48:07.795
I mean it just made it so much harder to be able to iterate because I'm not super familiar with Fusion.
00:48:07.795 --> 00:48:09.521
I was going to say, because it's not hacky.
00:48:09.675 --> 00:48:12.851
It's actually like it's ironically the best way of doing it now that I've done it.
00:48:12.851 --> 00:48:13.454
Sure, yeah.
00:48:13.916 --> 00:48:14.940
It felt hacky at the time.
00:48:15.034 --> 00:48:25.489
Because it's truly it feels weird, but like it works better, like you better, like you're getting truer 3d by doing that, because you're literally setting the ipd and everything of those two camera lenses.
00:48:25.489 --> 00:48:29.672
Yeah, that's in your virtual environment so you can match your, the camera that you're shooting.
00:48:29.692 --> 00:48:38.235
But now it seems, da vinci saw an opening in the market and was like, let's just be I mean, I don't know that, I think they just they're probably getting a there.
00:48:38.596 --> 00:48:44.304
There's a apple partnership here at work, because I don't think they would do you think that they were approached by apple?
00:48:44.304 --> 00:48:45.806
It's possible.
00:48:45.806 --> 00:48:56.101
I'm not entirely sure, because apple has their own camera tech that they bought from john right, but they don't have the same kind of brand like loyalty, trust around the product, like vr black magic is.
00:48:56.601 --> 00:49:00.875
Is it's a post-production like, yeah, playground and apple?
00:49:00.875 --> 00:49:01.416
I don't.
00:49:01.416 --> 00:49:03.963
I think that's just for enthusiast kids and their little siblings.
00:49:05.434 --> 00:49:10.505
Well, it's an interesting move for Apple, because traditionally Apple is all about that vertical integration.
00:49:12.338 --> 00:49:14.985
Well, and they have their own video editing software.
00:49:14.985 --> 00:49:16.228
They have Final Cut.
00:49:16.635 --> 00:49:28.251
Right, but it's not as professional a tool anymore it used to be, but when they redid Final Cut, like 10 years ago or whatever, it was into something like when they redid a Final Cut like ten years ago, whatever it was into something like the X.
00:49:28.251 --> 00:49:28.894
Yeah, exactly, final Cut Pro 10.
00:49:28.894 --> 00:49:30.157
That like everybody's like.
00:49:30.157 --> 00:49:31.922
What is this iMovie?
00:49:31.922 --> 00:49:35.402
You know like a lot of folks I knew like they really created.
00:49:35.443 --> 00:49:36.548
Adobe users out of.
00:49:36.548 --> 00:49:42.463
Yeah, it made you look really like in comparison to someone working on Adobe in the same editing suite.
00:49:42.463 --> 00:49:46.269
Literally you didn't know they're like is this wide rule?
00:49:47.115 --> 00:49:50.543
FCP yeah, Wide rule is a great way to actually.
00:49:50.675 --> 00:49:52.702
I'm not saying if you use wide rule, that it's.
00:49:52.702 --> 00:49:53.445
That's the point.
00:49:53.445 --> 00:50:04.503
It's like wide rule is just as good, but it looks like Apple kind of went too simple and it made folks who think that you need something incredibly complex to do something of quality.
00:50:04.503 --> 00:50:08.119
Look, I don't know what I'm doing, but this does that.
00:50:08.119 --> 00:50:09.003
It bridges the gap.
00:50:10.235 --> 00:50:17.108
The big issue with that to be clear on the FCP thing was that they removed all the tools that professionals were using and dumbed it down.
00:50:17.108 --> 00:50:19.382
So it's not so much that they just repackaged it.
00:50:19.382 --> 00:50:21.501
They removed things that pros were using.
00:50:21.556 --> 00:50:22.554
I was working on a project.
00:50:22.554 --> 00:50:23.721
It destroys your workflow right.
00:50:23.721 --> 00:50:25.132
You packaged it.
00:50:25.132 --> 00:50:25.711
They remove things that pros were using.
00:50:25.711 --> 00:50:25.981
I was working on a project.
00:50:25.981 --> 00:50:26.385
It destroys your workflow, right?
00:50:26.385 --> 00:50:26.969
You can't be a professional editor in that suite anymore.
00:50:26.969 --> 00:50:41.496
I was working on a project where we were using Final Cut Pro when X was released and we had a big discussion about well, we're not going to move to the next version of software because it destroyed all the tools that we're currently using.
00:50:41.516 --> 00:50:42.340
You can't go back.
00:50:42.340 --> 00:50:45.384
Everyone has to move up, and not everyone wants the license.
00:50:45.896 --> 00:50:49.920
Well, I mean you can hang on to the old one for a while, but eventually you have to.
00:50:49.920 --> 00:50:55.865
They'll just deprecate it and certainly now you're not going to have M chip support on the old version.
00:50:55.865 --> 00:50:56.907
It's like the Rapture.
00:50:58.496 --> 00:50:58.757
You're in or?
00:50:58.777 --> 00:50:59.159
you're out.
00:50:59.159 --> 00:51:00.619
But this is different.
00:51:00.619 --> 00:51:04.335
It's Blackmagic out.
00:51:04.355 --> 00:51:05.018
But this is different.
00:51:05.018 --> 00:51:05.942
It's black magic, it's open source, so it is.
00:51:05.942 --> 00:51:15.317
It is interesting that they, like, looked at another company with better expertise in both camera and editing software and said y'all do it they probably realized that their internal teams couldn't do it I mean it's smart, right.
00:51:15.398 --> 00:51:22.724
Instead of doing like, instead of reinventing the wheel yeah just
get somebody that has the sensor tech and like these are.
00:51:22.724 --> 00:51:33.693
Basically, we say they're 8K per eye, which is what they're generating, but they're the new 12K sensors that and it's all on one frame or on one sensor that is, it's two sensors.
00:51:33.693 --> 00:51:35.742
It is two sensors that are genlocked together.
00:51:35.742 --> 00:51:39.338
It's two 12K sensors that are producing two 8K images.
00:51:41.255 --> 00:51:42.019
I didn't realize it was.
00:51:42.396 --> 00:51:47.500
They're just saying 8K because when you're looking at the fisheye version, you're throwing away a lot of the Ks.
00:51:47.579 --> 00:51:48.481
Basically, yeah, what?
00:51:48.501 --> 00:51:49.204
30,000?
00:51:49.204 --> 00:51:50.347
That's what?
00:51:50.347 --> 00:51:53.371
So it's two full-frame 12K sensors.
00:51:53.371 --> 00:51:53.574
Is what?
00:51:53.594 --> 00:51:53.795
behind it.
00:51:53.795 --> 00:51:54.920
It's like a cool motorcycle.
00:52:07.994 --> 00:52:09.358
So it's got to in gen I'm using gen lock in more of a generic term.
00:52:09.378 --> 00:52:12.085
I bet they're like tied together on the circuit level.
00:52:12.106 --> 00:52:14.972
Yeah, so they're just because we have, there had been some, some, uh, the z cam.
00:52:14.992 --> 00:52:16.336
The z cam was a nightmare, the z cam.
00:52:16.336 --> 00:52:18.360
Well, and also I'd heard, I heard.
00:52:18.360 --> 00:52:28.003
I heard some um back in the day hugh had talked about even with cameras that were gen locked, there was frame mismatch yeah, you'll end up.
00:52:28.144 --> 00:52:29.068
You still end up with a frame.
00:52:29.068 --> 00:52:39.123
I mean, even we've seen several uh of the, even the newer, like sort of pocketable type cameras that have two, two cameras in them will drift one from the other on occasion.
00:52:39.123 --> 00:52:46.498
Um, it's one of those things that like, but again I think black magic doing what they're doing here have probably like.
00:52:46.498 --> 00:52:53.998
The k1 pro was basically two, two z cams just in the same body yeah genlocked, I think literally genlock technology.
00:52:53.998 --> 00:52:57.246
So they would drift and often and they also had a different.
00:52:57.887 --> 00:52:58.737
Um, they had different.
00:52:58.737 --> 00:53:02.969
I noticed one time I think it was a bug in the software they had two different color temperatures.
00:53:02.969 --> 00:53:04.355
Yeah, completely different color temperatures.
00:53:05.014 --> 00:53:06.077
Completely different color temperatures.
00:53:06.077 --> 00:53:07.501
This is what I was about to say.
00:53:07.501 --> 00:53:19.659
I've been in there, We've shot an entire project using the app Went in and set the color temperature in ISO and it only affected one of the lenses, and so we get the footage back and we're like, well, one of them's over here, one of them's over there.
00:53:19.679 --> 00:53:21.304
Yeah, so we had to go in and match the footage.
00:53:21.364 --> 00:53:21.905
No, we couldn't use it.
00:53:21.905 --> 00:53:23.090
We just couldn't use it.
00:53:23.170 --> 00:53:24.614
Yeah, that's right, we had to throw that out.
00:53:24.614 --> 00:53:25.521
One was completely underexposed.
00:53:25.561 --> 00:53:27.072
One was completely overexposed.
00:53:27.536 --> 00:53:33.836
Do you think this means if we in the future, if our supporters support us enough, can get one of these and livestream one of these shows?
00:53:34.858 --> 00:53:36.219
Yeah, I mean bandwidth.
00:53:36.219 --> 00:53:39.284
Yeah, huge bandwidth, absurd bandwidth.
00:53:39.284 --> 00:53:41.005
It has to be compressed.
00:53:41.005 --> 00:53:48.130
This pipeline won't work as it is live.
00:53:48.130 --> 00:53:52.221
It has to be encoded down into like AV1 or something Granted.
00:53:52.221 --> 00:53:55.157
With this I mean with DaVinci and the Apple pipeline.
00:53:55.157 --> 00:53:59.637
You use MVHEDC, which is even more efficient than AV1.
00:54:01.864 --> 00:54:03.380
But someday when James Cameron.
00:54:03.563 --> 00:54:14.003
I mean live streaming with these cameras would require significant infrastructure, like you would have to make sure that you're on a 10 gig network.
00:54:14.222 --> 00:54:14.403
Yeah.
00:54:15.567 --> 00:54:15.867
Minimum.
00:54:16.396 --> 00:54:18.114
Yeah, I mean well, yeah, exactly.
00:54:18.114 --> 00:54:24.257
Or if you're trying to live stream to the internet, that's just not going to happen, so you would have to, so not in In this pipeline.
00:54:24.257 --> 00:54:33.664
It would be like could you encode it down and then keep the metadata pipeline, but then you're only serving to avps yeah, I'm not going to say it couldn't happen.
00:54:33.704 --> 00:54:48.846
I think it could happen, but, um, it would require a lot of yeah, we're just not there yet yeah, a lot of tech that you would need to develop or find the people, because there are people who do these types of live streams.
00:54:49.335 --> 00:54:50.722
We're just not South Korea yet.
00:54:52.320 --> 00:54:52.983
They do exist.
00:54:52.983 --> 00:55:01.306
You just need to sort of vulture on them together into one place, and currently the industry doesn't have a lot of infrastructure for that.
00:55:01.306 --> 00:55:02.603
But there are people who are trying to make it happen.
00:55:02.603 --> 00:55:13.608
And there are people who are trying to make it happen and there are companies that are trying to make it happen, but none of them have really come to market yeah, yeah, people are claiming that they will.
00:55:13.628 --> 00:55:14.610
Yeah, yeah, yeah.
00:55:14.610 --> 00:55:16.615
I keep saying like oh, we finally cracked it.
00:55:16.615 --> 00:55:17.478
Join the wait list though.
00:55:17.478 --> 00:55:23.427
Yeah, it's finally here, but you're gonna have to wait, yeah, uh, so I mean.
00:55:24.367 --> 00:55:33.878
The truth of the matter is that this camera is most likely going to be the industry standard, probably for the next 10 years.
00:55:33.878 --> 00:55:34.500
I'm guessing.
00:55:34.760 --> 00:55:47.257
I would guess because it's gonna take a while for, like, obviously, adoption to happen because it is so expensive, but it's not crazy expensive in terms of what you're getting caliber of what it is uh, and the caliber cameras, you know.
00:55:47.257 --> 00:55:49.043
So there's a lot of people complaining about how expensive it is.
00:55:49.043 --> 00:55:52.327
I'm like that's what it takes to get truly good footage though.
00:55:52.347 --> 00:55:54.215
Right, I mean well, and this is this is not.
00:55:54.215 --> 00:55:56.382
This isn't even a prosumer camera.
00:55:56.382 --> 00:55:59.974
This is a professional camera, made for professional tools.
00:55:59.974 --> 00:56:13.505
So any here's the thing, though like to be able to even work off of this camera in post-production, you're going to need an extreme storage solution.
00:56:13.786 --> 00:56:17.684
Yeah, I mean if, unless you just work directly off of the modules that are in it.
00:56:17.684 --> 00:56:28.583
So to that end, I forgot, we didn't mention this at eight terabytes, eight K per eye, 90 frames per second, using BRAW's 12 to 1 compression ratio.
00:56:28.603 --> 00:56:29.166
Oh God, what is it?
00:56:29.835 --> 00:56:34.239
It's an hour and like 23 minutes that you can record on eight terabytes.
00:56:34.239 --> 00:56:35.623
Oh my God, I mean.
00:56:36.697 --> 00:56:38.027
That's insane.
00:56:38.027 --> 00:56:39.898
That's a lot how much is this.
00:56:40.601 --> 00:56:42.378
It is sorry.
00:56:42.559 --> 00:56:43.963
It's like one terabyte an hour.
00:56:43.963 --> 00:56:45.500
Right, Our product is just under.
00:56:45.539 --> 00:56:47.543
Yeah, it's like 55 minutes, a terabyte basically.
00:56:47.574 --> 00:56:49.202
And we're like a half hour to 40 minutes.
00:56:49.202 --> 00:56:54.067
So that is one-eighth, about one-eighth of the storage time.
00:56:54.135 --> 00:56:55.521
It's the fact that, because we're doing 8K total.
00:56:55.521 --> 00:57:00.543
So if you double the resolution and then 50% more frames per second, good Lord.
00:57:01.425 --> 00:57:05.119
Yeah, so Present more frames per second.
00:57:05.119 --> 00:57:07.652
Good Lord, yeah, so yeah, I mean, that's it we need 30 grand yeah.
00:57:07.652 --> 00:57:10.199
Well, we need a lot more than 30 grand.
00:57:10.199 --> 00:57:13.327
I can tell you that We'll start small.
00:57:13.327 --> 00:57:18.824
Yeah, I mean, our goal is to get a fleet of these at some point.
00:57:19.085 --> 00:57:22.204
Yeah, got some ideas that would require at least three of them, yeah.
00:57:22.204 --> 00:57:31.063
More on that later, yeah, but yeah we Impressive tool that we're really stoked to play with.
00:57:31.063 --> 00:57:31.978
But there's not.
00:57:31.978 --> 00:57:35.579
You know, the features aren't even in DaVinci yet they're still in beta.
00:57:38.099 --> 00:57:39.704
Well, I mean even DaVinci 20 beta is.
00:57:40.164 --> 00:57:41.027
This is like pre-beta.
00:57:41.835 --> 00:57:47.246
They're probably like handing you like an install that they've been working on.
00:57:47.246 --> 00:57:50.264
That's included For the people who get the camera.
00:57:50.324 --> 00:57:52.155
Yeah, exactly, you probably get a download.
00:57:53.157 --> 00:57:57.467
And they're probably like hey, you're our bug testers now.
00:57:58.275 --> 00:58:01.965
Because they're still saying that they're working on even more features.
00:58:03.297 --> 00:58:05.784
Well, and essentially how this rollout goes.
00:58:05.784 --> 00:58:08.239
Is they for anybody who bought this camera?
00:58:08.239 --> 00:58:11.780
They had to who are getting the units now?
00:58:11.780 --> 00:58:15.059
They had to tell them exactly the projects they were going to be shooting with them next.
00:58:15.059 --> 00:58:24.467
Right, because they want to control what that footage looks like, because it's going to be effectively their Main advertising.
00:58:24.507 --> 00:58:24.867
Exactly.
00:58:25.579 --> 00:58:30.425
The first impressions of the camera for the people that are using it right out of the gate.
00:58:31.675 --> 00:58:34.284
It's always kind of been a first mover in this realm.
00:58:34.284 --> 00:58:36.561
Bug testing, I think, is a way to put it.
00:58:36.561 --> 00:58:42.972
But when you pay $30,000 for a product, don't you expect customer service to really?
00:58:43.052 --> 00:58:44.119
Oh sure, yeah, and it's not even official.
00:58:44.119 --> 00:58:45.927
Yeah, and I mean there's going to be, and it's not even officially.
00:58:45.927 --> 00:58:47.510
Yeah Right, it's still just on pre-sale.
00:58:47.773 --> 00:58:48.438
Yeah, so it's.
00:58:48.438 --> 00:58:52.422
It's literally the first cameras are starting to get into people's hands right now.
00:58:52.422 --> 00:59:01.985
So it's, it's a uh there probably will be quite a bit of hand the wild at this point.
00:59:01.985 --> 00:59:06.210
I like the way we do it, yeah, so okay, that's it.
00:59:06.210 --> 00:59:07.456
We got to run.
00:59:07.456 --> 00:59:16.039
This is a short one today, but I think the Ursa Immersive stuff is huge, the Ivory stuff I'm pretty excited about.
00:59:16.039 --> 00:59:18.119
I think I will pick up a PSVR 2.
00:59:18.119 --> 00:59:24.543
Yeah, and that's it for Stereoscope, podcast number 13.