25 ms·
Google Photorealistic 3D Tiles and Unreal Engine
- stijnbakker 3y agoAwesome project by Nils Bakker. Linking 3D tiles to Unreal Engine and ChatGPT.
- agoose77 3y agoHehe, by you, you mean? ;) This is a really fun way to combine something that is being discussed to death with something that is visually beautiful. I'm fairly disinterested in most ChatGPT usages at the moment, but this is a really good way to show its utility. Particularly because it doesn't place _too_ much emphasis on the factual accuracy of the responses ;)
- dark-star 3y agoWhat, you don't think FC Barcelona is the best football club in Europe? ;-)
- itsmartapuntocm 3y agoLooks like it got the ol’ HN hug
- jonplackett 3y agoI’m sure if we all just stay on the site and hammer refresh it will load eventually…
- tantalor 3y agoIt's not so impressive when you find out it's just a Unreal engine plugin. This is a mashup.
- HanClinto 3y agoThis is really superb! Fantastic execution and excellent combination of tools. Is there a way that we can play with this ourselves, or is it just the demo video? Either way, it's really great!
- ceejayoz 3y agoIf you like this, you'll probably love the current version of Microsoft Flight Simulator.
- 55555 3y agoHOW DO I PLAY?? (serious)
- 55555 3y agoDoes anyone know how big the files tend to be for a city? I'd love to make this into a mobile game so everyone can explore the world when bored.
- OmarShehata 3y agoUnfortunately you're not allowed to ship these files with your game. They have to stream directly from Google's servers for each user (caching is allowed as long as you follow standard caching rules). A chunk of Manhatten I extracted is about 30mb glTF, but 7mb with all compression options in gltf-Transform (https://twitter.com/Omar4ur/status/1657361031763578881 https://twitter.com/Omar4ur/status/1657361031763578881). But this is not the highest resolution available. See terms of use: https://developers.google.com/maps/documentation/tile/policies https://developers.google.com/maps/documentation/tile/polici...
- crazygringo 3y agoMicrosoft Flight Simulator. (serious)
- rvnx 3y agoIt's a bit the same story as GPT: Early: Google does primitive tech (Google Earth) Later: Microsoft does amazing implementation (Flight Simulator / Bing) Finally: Google tries to copy but fails (Google Maps)
- deleted 3y ago[deleted]
- andybak 3y agoHuh? Google Maps predates Google Earth and neither really relate to MS Flight SIM.
- cheeaun 3y agoLooks insanely cool! I also made a simple web-based demo with Deck.GL + shadow lighting + post-processing effects here: https://cheeaun.github.io/photorealistic-3d-deckgl/ https://cheeaun.github.io/photorealistic-3d-deckgl/ There's a limit of 250K "3D Tiles renderer requests per day" so it'll stop serving tiles if exceeded.
- 55555 3y agoThanks for the info. This is per API key? How many renderer requests does a user use per minute? I'm just trying to figure out if this is something that can be used in an app at scale.
- cheeaun 3y agoLimit applies per project if I’m not mistaken. More info here https://developers.google.com/maps/documentation/tile/usage_limits https://developers.google.com/maps/documentation/tile/usage_... I’m not really sure if there’s a limit per user. It’s still beta and I can’t or don’t dare to increase the quota for now.
- snickmy 3y ago"message": "Quota exceeded for quota metric '3D Tiles root requests' and limit '3D Tiles root requests per day' of service 'tile.googleapis.com' for consumer 'project_number:174664172126'.",
- cheeaun 3y agoFor those wondering how it looks like, I have a thread here with lots of screenshots https://twitter.com/cheeaun/status/1657727482492235777 https://twitter.com/cheeaun/status/1657727482492235777
- s9w 3y ago[dead]
- canbus 3y agoHas been HN'd I think!
- helsinkiandrew 3y agohttps://archive.is/oxZKS https://archive.is/oxZKS
- blinding-streak 3y agoYouTube video from the project: https://www.youtube.com/watch?v=_cziz3qYT4Q https://www.youtube.com/watch?v=_cziz3qYT4Q
- samstave 3y agoThis is amazing - it will be cool when these models in unity can be turned into real buildings where one can design the interiors as well, and maybe use this in Hitman to play real cities.
- samstave 3y agowhat if you could own a build and the receive points on either survival or the other version points? And you can build your own maps - and you set A and B and you win creds based on winner. Fuck you Morgan Roberts at BLIZZARD you stole my legos
- artificial 3y agoThanks for the video! Really neat technology, seems like a great way to explore. Something about the FOV makes me ill.
- SamBam 3y agoIt's super cool. Does the 3D tile mao extend down to the street level? I would have loved to see flying along the streets between the buildings.
- seabass-labrax 3y agoMight it be the extreme chromatic aberration? I once read an article saying how to achieve 'photorealism' in computer graphics, one should add chromatic aberration, as that's what camera lenses naturally produce. I think some people take it too far though!
- shrx 3y agoNo lenses except the cheapest Chinese ones made for CCTV cameras exhibit noticeable chromatic aberrations. It's really annoying it's being pushed in video games so much lately.
- sambeau 3y agoAs someone who worked at Realtime Worlds on the MyWorld project, this is very poignant. https://en.wikipedia.org/wiki/Realtime_Worlds https://en.wikipedia.org/wiki/Realtime_Worlds https://en.wikipedia.org/wiki/Project_MyWorld https://en.wikipedia.org/wiki/Project_MyWorld
- dark-star 3y agoInteresting! Do you have some more details you could share, like screenshots or trailers/videos? Sadly the video link to the trailer on YouTube is not working anymore.
- sambeau 3y agoThis is one of our demos from 2008, which looks very similar (though we aren't using Google Maps data, we're mostly using OS map data). It's also long before an art pass, so the textures, trees, building, road etc are just placeholder. https://www.youtube.com/watch?v=pfJwX_HnLpU https://www.youtube.com/watch?v=pfJwX_HnLpU This is Mike (who did the first lemmings)'s test to se how many lemming-like things you could render in the world. He, myself, and Bill (GTA physics) went on to build a fun game out of this where you could run over them in tanks and blow them up. https://www.youtube.com/watch?v=2O6WS1VolKA https://www.youtube.com/watch?v=2O6WS1VolKA Blowing them up test: https://www.youtube.com/watch?v=SJHRdVaUtDs https://www.youtube.com/watch?v=SJHRdVaUtDs
- jamesfmilne 3y agoHi Sam, I worked at Real Time Worlds on that too. Probably before it was called My World, then I think we were calling it Real Driving or something then. Small world! Cheers James
- sambeau 3y ago:wave emoji:
- speedgoose 3y agoBy the way, Google Earth VR (2016) provides a similar experience but in virtual reality. Seing 3D graphics with depth improves a lot the experience. You also have some nice features such as the possibility to grab the sky to rotate the sunlight. This demo looks nice though. The post processing has nice colours, though the fake chromatic aberrations may be a bit high.
- Adrig 3y agoTo this day this is the best experience I had in VR by far. I spent hours roaming the earth, it's truly amazing. It's sad that Google is massively underutilizing this asset.
- modeless 3y agoWhat should Google be doing with it?
- TheRealPomax 3y agoTeam up with microsoft and asobo.
- hackernewds 3y agobut what about capitalism?
- TheRealPomax 3y agoWhat about it? Google charges MS/ASobo a "friendly" license fee, and MS/Asobo get a feature they can use to attract more players. All parties stand to gain concrete dollar amounts, the very backbone of capitalism.
- modeless 3y agoThey seem to be doing fine on their own. I prefer to have some competition.
- stijnbakker 3y agoJust some context - this is not me, but former colleague of mine :-) (even though we share the same surname)
- badrequest 3y agoI really appreciate this disclaimer. :)
- r34 3y agoIt could be a great introduction to the metaverse. Imagine adding the interior spaces by making the doors and windows openable. Then allow for more and more interactions. A lot could be done by algorithms (image recognition, etc.), but I think a lot of users would be interested in "building this new world". Adding procedurally generated spaces through portals would be a great next step. We are not far away from being able to "create a castle described by X in Y mixing painting style of Z and sculpture style of Ź". Maybe transforming between these styles and others in time.
- benstrumental 3y agoVery cool! Here's a tutorial from Sebastian Lague on implementing something similar in Unity, which may have served as inspiration for this project: https://youtu.be/sLqXFF8mlEU https://youtu.be/sLqXFF8mlEU
- andybak 3y agoI think the inspiration was the release of a new Google API last week along with support for it via Cesium's Unity and Unreal plugins.
- nkozyra 3y agoYeah. Sebastian Lague's game videos are great because of the way he walks through his steps & methodology, but wrt his geographic implementations it's not how you would approach this problem for this level of granularity.
- bluehat974 3y agoIt's just killed Flight Simulator
- lostgame 3y agoWell, except for; y’know…all the ‘Flight Simulation’ parts, uh, sure…?
- pookha 3y agoYou can do this stuff with drones and open source tools. I used a cheap 100 dollar intel drone to take photos of my house and processed the pictures using (alice vision?) software that built the 3D mesh. My idea was to package something together for a home remodeling system that would let people measure and look at their houses with a 3D model but it just so happens that I live in the no-drone radius within Washington DC. Cesium also has a pretty nice 3D tiling photogrammetry service.
- deleted 3y ago[deleted]
- _puk 3y agoHow long would it take the drone to reach Utrecht?! I think the beauty of this is the fact that it's now easy to do this for anywhere that has coverage from Google tiles. I'd love to see a side by side of achieving this with Unreal Vs open source tools though, would give a good indication of the gap between them (if any). On a side note.. regulation came in quite quick for the no-drone areas in a lot of places, scuppered our farmer unmanned livestock checking startup idea!
- jeroenhd 3y agoThere's no way the drone would reach without breaking the law (or with you walking behind your drone the entire time). Drone pictures are nice but most people aren't allowed to fly them in many places and even if they are, many densely packed cities have restrictions of their own.
- renewiltord 3y agoThese days you could probably get away with a handheld video and NeRF software if you wanted to add a missing place to this thing. Very impressive work from OP! And cool suggestion from you.
- mring33621 3y agoAll I can say is WOW WOW WOW Very nice! Throw in some Carmen Sandiego stuff and i'd buy this for my kids
- silverfrost 3y ago404 for me
- opyate 3y agoFor the OP: Warning: Potential Security Risk Ahead Firefox detected a potential security threat and did not continue to nilsbakker.nl. If you visit this site, attackers could try to steal information like your passwords, emails, or credit card details. And: $ curl https://nilsbakker.nl/portfolio/3d-tiles/ https://nilsbakker.nl/portfolio/3d-tiles/ curl: (60) SSL certificate problem: self-signed certificate More details here: https://curl.se/docs/sslcerts.html https://curl.se/docs/sslcerts.html curl failed to verify the legitimacy of the server and therefore could not establish a secure connection to it. To learn more about this situation and how to fix it, please visit the web page mentioned above. (hf-course-3.9.13)
- mrbungie 3y agoNo problems here, it displays as a "Let's encrypt" certificate.
- argiope 3y agoThese are the fields on the certificate that's being presented to me: emailAddress = root@dns-redirect001.axc.nl, CN = dns-redirect001.axc.nl, OU = SomeOrganizationalUnit, O = SomeOrganization, L = SomeCity, ST = SomeState, C = -- A self-signed certificate that expired on 6/11/19, 4:35:46 PM GMT+2 It's probably been taken down.
- jeroenhd 3y agoIt works for me (again) but I remember that server domain from my old Versio shared hosting account. They used to be the typical "dirt cheap, low spec, PHP 5.4" hoster of choice for students and people looking to save a buck, but they've since raised their prices significantly (and I don't think they've raised their quality of service much). Would not recommend. I wouldn't recommend shared hosting in the first place, but if you do, it's worth looking around for better hosts. There's a good chance you'll be better off with Github pages for hosting websites that you expect any visitors to see.
- 3y ago
- bhouston 3y agoIncredible! The video music is also amazing. (But the slight chromatic aberration was distracting.)
- davidy123 3y agoI cannot stand the music, or music in any video of this type. I don't need or want its loaded suggestions. I would love to be able to hear even simulated wind whistling, and sounds from the scenes below.
- crazygringo 3y agoYou're free to mute the video, that's what mute is for. As for sounds from the scenes below, that's a lot of work. Where do you think people should source that from?
- davidy123 3y agoOh, I know all about mute. 30-ish years ago, DVD players supported alternate soundtracks so people could offer a soundtrack with music and without. I don't think I've ever seen that basic affordance on a web video. That would probably lead to more diegetic sound, and the tools to simulate it.
- abdellah123 3y agocrazy!! Video here https://www.youtube.com/watch?v=_cziz3qYT4Q&ab_channel=NilsBakker https://www.youtube.com/watch?v=_cziz3qYT4Q&ab_channel=NilsB... source available somewhere?
- abraxas 3y agoLovely simple Unreal project. It's amazing how much can be accomplished with Blueprints when all the necessary functionality is at your disposal (although it can be hellish when it's not). I have such a love/hate relationship with UE. Sometimes it will blow me away with how some stuff just works with a few blueprints and other times (especially around physics) it just wants to do stuff its way or the highway.
- qalmakka 3y agoUE looks cool, it's full of features, but it's also full of warts (especially when you realize how poorly designed and implemented certain parts are, and the huge mess they made with their C++). My major issue with blueprints is that they are always abused and turn into an unmaintainable mess in the blink of an eye. The company I work at has a massive UE-base codebase and we've been working hard for months to purge as much blueprint logic from our it as we can because it's simply impossible to maintain them. Epic is pushing them hard but I just can't see them as more than a way for amateurs to mock up stuff.
- abraxas 3y agoYeah, after my initial honeymoon I'm souring on blueprints fast. Working with them on a team using version control must be a bit of a nightmare. Not having a way to export them into a human usable formal (say a good quality Lua style DSL) means excluding all kinds of tooling that could be built by other parties for handling text based code.
- qalmakka 3y agoWhat UE sorely lacks is a good scripting language. It's clear to me that Tim Sweeney wanted to offer a C#-like experience, but using C++ - IMHO UE failed in any possible way to accomplish that - Epic made a sawed-off shotgun in place of a precision weapon. There are just a gazillion ways to introduce concurrency and memory issues in UE, but most of the time it's "fine" because for a videogame some aspects (like proper memory management, safety, ...) are less important than CPU cycles. A game often behaves as if it's the only application running on a machine, and if it gobbles too much RAM the usual answer the developer gives its users is, "buy more". Thankfully this has been changing in the last few years due to mobile gaming and freemium, which forces companies to target not top-notch machines but cheap laptops.
- folli 3y agoI also tried my hand on integrating the Google Earth Tiles with Cesium.js for GPS Track visualization: https://cubetrek.com/static/highresmode.html https://cubetrek.com/static/highresmode.html It basically allows you to replay your hikes, running or biking adventures in 3D. I wonder how much Google's gonna charge once it's out of experimental mode.
- yosito 3y agoIt would be really cool if there was more shared than a blog post with a video. What about either a tutorial, source code, or a link or download to use this ourselves?
- Paul-Craft 3y agoThe post itself has a pretty decent, high-level walkthrough.
- jamesfisher 3y agoCould be a fun variation on Geoguessr
- deleted 3y ago[deleted]
- therealmarv 3y agoI just keeping thinking about Terravision and "The Billion Dollar Code" from Netflix while watching the video.
- J_cst 3y agoThat's an amazing project *** Bravo!
- helloplanets 3y agoI remember toying with Google Earth a year or so back, thinking it'd be amazing if the actual Google Maps API would give access to that level of granularity. Was sort of baffled as to why they wouldn't. Definitely gonna give this a shot. P.S. For those who haven't visited Google Earth (instead of Google Maps) in a long time, it's alive and well, and still pretty fun to go on a mini excursion with: https://earth.google.com/web/ https://earth.google.com/web/
- Obertr 3y agofeels like magic. Those small steps like take me to the biggest city and it magically goes to Barcelona is something from the future.
- waltbosz 3y agoFor years I've been dreaming of a driving/pedestrian sandbox game that used Google Maps data to let me drive recklessly around my home town with accurate models of the buildings and roads. This demo reminds me of that dream.
- crazygringo 3y agoMe too. The problem seems to be mainly that the models are still awfully approximate and the textures are horribly blurry. They're fantastic for a bird's-eye view or flight simulators, but not what you want for driving. I'm hoping that at some point in the next 10 years, Google/Microsoft come up with a high-res version produced mainly by Street View-type data or similar drone-supplied data. I suspect that basic photogrammetry is the easy part -- that the challenging part is dealing with changing sun position, hourly/daily/monthly weather/seasons, and all of the pedestrians and moving/parked vehicles.
- darkwraithcov 3y agoAI upscaling with diffusion models will probably solve that problem.
- waltbosz 3y agoThat's what I was thinking. The satellite photos are detailed enough to see lane lines, and combine that with the street level photos will get you the road configuration. But I think whatever data GPS software uses is already detailed enough to know lane config, it tells you exactly what lane to be in when making turns.
- tomaaron 3y agophotogrammetry is old. Check out NERF. https://youtu.be/DJ2hcC1orc4 https://youtu.be/DJ2hcC1orc4
- rzzzt 3y agoLiDAR-mounted drones are available, although a ground-level thingy can also generate neat point clouds in its vicinity: https://enterprise-insights.dji.com/blog/lidar-equipped-uavs https://enterprise-insights.dji.com/blog/lidar-equipped-uavs
- stefantalpalaru 3y ago[dead]
- majikandy 3y agoThis is amazing! I was mesmerised and watched the whole video hoping it wouldn’t end. How do we try it for real?
- birdyrooster 3y agoWow that was nauseating, Google really has terrible maps data. Garbage in, garbage out I suppose.
- andybak 3y agoWho has better data, may I ask? I'd love to know because I've been looking for several years
- joeldo 3y agoI'd imagine there would be a fair amount of hallucination with ChatGPT generating the Lat/Long pairs (especially for smaller cities/towns)?
- deleted 3y ago[deleted]
- miohtama 3y agoVery cool! AI should to context fill more detailed textures and fix some geometry issues with the buildings.
- sph 3y ago[dead]
- ChrisClark 3y agoI think you're looking for this thread. https://news.ycombinator.com/item?id=36000631 https://news.ycombinator.com/item?id=36000631
- dang 3y agoI've moved it thither on the assumption that you're correct. Thanks for watching out for a fellow user!
- Ziggy_Zaggy 3y agoVery impressive!
- crtified 3y agoI remember working in this field about 15-20 years ago. And separately, in my spare time, playing video games like Crysis. It was quite apparent even then, that video games were generally light years ahead at visualisation. Back then, one could - using professional, multi-thousand-dollar software, and expensive services like land surveyors - painstakingly, manually build up a small-scale 3D scene encompassing an individual owners land. The result would look average/generic, and the rendering performance and navigation limitations would be abysmal. On that same PC, one could then load up Crysis, marvel at the vastly superior output, navigability, and point-of-view realism - covering massive land areas - and think 'Holy Shiz, if I could just get my data into this, it'd be a revelation, industry-changing'. It's great to see how things are progressing.
- Shorel 3y agoThis shows how insanely optimized game engines are, and game development in general. All enterprise software is optimised in man/hours, as in the maximum amount of features for some given hours of work. Enterprise customers will then invest in the extra hardware, because "developers are more expensive than computers". Games can't afford that, they need to run in many different kinds of shitty and good hardware, so it is optimised over and over, by very dedicated and underpaid developers. And they mostly code in C++. But games are sold by the millions, so it's a different market.
- welru 3y ago[flagged]